Crawling volatile content

Published

2018-08-06 16:23

Collected

2026-07-01 11:08

---
id: 394
title: "Crawling volatile content"
source_domain: portswigger.net
source_url: "https://portswigger.net/blog/crawling-volatile-content"
published_at: "2018-08-06T16:23:00Z"
tags: ["burp-suite", "crawler", "web-crawling", "mobp", "volatile-content"]
phying_url: "https://phying.com/item/394"
lang: en
---

# Crawling volatile content

## Summary

Burp's new crawler handles volatile content by identifying locations from their contents rather than URLs and modeling highly variable links as non-deterministic edges in its graph.

## Intelligence Metadata

- **Sources:** portswigger.net
- **Published:** 2018-08-06T16:23:00Z
- **Original:** https://portswigger.net/blog/crawling-volatile-content
- **Phying News:** https://phying.com/item/394