Research Academy
My account Customers About Blog Careers Legal Contact Resellers

Burp Suite User Forum

Create new post

Burp suite Community 2.1 Crawl

Venom | Last updated: Jun 28, 2019 01:06PM UTC

Hello, I'm not sure am i doing something wrong or why Crawl scan is not working? After i configured settings and started it, it says "Crawl finished." under dashboard. Other thing i noticed that under "Proxy" and "Intercept" there is "Intercept is Ofl" not "Off". Best regards

Liam, PortSwigger Agent | Last updated: Jun 28, 2019 01:08PM UTC

Do you see any errors in the Event log? If you manually browse the site does the Target > Site map populate?

Burp User | Last updated: Jun 28, 2019 01:13PM UTC

No errors in Event log. Yes manually everything works perfectly.

Liam, PortSwigger Agent | Last updated: Jun 28, 2019 01:31PM UTC

Sorry, I didn't notice that you're using the Community Edition. Burp Crawler is part of Burp Suite Professional.

Burp User | Last updated: Jun 28, 2019 02:02PM UTC

Ohh, allright. So in the ver. 2 in Community version there is spider function gone too or is there anything similar to that?

Liam, PortSwigger Agent | Last updated: Jun 28, 2019 02:23PM UTC

The Spider function has been removed from Burp 2 Pro and Community. The Spider was becoming increasingly obsolete for use with modern applications. We are considering adding another task to both Pro and Community that would fetch content in the same way Burp Spider would. Unfortunately, we can't provide an ETA for this feature.

Burp User | Last updated: Jun 30, 2019 07:58AM UTC

I'd also be interesting in finding an answer to this. Is there any equivalent to Spider in the Community Edition post v2 or has that been stripped out and restricted to paying customers?

Burp User | Last updated: Jul 15, 2019 12:27PM UTC

If the crawling feature is restricted to the Pro version, can this be indicated in the UI on Community? Currently when you right click on a site and chose "Scan", you get taken to the "New scan" screen. The "Crawl and audit" and "Audit selected items" options are both greyed out with some text indicating that they're only available in pro, but "Crawl" doesn't have this, and it lets you configure the scan and apparently run it. The scan then completed immediately with no requests, and no indication that this functionality is only available in the paid version. This means wasted time for both Venom and myself (and probably others) trying to work out why the Crawl doesn't seem to be doing anything, until I came across this thread which says that's by designed. It also makes it just makes it look like the feature is broken. Please can the "Crawl" option be disabled like the auditing options are so this is clear in future? Or even just the whole "Scan" menu item, since it does nothing in Community. Thanks - JP

Rose, PortSwigger Agent | Last updated: Jul 16, 2019 02:31PM UTC

JP, thanks for this report. It should have been fixed in the latest version. Let us know if there are still any issues.

Liam, PortSwigger Agent | Last updated: Sep 18, 2019 02:12PM UTC

Burp 2.0 has moved to a task-based model. - https://portswigger.net/blog/burp-2-0-where-are-the-spider-and-scanner

Burp User | Last updated: Sep 22, 2019 08:30AM UTC

I want spider option in new burp suite edition... without spider option how to vulnerability???

Burp User | Last updated: Oct 14, 2019 09:17AM UTC

without spider how to do vulnerability???. It's more then 4 months this latest version still did not fix issue?? How to move the older version ??

Liam, PortSwigger Agent | Last updated: Oct 14, 2019 09:43AM UTC

Burp Spider has been replaced by Burp Crawler: - https://portswigger.net/blog/burp-2-0-where-are-the-spider-and-scanner You can download older version of Burp from your account page on our website: - https://portswigger.net/users If I can be of any further assistance, please let me know.

Ben, PortSwigger Agent | Last updated: Oct 14, 2019 10:54AM UTC

Hi, Only Live Passive Crawl is currently available in the latest version of Burp Community.

Burp User | Last updated: Dec 09, 2019 04:23AM UTC

The Spider function has been removed from Burp 2 Pro and Community. We are considering adding another task to both Pro and Community that would fetch content in the same way Burp Spider would. Unfortunately, we can’t provide an ETA for this feature. Any ETA update[Spidering Option] for Community users? Thank you

Ben, PortSwigger Agent | Last updated: Dec 13, 2019 08:53AM UTC

Hi, Burp 2.x moved to a task based model. With the new task-based model, you can configure multiple parallel scans, each with their own settings, and independently monitor and control each task. Please see the following link for more information: https://portswigger.net/blog/burp-2-0-where-are-the-spider-and-scanner

Burp User | Last updated: Dec 14, 2019 01:47PM UTC

Why the newer version of Burpsuite doesn't have spider option,,, and also New Scan option is Unable in my community version

Burp User | Last updated: Jan 04, 2020 11:01AM UTC

What is the replacement for spider in community edition.

Michelle, PortSwigger Agent | Last updated: Jan 06, 2020 01:46PM UTC

Community uses the same task-based model as Professional in 2.x, so this article applies to Community too: https://portswigger.net/blog/burp-2-0-where-are-the-spider-and-scanner

You must be an existing, logged-in customer to reply to a thread. Please email us for additional support.