Burp Suite User Forum

Create new post

Crawler not following links

soein | Last updated: Nov 23, 2023 10:04AM UTC

Hello, I am currently trying to crawl a gitlab page and scan for keywords. I can access the gitlab repositories but the crawler is not following any further links in the repositories itself. I have tried different crawler settings (link depth, crawl strategy, click all clickable elements etc.) but no luck. Any suggestions?

Thomas, PortSwigger Agent | Last updated: Nov 23, 2023 10:31AM UTC

Thank you for letting us know about this. Could you let me know if this issue is happening while using Burp Suite Enterprise or Burp Suite Professional? If you are using Burp Suite Professional, have you viewed the Live Crawl View or Crawl Paths to see what the Scanner was doing during the Crawl? Did it appear to get stuck anywhere? If you are using Burp Suite Enterprise, please email us at support@portswigger.net with the Scan Logs from a scan against this application, and we will take a look at if there are any issues or exceptions we can help reduce or remove.

You must be an existing, logged-in customer to reply to a thread. Please email us for additional support.