Burp Suite User Forum

Create new post

Crawler not populate certain URL to sitemap

Randy | Last updated: Feb 10, 2022 04:12PM UTC

Hi, I am using the Burp Pro, and noticed a weird behavior with Burp. In the Crawler logger, I saw that crawler sent requests to '/api/...', but that 'api' branch never get populate in the sitemap. The crawler is setup with the following scan configure: 1) Crawl Strategy - more complete 2) Never stop crawl due to application errors The Target sitemap filter is set to show everything. I also open Burp with a brand new state, but still seeing the same issue. When I sent one of the '/api/...' to repeater and resend the requests, the sitemap will populate that URL. Do you know why I am seeing this issue?

Michelle, PortSwigger Agent | Last updated: Feb 11, 2022 09:41AM UTC

Thanks for your message. Can you email some screenshots or a screen recording showing examples of the requests you see in the Crawler logger, the request you send in Repeater, and the behavior you see in the Site Map to help us better understand your issue and replicate it here, please?

You must be an existing, logged-in customer to reply to a thread. Please email us for additional support.