Research Academy
My account Customers About Blog Careers Legal Contact Resellers
The Burp Suite User Forum was discontinued on the 1st November 2024.

Burp Suite User Forum

For support requests, go to the Support Center. To discuss with other Burp users, head to our Discord page.

SUPPORT CENTER DISCORD

Improve "remove duplicate URLs" of "Consolidate Items" feature

Michael | Last updated: Aug 13, 2021 08:14AM UTC

Hi, the "remove duplicate URLs" feature of consolidate items is "to general", i.e.: http://www.domain.com/index.php?id=123 http://www.domain.com/index.php?id=123&page=2 ...whereas the first URL should be removed by the "remove duplicate URLs" feature, but it doesnt. Other example where this option is inaccurate: http://www.domain.com/eshop/product/some-fancy-product/details.php?show=true http://www.domain.com/eshop/product/some-other-product/details.php?show=true http://www.domain.com/eshop/product/some-more-products/details.php?show=true http://www.domain.com/eshop/product/<...>/details.php?show=true ...whereas the domain and the request is basically the same, but only one part of the url changes, the product (but requesting details for each product is the same construct of request). Scanner can check for this situation with regex and for example if the name/number of parameters is the same, then this would indicate a duplicate request. Maybe two options to choose from would suit, the one we have now and then a more strict setting, that acts to above given situations. Thanks & Cheers, Michael.

Uthman, PortSwigger Agent | Last updated: Aug 13, 2021 10:18AM UTC