ESG Web crawling now allows crawl depth configuration

Website Crawling Enhancements

• The website scanner now uses the new crawl engine that powers Briink's batch screenings, additionally the crawl depth parameter has been re-added to URL crawl jobs, giving you more control over how deeply the system crawls websites during document collection.
• Enhanced web crawler with better detection of blocked requests for more reliable document fetching