Black Widow Crawler for TOR network to search for criminal patterns

Abstract

This work aims to develop the Black Widow crawler focused on the Tor network, which searches, analyzes, and indexes websites containing criminal patterns. Also, a comparison of the results of the Black Widow crawler with one of the best crawlers found during information gathering is carried out, to confirm the possibility of an improvement in the current crawlers of the Tor network. The experiments demonstrate that the current crawlers can be improved. Compared to the current crawler, the Black Widow crawler achieved a 240% improvement in the number of indexed secret services.