1.1 Goals - montequie/darknet-network-topology GitHub Wiki

The System goals

The System has 3 main goals that helps us answer our research question:

1. Expanding the onions seed set - To achieve the biggest picture possible of the Darknet's Network graph we need to have a good, well known, initial set of onion links to start the crawl with. The expansion of the seed set is done by a web scraper who crawls the regular web with the aim of finding onion urls yet to be discovered in the past.
2. Testing the onions' availability status - To build the Darknet's Network graph we need to test which onion is "alive" and what other onions he is pointing to, it is done by another web scraper who crawls the Darknet querying the onions from the seed set from the previous goal.
3. Analysing the resulted data - After collecting all the data we need to examine it and make some predictions about the Darknet and onion services behaviour. Statistical tools are analysing the results and outputting processed data.