Hashtag Realtalk with Aaron Bregg

Episode 105 - Monsters Under Your Bed: Mapping The Dark Web with Python

Aaron Bregg Season 7 Episode 3

*Disclaimer* While this episode deals with an incredibly important topic, there are potential dangers in doing this type of work. PLEASE do your homework and be well prepared should you go down this path, as your life can be impacted with a wrong turn.

In this episode, which is the first of a listener requested one around technical topics.

With cybercrime and threat actor activity on the rise, it is more important than ever to understand the dark web and monitor it for potential risks or signs of a breach. There are several tools and intel providers that can do this, but they’re not cheap. So why don’t we just do it ourselves?

Python can handle simple tasks surrounding dark web scanning and offers more customization for complex tasks. Using strictly free open-source libraries and any system you have available, you can set up an automated scanner and detect threats as they arise.

Scan for IP addresses, potentially compromised emails, crypto addresses, and any regex patterns that you desire. Map your findings to the most relevant onion sites and get an understanding of where your adversaries tend to operate. This is just a start. From here, you can go almost anywhere.

Episode Charity:

Proceeds from this episode's sponsorship will be going towards the Baker-Bonsai Friendship Fund. Bruce Baker was a great bonsai tree artist and along with Deal Bull, helped make the art of bonsai be something wonderful that can be shared for future generations at the Frederik Meijer Gardens.

Episode Sponsor:

Cloud Security Alliance of West Michigan

Talking Points:

  • Why is it important that you at least have a basic understanding of the Dark Web is you are in the Small and Medium sized Business (SMB) space.
  • Pros and Cons of Build vs Buy
  • What safeguards do you want when out in the fringes?
  • What are the mental health aspects of doing this type of work? How manage those pressures?
  • What are Seed URLs?
  • How to use Dark Web templates for scanning.

Description credit to GrrCon