Deep web scraping

+3 Isaiah Rahmany · August 29, 2014
my program verifies onion sites in the deep web using tor network and privoxy :) if it doesnt exist then the program just crashes lol and if you suspect me of using special services on the deep web believe me I don't I am only 14... and My program name is BlackC1p3r idk why just saw that random name somewhere 4 years ago lol


from bs4 import BeautifulSoup
import sys
import os
import requests



proxy = {"http": "127.0.0.1:8118"}



print(30 * "*")
print("*   Welcome to BlackC1p3r    *")
print(30 * "*")
print("* BlackC1p3r is a onion url  *")
print("* verifaction tool designed  *")
print("* by Isaiah Rahmany for fun  *")
print("* The purpose of this is to  *")
print("* verify onion urls and to   *")
print("* check if it exists if      *")
print("* you get an error and the   *")
print("* application quits then     *")
print("* the url most likely        *")
print("* does not exist so thank    *")
print("* you for using. That's all  *")
print("******************************")
print("")
url = input("Enter an onion url -> ")


os.system("cls")


r2 = requests.get("http://thehiddenwiki.org")

data2 = r2.text

soup2 = BeautifulSoup(data2)






r = requests.get(url, proxies=proxy)


data = r.text

soup = BeautifulSoup(data)

title = soup.title.string

print("URL -> " + url)
print("Page Title -> " + title)
input("Press enter or return to continue...")





Post a Reply

Replies

Oldest  Newest  Rating
+2 Isaiah Rahmany · August 29, 2014
any ideas on what I should scrap from the deep web guys? scrap, scrape, idk what the hell you supposed to call it lol
+3 Kaveh Greenwood · August 30, 2014
Nice program. It's great to see the works of others on here.

How about web developer tools?
  • 1

Python

107,130 followers
About

This section is all about snakes! Just kidding.

Links
Moderators
Bucky Roberts Administrator