#Requesting info from a web page
#Scarping data off a webpage
from bs4 import BeautifulSoup
#Limiting the max amount of pages it can crawl through
page = 1
When I run this it is meant to pull out the URL out of all the titles, however when I run this it does nothing. Can you please tell me how to fix this or give me a different website in which I can web crawl on?
Python web crawler
· February 17, 2015
In Python Programming Tutorial - (25-26) - How to Build a Web Crawler, Bucky uses his trading website. However when I try and use this the website has no data, therefore no stuff to crawl. I tried to use gumtree but my code seemed to do nothing. The code is displayed below:
Post a Reply
Nothing to see here.
This section is all about snakes! Just kidding.
|Bucky Roberts Administrator|