Check out these great Python tools for crawling and scraping the web, and parsing out the data you need.

Source: 3 Python web scrapers and crawlers | Opensource.com