Change the repository type filter
All
Repositories list
2 repositories
amazon-scrapy
Publicamazon-crawler
PublicA Web crawler is a program that explores the Web by reading Web pages and following the links it finds on them to other pages, from which it extracts more links to follow, and so forth. A typical use of a Web crawler is to add pages to a search service's database -- using a crawler to find pages automatically allows the search service to build a…