Scrapy

Scrapy (/ˈskreɪpi/ SKRAY-pee) is a free and open source web crawling framework, written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general purpose web crawler. It is currently maintained by Scrapinghub Ltd., a web scraping development and services company. Some well-known companies and products using Scrapy are: Lyst, CareerBuilder, Parse.ly, Sciences Po Medialab, Data.gov.uk’s World Government Data site.

Scrapy

Scrapy (/ˈskreɪpi/ SKRAY-pee) is a free and open source web crawling framework, written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general purpose web crawler. It is currently maintained by Scrapinghub Ltd., a web scraping development and services company. Some well-known companies and products using Scrapy are: Lyst, CareerBuilder, Parse.ly, Sciences Po Medialab, Data.gov.uk’s World Government Data site.