Creating an ecomm dataset from Scrapy

I needed an ecommerce dataset for an experiment but couldn’t find one to download– so I scraped it together myself. When learning how to use Scrapy (an open source scraping library), the only tutorials I found online were for little toy scrapers, hardly good for anything practical. So I wrote a step-by-step post detailing exactly how I scrape an ecommerce site, from start to finish.

Read it here.