Scrapy
Python framework for building web crawlers
Scrapy is a Python framework for crawling sites and extracting structured data. It provides spiders, selectors, item pipelines and middleware, and is a common base for large scraping projects.
More in Scraping & RPA
Featured
Featured
Apify
Scraping & RPA
Marketplace and cloud platform for scrapers and Actors
UiPath
Scraping & RPA
Enterprise robotic process automation platform
Automation Anywhere
Scraping & RPA
RPA and agentic process automation platform
Bright Data
Scraping & RPA
Proxy networks and web data collection tools
Browse AI
Scraping & RPA
Train no-code robots to extract and monitor web data
Crawl4AI
Scraping & RPA
Open source crawler that outputs LLM-ready markdown