Python
scrape-website
Incredibly High Performant web scraper (seconds for what takes others lots of minutes) - battle tested on millions of websites
PythonEmergingaiapi-web-scrapingllmllms
2
2
1
28d ago
Recent commits
Latest commits.
- feat: output Markdown with metadata and fix cross-page dedup loss6b7a19dVentz Petkov28d ago
- feat: add URL exclude patterns, tracking-param stripping, sitemap seedingf02183cVentz Petkov1mo ago
- fix: prevent UTF-8 mojibake from chardet charset mis-detectionf237155Ventz Petkov1mo ago
- Initial commit: async website scraper with text extractionb57c21fVentz Petkov3mo ago
Top contributors
Builders behind this project.
