DCrawler is a distribited web spider written in Nodejs and queued with Mongodb. It gives you the full power of jQuery to parse big pages as they are downloaded, asynchronously. Simplifying distributed crawler!
Cross-referenced across 55 tracked directories
#4197
Popularity Rank
1 / 55
Listed In
Emerging
Adoption Stage
2d
Listed For
Recently added to the ecosystem
Score: 100/100
0 dependency vulnerabilities found
guyhartstein
Tavily AI SDK tools - Search, Extract, Crawl, and Map
GitHub Actions
An AI web browsing framework focused on simplicity and extensibility.
raznem
n8n node to call Parsera API for AI Scraping
atom8ai
Production-grade Google Maps & Places API scraper for n8n. Specifically designed for AI Agents, B2B lead generation, and mass email scraping with built-in rate limit handling.
Please to use AI Security Scan.
New accounts get 100 free scan credits.