Back to Skills
crawlit
SkillData Extractioncrawlercrawlspidder
A node.js crawler support custom crawl rules for special site with a plugin.
Directory Presence
Cross-referenced across 55 tracked directories
Adoption Metrics
#4163
Popularity Rank
1 / 55
Listed In
Emerging
Adoption Stage
2d
Listed For
Recently added to the ecosystem
Related Skills
Tavily AI SDK tools - Search, Extract, Crawl, and Map
SkillData Extraction
3 dirs
An AI web browsing framework focused on simplicity and extensibility.
SkillData Extraction
3 dirs