supercrawler

SkillAI Toolcrawlerspidersupercrawler

A web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and concurrency limits.

Directory Presence

Cross-referenced across 55 tracked directories

Directory	Status	First Seen	Last Confirmed	Link
N npm Skills Registry		3/14/2026	3/16/2026

Adoption Metrics

#4164

Popularity Rank

1 / 55

Listed In

Emerging

Adoption Stage

Listed For

Recently added to the ecosystem

Related Skills

@vercel/detect-agent

vercel-release-bot

Detect if code is running in an AI agent or automated development environment

SkillAI Tool

4 dirs

bedrock-agentcore

GitHub Actions

TypeScript SDK for AWS Bedrock AgentCore

SkillAI Tool

4 dirs

nanoid

A tiny (118 bytes), secure URL-friendly unique string ID generator

SkillAI Tool

3 dirs

@google/genai

google-wombot

[![NPM Downloads](https://img.shields.io/npm/dw/%40google%2Fgenai)](https://www.npmjs.com/package/@google/genai) [![Node Current](https://img.shields.io/node/v/%40google%2Fgenai)](https://www.npmjs.com/package/@google/genai)

SkillAI Tool

3 dirs