Skills

CAP Plugin — Midnight Blockchain Indexer with OData V4 API

Lihkg Web Crawler

A library for checking basic SEO signals of a website

Crawl elements selector which match specific DOM event

Crawler for twitter

Node.js screen scraping and web crawling module

Crawler(robots) decision middleware for Express

DCrawler is a distribited web spider written in Nodejs and queued with Mongodb. It gives you the full power of jQuery to parse big pages as they are downloaded, asynchronously. Simplifying distributed crawler!

Canada neighbourhood data with crawler

Command-line interface for bauer-crawler.

Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.

Hivemind Platform Crawler

Generic web crawler powered by Node.js

Web crawler and API for aggregating and serving digital rights organizations' publications.

A search and crawler for Wikipedia articles

Simple web-crawler for nodejs

A node.js module to scrape player points from Repubblica Sport match report

extract emails address from website by following links

定义一个json格式的爬虫规则，Nodejs按照该规则爬取所需要的内容

A simple Node.js version pdf download crawler

A really small crawler.

Fast asynchronous NodeJS module for crawling/scraping a web through worker_threads.

SEO project，integrated submit latest urls to Baidu and Google and Bing ect... search engine

Easily crawl your public notion pages