Skills

## 下载htlm文档中间件

A simple command line app for controlling a GitHub Crawler

auto web crawler

This module helps detect if a user agent derives from known robots/crawlers/spiders

Node tùy chỉnh cho n8n để cào dữ liệu từ trang web, trích xuất nội dung và hình ảnh

# Usage

Halux middleware for Redux

抖音视频爬虫 n8n 节点 - 搜索、提取和下载抖音视频

Pull athlete information straight from the Parkrun website

Config based news crawler using Google Puppeteer

A Mercator crawler with url-frontier, url-set, meta-data fetcher, etc. inspired by the Stanford Information Retrieval book

Scrapy Framework implemented by nodejs.

moved to web-automation.

Plugin for bauer-crawler to convert PDF into text.

a video downloader that crawls the web

A prerender middleware for express. This middleware serves cached prerendered pages for crawlers or if no cached page exists for a requested page it will cache a page using PhantomJS and respond with that newly cached page.

Plugin for bauer-crawler to scrape content.

A powerful command-line tool for crawling websites and generating CSV reports

A web spider of hangzhou

Google Maps Place crawler

PIXNET posts crawler for node.js

A terminal-based dungeon crawler game with ASCII graphics

SiteBot is an event driven website crawler.

Unofficial National Bibliographic Information Network collection crawler