Sign in

Repository Index

107,098 visible repositories in the index

Tags: Automation, bots, and scraping
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters

Filters

Clear all filters

385–408 of 1,659 · Most stars

使用scrapy,redis, mongodb,graphite实现的一个分布式网络爬虫,底层存储mongodb集群,分布式使用redis实现,爬虫状态显示使用graphite实现

Translated[Captcha Recognition - Training] This project is based on CNN/ResNet/DenseNet+GRU/LSTM+CTC/CrossEntropy to realize verification code identification. This project is only for training the model.

牛人快跑 - GeekGeekRun,求职找工作自动化工具,基于 Puppeteer、Electron。界面友好,简单易用!开源,免费!快速海投、自动开聊、已读不回提醒、职位信息抓取、不合适职位标记、僵尸职位清理;让你即刻变身成为一台冇得感情的求职机器🤖,找工作不内耗。宝宝不用动,妈妈全自动~祝你收获好Offer!

  • automatic-control
  • bosszhipin
  • findjob
  • jobsearch

🤖 Top-rated tools to scrape all major public sections from Facebook, Instagram, and Twitter (X) including posts (likes/comments), photos/videos, contact information, followers, following and much more.

  • facebook-page-insights
  • instagram-followers-scraper
  • facebook-ads-metrics
  • facebook-contact-info

Watch (parts of) webpages and get notified when something changes via e-mail, on your phone or via other means. Highly configurable.

Twitter Text Libraries. This code is used at Twitter to tokenize and parse text to meet the expectations for what can be used on the platform.

  • twitter-text
  • tweet
  • twitter
  • unicode

Open Source AI trading agent that operates autonomously across 1000+ markets - Polymarket, Kalshi, Binance, Hyperliquid, Solana DEXs, 5 EVM chains. Scans for edge, executes instantly, manages risk while you sleep. Agent commerce protocol for machine-to-machine payments. Self-hosted. Built on Claude.

WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup a multi-threaded web crawler in less than 5 minutes.