Sign in

Repository Index

105,102 visible repositories in the index

Tags: Automation, bots, and scraping
Tags

A repository shows when it has any selected Tag.

Clear Tags
Filters (1)

Filters

Clear all filters

1–21 of 21 · Most stars

🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...

  • pocket
  • wget
  • browser-bookmarks
  • pinboard

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract structured data with LLMs via Pydantic AI, or control the browser in natural language with Stagehand. Works with BeautifulSoup, Parsel, Playwright, and raw HTTP. Download HTML, PDF, images, and other files. Proxy rotation included.

Translated✨WeChat Official Account assistant that fits reading habits, WeChat Official Account to MarkDown, WeChat Official Account to PDF, scheduled updates of subscribed Official Account articles, generate RSS feeds for WeChat Official Accounts, export WeChat Official Account subscription feeds, supports Webhook/API/AI Agent integration for WeChat Official Accounts, subscribe to WeChat Official Accounts, WeChat Official Account assistant, WeChat Official Account reading, WeChat Official Account interface, WeChat Official Account crawler, WeChat Official Account monitoring, tag-based subscription to WeChat Official Accounts, WeChat Official Account source, WeChat Official Account book reading, WeChat Official Account articles, WeChat Official Account framework, WeChat Official Account management, WeChat Official Account source, WeChat Official Account platform, WeChat Official Account code, WeChat Official Account system, WeChat Official Account source code

  • rss-feed
  • rss-hub
  • weichat
  • weixin

🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单,功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬虫解决不同场景的需求。且支持断点续爬、监控报警、浏览器渲染、海量数据去重等功能。更有功能强大的爬虫管理系统feaplat为其提供方便的部署及调度

Specify a github or local repo, github pull request, arXiv or Sci-Hub paper, Youtube transcript or documentation URL on the web and scrape into a text file and clipboard for easier LLM ingestion

爬虫案例合集。包括但不限于《淘宝、京东、天猫、豆瓣、抖音、快手、微博、微信、阿里、头条、pdd、优酷、爱奇艺、携程、12306、58、搜狐、各种指数、维普万方、Zlibraty、Oalib、小说、招标网、采购网、小红书、大众点评、推特、脉脉、知乎》

A blazing fast, async-first, undetectable webscraping/web automation framework based on ultrafunkamsterdam/nodriver. Now with Docker support!

  • chrome
  • chrome-devtools-protocol
  • python
  • webscraping

manus自动写脚本 注册链接 https://manus.im/invitation/V9OIRPDYST3RAF8 KIMI 注册链接http://s.b6v.cn/iUIez 百度贴吧签到★小米运动刷步数★恩山签到★雨云签到白嫖服务器★小茅预约★天翼云盘签到★阿里云盘签到★富贵论坛签到★一点万向签到打卡★品赞代理签到★星空代理签到★什么值得买签到★值得买每日抽奖★小米社区签到★ddnsto自动续费七天★爱奇艺签到刷时长★双色球预测(娱乐)

Solana trading and sniping bot for pump.fun and Raydium LaunchLab launchpads (letsbonk.fun, StonkFun), following graduated coins into PumpSwap and Raydium CPMM. Talks to the chain through your own RPC node, no third-party APIs.

  • pumpdotfun
  • sniper
  • solana
  • letsbonk

Translated📚 WeChat Reading (微信读书) lossless full-book export tool — one-click export of dual-font, finely typeset PDF / EPUB / plain Markdown notes (compatible with Obsidian & Notion), solving the problem of missing characters when turning pages on the web version.

The Raspberry Pi Telegram Bot is a lightweight, customizable bot built for Raspberry Pi users. It leverages Python and the Telegram Bot API to enable users to execute commands, receive updates, and automate processes from their Telegram account. Ideal for DIY projects, home automation, and remote control applications, this bot is easy to set up .