Web Crawler/Spider for NodeJS + server-side jQuery ;-)
Repository Index
132,241 visible repositories in the index
1–24 of 38 · Most stars
The go-to web for your AI coding agent — local-first search, fetch, crawl & research over MCP. No API keys, no cloud, $0/query. Public beta.
🎬 Open-source, self-hosted AI agent that runs a YouTube channel end to end: researches topics, writes scripts, generates narration, visuals and video, optimizes SEO, and publishes after your approval, then learns from analytics. Works with Gemini, OpenAI, OpenRouter, DeepSeek and more.
- ai-agents
- automation
- content-automation
- content-creation
Automatically crawl arXiv papers daily and summarize them using AI. Illustrating them using GitHub Pages.
Private messaging system that hides metadata
vulnx 🕷️ an intelligent Bot, Shell can achieve automatic injection, and help researchers detect security vulnerabilities CMS system. It can perform a quick CMS security detection, information collection (including sub-domain name, ip address, country information, organizational information and time zone, etc.) and vulnerability scanning.
- crawler
- information-gathering
- cms-detector
- cloudflare-detection
A research tool for visually exploring Bureau of Labor Statistics Occupational Outlook Handbook data. This is not a report, a paper, or a serious economic publication — it is a development tool for exploring BLS data visually.
地图搜租房:满大街找租房心力交瘁?试试换个方式直接在地图上搜租房!【微信公众号、小程序:人生删除指南】
The Tavily Python SDK allows for easy interaction with the Tavily API, offering the full range of our search, extract, crawl, map, and research functionalities directly from your Python programs. Easily integrate smart search, content extraction, and research capabilities into your applications, harnessing Tavily's powerful features.
- agent
- crawl
- extract
- map
Returns latest research results by crawling arxiv papers and summarizing abstracts. Helps you stay afloat with so many new papers everyday.
- script
- python
- arxiv
- summarization
A reconnaissance framework for researching and investigating Telegram.
GitHub Action for sending a notification to a Slack channel
- github-actions
- slack
- research-development
- hacktoberfest
Automatically archive links to videos, images, and social media content from Google Sheets (and more).
- archive
- docker
- open-source-research
- python
TOP250豆瓣电影短评:Scrapy 爬虫+数据清理/分析+构建中文文本情感分析模型
- project
Pure-Python protocol tools and research notes for X.com, with VibeLoft Twitter account datasets
Automate creating resilient, disposable, secure and agile infrastructure for Red Teams.
[EMNLP 2026] MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research · 浏览器里运行的安卓模拟器 · Browser-hosted Android Simulator · Verifiable Evaluation · Scalable Online RL Training
Reproducible watchers for research
A Python library for trading automation on DeFi, data research and integration. Supporting Uniswap, Aave, Chainlink, USDC and other protocols.
PyExfil — Python 3 toolkit for researching and stress-testing data exfiltration techniques across network, physical, and steganographic channels. For red team simulation and DLP detection testing.
- python
- data-exfiltration
- icmp
- quic
This guide should help fellow researchers and hobbyists to easily automate and accelerate there deep leaning training with their own Kubernetes GPU cluster.
- kubernetes
- kubernetes-cluster
- kubernetes-setup
- deep-learning
Scientific measurement library for instruments, experiments, and live-plotting
- science
- measure
- research
- automation
A Python library for scraping the Google search engine.
- python-library
- python
- python3
js cookie逆向利器:js cookie变动监控可视化工具 & js cookie hook打条件断点
- crawler
- js-reverse
- reverse-engineering
- userscript