Word2vec 千人千面 个性化搜索 + Scrapy2.3.0(爬取数据) + ElasticSearch7.9.1(存储数据并提供对外Restful API) + Django3.1.1 搜索
- python
- scrapy
- spider
- elasticsearch
142,187 visible repositories in the index
193–216 of 276 · Most stars
Word2vec 千人千面 个性化搜索 + Scrapy2.3.0(爬取数据) + ElasticSearch7.9.1(存储数据并提供对外Restful API) + Django3.1.1 搜索
source for Open States scrapers
Collection of scripts corresponding to LucidProgramming YouTube tutorials
闲鱼爬虫,基于闲鱼网页端开发,使用 FastAPI 构建的闲鱼商品搜索接口,支持异步并发请求和自动化数据去重存储。现已支持登录。
Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist
Bulk download your favourite anime episodes from your favourite anime websites
HTTP API for Scrapy spiders
An open database of international sanctions data, persons of interest and politically exposed persons
Non-official client to get some info about products sold on Amazon
Tool for automated TikTok interactions
Generate Free Edu Mail(s) within minutes
Make a ZIM file from any Web site and surf offline!
invisible playwright mcp: Playwright MCP server undetected by anti-bots and captchas: AI agent browses the web on anti-detect stealth Firefox, Python, undetected browser automation, scraping, computer use.
Crawl BookCorpus
A modular, terminal-based toolkit for OSINT, reconnaissance, and scraping - built in Python, runs on Linux and Windows.
📄 Python tool to turn Notion.so pages into lightweight, customizable static websites
A CLI toolset to generate table of contents for PDF files automatically.
A set of spiders and scrapers to extract location information from places that post their location on the internet.
A Manga download framework using selenium.
A command-line tool to get valuable information out of AWS CloudTrail
Free lead generation tool. Scrape Instagram, Twitch, TikTok, and LinkedIn profiles. Extract emails from bios, verify via SMTP, export to CSV.
Stealth Chromium engine that stops scrapers and browser agents from getting blocked, with one line of code change.
python爬虫,包含大小项目
This bot helps users to mass report Instagram accounts