This code is used to perform web scraping and data extraction from Google Maps. It is particularly designed for obtaining information about businesses, including their name, address, website, phone number, reviews, and more.
- chromium
- data
- data-scraping
- google
LinkedIn enumeration tool to extract valid employee names from an organization through search engine scraping
- webscraping
- python3
- osint
- enumeration
This package is designed to bypass puppeteer's bot-detecting captchas such as Cloudflare. It acts like a real browser and can be managed with puppeteer.
- cloudflare-bypass
- puppeteer
- puppeteer-cloudflare-captcha
- puppeteer-extra-plugin
自然语言处理(nlp),小姜机器人(闲聊检索式chatbot),BERT句向量-相似度(Sentence Similarity),XLNET句向量-相似度(text xlnet embedding),文本分类(Text classification), 实体提取(ner,bert+bilstm+crf),数据增强(text augment, data enhance),同义句同义词生成,句子主干提取(mainpart),中文汉语短文本相似度,文本特征工程,keras-http-service调用
- chatbot
- feature
- data-augmentation
- text-augment
AgentQL is a suite of tools for connecting your AI to the web. Featuring a query language and Playwright integrations for interacting with elements and extracting data quickly, precisely, and at scale. Includes REST API, Python and JavaScript SDKs, browser debugger.
advertools - online marketing productivity and analysis tools
- marketing
- advertising
- adwords
- python
Automated CAPTCHA solver usage examples.
- aws-captcha-solver
- captcha-bypass
- captcha-solving
- cloudflare-turnstile
Collection of patches for puppeteer and playwright to avoid automation detection and leaks. Helps to avoid Cloudflare and DataDome CAPTCHA pages. Easy to patch/unpatch, can be enabled/disabled on demand.
Automated CAPTCHA solver for Node.js.
- aws-waf-captcha
- aws-waf-token-solver
- captcha
- captcha-recognition
Collect structured responses from a ChatGPT scraper by sending a prompt with valid ChatGPT scraping API credentials. Enable live search, inject HTML context, and automate intelligent scraper ChatGPT workflows in just a few parameters.
The Tavily Python SDK allows for easy interaction with the Tavily API, offering the full range of our search, extract, crawl, map, and research functionalities directly from your Python programs. Easily integrate smart search, content extraction, and research capabilities into your applications, harnessing Tavily's powerful features.
Effortlessly extract data with our AI scraper API. Simplify data extraction, get clean JSON outputs and adapt to page changes. Try it free today!
- ai-data-extraction
- ai-scraper
- ai-web-scraper
- data-extraction
Free, open-source Postiz alternative: self-host a social media scheduler with an AI post writer, content calendar, and publishing across 8 platforms. MIT licensed; external provider charges may apply.
- ai
- ai-content-generation
- content-calendar
- content-scheduling
社媒助手开源版 - 小红书、抖音、快手等平台数据采集的浏览器插件,可通过API调用,支持Docker部署。
🤖 Scrape data from HTML websites automatically by just providing examples
Lightweight library for scraping web-sites with LLMs
Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors
Fast proxy scraper and checker written in Rust. Collects HTTP, SOCKS4 and SOCKS5 proxies from any number of sources, verifies each one really works, and writes JSON and plain text with response time, exit IP, ASN and geolocation. Single binary for Windows, Linux, macOS, Android, FreeBSD, NetBSD, illumos and Solaris, with an interactive TUI.
- proxyscraper
- proxyscrape
- proxy-checker
- proxy
Web data extraction tool implemented as chrome extension
Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.
微信公众平台 Python 开发包 [DEPRECATED]
A configurable and extensible PHP web spider
Open-source GitHub repository abuse detection and response system.
基于金融-司法领域(兼有闲聊性质)的聊天机器人,其中的主要模块有信息抽取、NLU、NLG、知识图谱等,并且利用Django整合了前端展示,目前已经封装了nlp和kg的restful接口