Moodle-DL downloads course content fast from Moodle (eg. lecture pdfs)
- moodle
- moode-crawler
- crawler
- moodle-downloader
142,273 visible repositories in the index
361–384 of 452 · Most stars
Moodle-DL downloads course content fast from Moodle (eg. lecture pdfs)
Social media scraping / data collection library for Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs
➖ Stripped down, stable version of firecrawl optimized for self-hosting and ease of contribution. Billing logic and AI features are completely removed. Crawl and convert any website into LLM-ready markdown.
Execute complex automation scripts via remote cloud sessions , featuring integrated residential proxies , automated CAPTCHA solving , and native JavaScript rendering for the toughest dynamic websites.
An API to scrape American court websites for metadata.
X/Twitter automation toolkit: scrapers, CLI and an MCP server with approval-gated write actions, no paid API.
Complete-Life-Cycle-of-a-Data-Science-Project
:card_index: Extract social media profiles and more with regular expressions
This Python application is an OSINT (Open Source Intelligence) tool called "Ominis OSINT - Web Hunter." It performs online information gathering by querying Google for search results related to a user-inputted query. The tool extracts relevant information such as titles, URLs, and potential mentions of the query in the results.
译文:Puppeteer 与 Chrome Headless —— 从入门到爬虫
全自动短视频搬运工具,支持自动下载、去重、AI生成标题+标签、上传,可二开扩展至多平台,例如:TikTok->视频号/抖音/小红书、抖音->TikTok/视频号/小红书......video-processing, automation, tiktok, selenium, pyqt5, ffmpeg, bot, data-scraping, video-deduplication.
A port of n0madic/twitter-scraper to Node.js.
Real-time detection of anti-bot systems, captchas & fingerprinting techniques. Identifies Cloudflare, Akamai, DataDome, reCAPTCHA, hCaptcha, Shape Security & more with confidence scoring and advanced capture tools.
Dive into web scraping and build a Next.js 13 eCommerce price tracker within a single video that teaches you data scraping, cron jobs, sending emails, deployment, and more.
HTTP client that can impersonate web browsers
Nextjs server to query websites with GraphQL
A Playwright-based Node.js tool that bypasses search engine anti-scraping mechanisms to execute Google searches. Local alternative to SERP APIs with MCP server integration.
JARVIS: a real-time agentic intelligence-gathering platform powered by autonomous web scraping & OSINT, streamed via Meta Ray-Ban smart glasses
Instagram Data Scraper, Instagram Web Scraper, Instagram Super Scraper is a PHP script which takes @user-name or #keywords as input and returns all information related to user or hash-tags e.g. likes, comments, post count, images, likes on images etc... You can search @account information and #hash-tag simultaneously by using space separated words in search box jQuery is using to build the Awesome View, to handle each and every request separately. I hope you like this small chunk of code All code is well commented to understand the flow and functionality, if I missed something or any improvement/suggestion you have, kindly let me know..
Advanced python library to scrap Twitter (tweets, users) from unofficial API
Universal Reddit Scraper - Works on any Subreddit or User
Twitch YouTube bot. Automatically make video compilations of the most viewed Twitch clips and upload them to YouTube using Python 3.
:frog: 知网(CNKI)文献下载及文献速览爬虫 (Web Scraper for Extracting Data)
The simplest demo of chrome automation by python and selenium in AWS Lambda