Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
Repository Index
47,133 repositories indexed
217–240 of 2,809 · Most stars
Xiaomi Home Integration for Home Assistant
- home-assistant-integration
- miot-devices
- home-assistant
- miot
TranslatedA Python web scraping tutorial series, learning Python web scraping from 0 to 1, including browser packet capture and mobile APP packet capture with tools such as fiddler and mitmproxy, the use of the various modules involved in web scraping, such as requests, beautifulSoup, selenium, appium, scrapy, etc., as well as IP proxies, CAPTCHA recognition, using Mysql and MongoDB databases with Python, multi-threaded and multi-process scraping, reverse engineering and cracking of CSS scraping encryption, JS scraping reverse engineering, distributed scraping, practical scraping project examples, etc.
- python3
- python-script
- python-spider
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
- nlp
- pre-trained-model
- unilm
- minilm
Translated100-Days-Of-ML-Code Chinese version
- machine-learning
- python
- 100-days-of-ml-code
- chinese-simplified
Tornado is a Python web framework and asynchronous networking library, originally developed at FriendFeed.
- python
- asynchronous
Mobile Security Framework (MobSF) is an automated, all-in-one mobile application (Android/iOS/Windows) pen-testing, malware analysis and security assessment framework capable of performing static and dynamic analysis.
- static-analysis
- dynamic-analysis
- mobsf
- android-security
🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools
Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.
List of ngrok, Cloudflare Tunnel, Tailscale, and ZeroTier alternatives and other tunneling software and services. Focus on self-hosting.
- ngrok
- tunneling
- self-hosted
- ngrok-alternative
TranslatedThe official repo of Qwen chat & pretrained large language model proposed by Alibaba Cloud.
- chinese
- large-language-models
- natural-language-processing
- flash-attention
Best Practices on Recommendation Systems
- machine-learning
- recommender
- ranking
- deep-learning
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
- adapter
- diffusion
- llm
- parameter-efficient-learning
☁️ Build multimodal AI applications with cloud-native stack
- neural-search
- cloud-native
- deep-learning
- machine-learning
Translated⚡️HivisionIDPhotos: a lightweight and efficient AI ID photos tools. A lightweight AI algorithm for making ID photos.
- demo
- gradio
- idphoto
- machine-learning
Open standard for machine learning interoperability
💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants
- nlp
- machine-learning
- machine-learning-library
- bot
TranslatedSelf-hosted TikTok, Douyin & Bilibili scraper and no-watermark video downloader — async REST API, MCP server for AI agents, CLI and web console, plus offline speech-to-text for downloaded videos. Self-healing identity pool, PostgreSQL archive, one docker compose up.
How Python does AI. Agents, realtime voice, image generation, embeddings. Every model, every interface, typed end to end.
- agent-framework
- pydantic
- python
- genai
Open source software that helps you create and deploy high-frequency crypto trading bots
Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.
- pytorch
- speech-recognition
- paraformer
- punctuation
gpt-oss-120b and gpt-oss-20b are two open-weight language models by OpenAI
Tool for producing high quality forecasts for time series data that has multiple seasonality with linear or non-linear growth.
- forecasting
- r
- python
Command-line program to download image galleries and collections from several image hosting sites
- gallery
- downloader
- pixiv
- danbooru