Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.
- programming
- development
- design
- design-system
Repository Index
47,133 repositories indexed
1–24 of 41 · Most stars
Robust Speech Recognition via Large-Scale Weak Supervision
🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
- crawler
- crawling
- crawling-python
- playwright
Making large AI models cheaper, faster and more accessible
- deep-learning
- hpc
- large-scale
- data-parallelism
DeepInfer: High-performance, large-scale inference framework for DeepSeek models
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
- nlp
- pre-trained-model
- unilm
- minilm
List of ngrok, Cloudflare Tunnel, Tailscale, and ZeroTier alternatives and other tunneling software and services. Focus on self-hosting.
- ngrok
- tunneling
- self-hosted
- ngrok-alternative
Wan: Open and Advanced Large-Scale Video Generative Models
- aigc
- video-generation
Ongoing research training transformer models at scale
- large-language-models
- model-para
- transformers
Wan: Open and Advanced Large-Scale Video Generative Models
- aigc
- videogeneration
Software to automate the management and configuration of infrastructure and applications at scale.
- python
- configuration-management
- remote-execution
- infrastructure-management
High-Resolution 3D Assets Generation with Large Scale Hunyuan3D Diffusion Models.
- 3d
- 3d-aigc
- 3d-generation
- image-to-3d
The pytest framework makes it easy to write small tests, yet scales to support complex functional testing
- unit-testing
- test
- testing
- python
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
Scalene: a high-performance, high-precision CPU, GPU, and memory profiler for Python with AI-powered optimization proposals
- python
- profiling
- performance-analysis
- cpu-profiling
Modin: Scale your Pandas workflows by changing a single line of code
- dataframe
- pandas
- distributed
- datascience
The no-magic web API and microservices framework for Python developers, with a focus on reliability and performance at scale.
- python
- rest
- microservices
- web
Light, flexible and extensible ASGI framework | Built to scale
🔧 pyinfra turns Python code into shell commands and runs them on your servers. Execute ad-hoc commands and write declarative operations. Target SSH servers, local machine and Docker containers. Fast and scales from one server to thousands.
- python
- cloud-management
- configuration-management
- remote-execution
Python framework for creating, editing, and running Noisy Intermediate-Scale Quantum (NISQ) circuits.
- nisq
- quantum-algorithms
- quantum-computing
- cirq
Neural Network to colorize grayscale images
SOTA-Class TTS at Compact Scale
Biological foundation modeling from molecular to genome scale
A 1:1 scale streamed Earth for BeamNG.drive: real elevation and satellite imagery, floating origin, LOD streaming from a companion server