Sign in

Repository Index

47,133 repositories indexed

Tag: All Tags
Tag
Filters (1)

Filters

Clear all filters

73–96 of 331 · Most stars

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

TranslatedOpen-source manuscript of 《深入理解 AI Infra:量化分析与系统设计》 (In-Depth Understanding of AI Infra: Quantitative Analysis and System Design), by 李博杰 (Li Bojie): starting from hardware constraints and model architecture, it quantitatively derives the system design of LLM inference and training. Includes the full text of the book, a PDF, and companion calculation tools and experiments

  • accelerator
  • ai-infra
  • ai-infrastructure
  • book

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

A lightweight, object-oriented finite state machine implementation in Python with many extensions

  • python
  • state-machine
  • nested-states
  • hierarchical-state-machine