Repository Index

This is a repo with links to everything you'd ever want to learn about data engineering

• apachespark
• awesome
• bigdata
• data

Instruct-tune LLaMA on consumer hardware

TranslatedInterview = Resume Guide + Algorithm Problems + Standard Interview Q&A (八股文, "eight-legged essay") + Source Code Analysis

• python
• kaggle
• machine-learning
• leetcode

Code for Tensorflow Machine Learning Cookbook

• tensorflow
• tensorflow-cookbook
• linear-regression
• neural-network

Machine Learning Containers for NVIDIA Jetson and JetPack-L4T

• machine-learning
• dockerfiles
• jetson
• pytorch

OmniGen: Unified Image Generation. https://arxiv.org/pdf/2409.11340

• diffusion
• image
• image-generation
• multi-modal

A modern Anki custom scheduling based on Free Spaced Repetition Scheduler algorithm

• anki-addon
• spaced-repetition-algorithm
• anki
• deep-learning

OmniGen2: Exploration to Advanced Multimodal Generation. https://arxiv.org/abs/2506.18871

🛠 All-in-one web-based IDE specialized for machine learning and data science.

• machine-learning
• deep-learning
• data-science
• docker

Causal Inference for the Brave and True. A light-hearted yet rigorous approach to learning about impact estimation and causality.

• causal-inference
• python
• causality
• data-science

A small package to create visualizations of PyTorch execution graphs

Structured state space sequence models

• state-space-models
• sequence-models
• pytorch

Scikit-Learn, NLTK, Spacy, Gensim, Textblob and more

We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tuning) together for easy use. We welcome open-source enthusiasts to initiate any meaningful PR on this repo and integrate as many LLM related technologies as possible. 我们打造了方便研究人员上手和使用大模型等微调平台，我们欢迎开源爱好者发起任何有意义的pr！

• chatglm
• llama
• llm
• lora

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

• data-science
• python
• dag
• data-engineering

Python library for interactive topic model visualization. Port of the R LDAvis package.

TeachOpenCADD: a teaching platform for computer-aided drug design (CADD) using open source packages and data

Benchmarks for Low Latency (Streaming) solutions including Apache Storm, Apache Spark, Apache Flink, ...

• benchmarks
• low-latency
• streaming

Python package for Bayesian Machine Learning with scikit-learn API

• python
• bayesian-machine-learning
• machine-learning
• scikit-learn

Cyber Defence Monitoring Course Suite :: Suricata, Arkime (and others in the past)

• moloch
• suricata
• monitoring
• nsm

Big Data essentials: Hadoop, MapReduce, Spark. Explore tutorials and demos in Jupyter notebooks—most are self-contained and live, ready to run with a click.

• big-data
• bigdata
• spark
• spark-sql

Mobile Deep Learning Projects, published by Packt

Exploring the space of drug combinations to discover synergistic drugs using Active Learning