lakeFS - Data version control for your data lake | Git for data
- data-engineering
- data-versioning
- go
- object-storage
47,133 repositories indexed
1–3 of 3 · Most stars
lakeFS - Data version control for your data lake | Git for data
s3git: git for Cloud Storage. Distributed Version Control for Data. Create decentralized and versioned repos that scale infinitely to 100s of millions of files. Clone huge PB-scale repos on your local SSD to make changes, commit and push back. Oh yeah, it dedupes too and offers directory versioning.
An open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.