SeaweedFS is a distributed storage system for object storage (S3), file systems, Iceberg table buckets, and Lance vector buckets, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.
Repository Index
47,133 repositories indexed
1–18 of 18 · Most stars
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
Ceph is a distributed object, block, and file storage platform
TranslatedBig Data Beginner's Guide :star:
- hadoop
- hdfs
- yarn
- mapreduce
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
TranslatedFocused on big data learning and interviews, the road to becoming a big data god begins. Flink/Spark/Hadoop/Hbase/Hive...
A terminal spreadsheet multitool for discovering and arranging data
Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀
- dataframe
- python
- bigdata
- tabular-data
Utils for streaming large files (S3, HDFS, gzip, bz2...)
- python
- s3
- hdfs
- webhdfs
The Universal Storage Engine
- tiledb
- arrays
- storage-engine
- scientific-computing
A native go client for HDFS
- hdfs
- go
- commandline
Official HDF5® Library Repository
- c
- cpp
- database
- fortran
DroneBridge is a system based on the WifiBroadcast approach. A bidirectional digital radio link between two endpoints is established using standard WiFi hardware and a custom protocol. DroneBridge is optimized for use in UAV applications and is a complete system. It is intended be a real alternative to other similar systems, such as DJI Lightbridge or OcuSync.
- msp
- telemetry
- wifibroadcast
- dronebridge
Affordable Digital HD Video Transmission made easy!
- wifibroadcast
- multirotor-uavs
- drones
- downlink
MATLAB MAT File I/O Library with support for MATLAB Class Object System
- matlab
- zlib
- hdf5
- mat-files
Big Data essentials: Hadoop, MapReduce, Spark. Explore tutorials and demos in Jupyter notebooks—most are self-contained and live, ready to run with a click.
Modern Pure Go implementation of the HDF5 file format
- go
- golang
- hdf5
- hdf5-format
Pure Go library for reading and writing MATLAB .mat files (v5-v7.3+). No CGo, no external dependencies. Full support for numeric types, complex numbers, and multi-dimensional arrays. Cross-platform (Windows/Linux/macOS). Part of SciGoLib ecosystem.
- cross-platform
- data-science
- go
- golang