Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
Repository Index
47,133 repositories indexed
1–21 of 21 · Most stars
A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome.
A library that allows you to easily mock out tests based on AWS infrastructure.
Official s3cmd repo -- Command line tool for managing S3 compatible storage services (including Amazon S3 and CloudFront).
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
Continuous Archiving for Postgres
- python
- backup
- backups
- postgresql
Utils for streaming large files (S3, HDFS, gzip, bz2...)
- python
- s3
- hdfs
- webhdfs
Security Tool to Look For Interesting Files in S3 Buckets
- s3-bucket
- penetration-testing
- bugbounty
- enumeration
Super S3 command line tool
- s4cmd
- python
- cli
- bloomreach
YAS3FS (Yet Another S3-backed File System) is a Filesystem in Userspace (FUSE) interface to Amazon S3. It was inspired by s3fs but rewritten from scratch to implement a distributed cache synchronized by Amazon SNS notifications. A web console is provided to easily monitor the nodes of a cluster.
Parallel uploads to Amazon AWS S3
AWS Identity and Access Management Visualizer and Anomaly Finder
A Flask extension to access, upload, download, save and delete files on cloud storage providers such as: AWS S3, Google Storage, Microsoft Azure, Rackspace Cloudfiles, and even Local file system
Read and write Neuroglancer datasets programmatically.
- neuroglancer
- volumetric-data
- python
- cloud
Like `du` but for S3
Utilities to do parallel upload/download with Amazon S3
micrOS - mini asynchronous automation OS for DIY projects.
- micropython
- iot-platform
- interrupts
- socket
ESP_LCD based MicroPython driver for ESP32-S3 Devices with ST7789 or compatible displays.
- esp32s3
- esp32s3-box
- t-display-s3
- t-dongle-s3
MicroPython driver for the TTGO T-Display-S3 st7789 display written in C
- micropython
- st7789
- t-display-s3
Fast ESP_LCD based MicroPython driver for the TTGO T-Display-S3 st7789 display written in C
- esp32s3
- micropython
- st7789
- t-display-s3
MicroPython display driver for TTGO T-Display-S3 written in python.