Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
- data-science
- python
- dag
- data-engineering
Repository Index
47,133 repositories indexed
1–3 of 3 · Most stars
Various examples of notebooks for working with web archives with the Archives Unleashed Toolkit, and derivatives generated by the Archives Unleashed Toolkit.
- notebooks
- pyspark-notebook
- juypter-notebook
- spark
GTFS Data Pipeline for TfNSW Bus Datasets
- gtfs
- gtfs-static
- gtfs-realtime
- tfnsw