An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
Repository Index
47,133 repositories indexed
1–18 of 18 · Most stars
Apache OpenWhisk is an open source serverless cloud platform
- openwhisk
- apache
- serverless
- cloud
Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark
State of the Art Natural Language Processing
Pure Scala Artifact Fetching
- scala
- sbt-plugin
- launcher
- scalajs
Scala library for boilerplate-free, type-safe data transformations
- scala
- boilerplate
- generic-programming
- automatic-conversion
Sparkling Water provides H2O functionality inside Spark cluster
- h2o
- spark
- machine-learning
- integration
CPU and GPU-accelerated Machine Learning Library
Free fork of NotProton: Windows Steam games in Mac Steam, on CodeWeavers' Wine and Apple's Game Porting Toolkit
- apple-silicon
- d3dmetal
- dxmt
- dxvk
A distributed Spark/Scala implementation of the isolation forest and extended isolation forest algorithms for unsupervised outlier detection, featuring support for scalable training and ONNX export for easy cross-platform inference.
- isolation-forest
- spark
- outlier-detection
The LinkedIn Fairness Toolkit (LiFT) is a Scala/Spark library that enables the measurement of fairness in large scale machine learning workflows.
- fairness
- fairness-ml
- fairness-ai
An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.
- archivespark
- spark-framework
- spark
- web-archiving
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
A library that brings useful functions from various modern database management systems to Apache Spark
Web application for distributed compute analysis of Archive-It web archive collections.
Internet Archive's Sparkling Data Processing Library
An open-source toolkit for analyzing line-oriented JSON Twitter archives with Apache Spark.
- spark
- tweets
- twitter-data
- twitter-json
A simplistic serialisation library for use alongside the official RethinkDb Java driver