An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
Repository Index
132,241 visible repositories in the index
1–24 of 26 · Most stars
The Scala 3 compiler, also known as Dotty.
- scala
- scala3
- epfl
- compiler
State of the Art Natural Language Processing
Open-source code analysis platform for C/C++/Java/Binary/Javascript/Python/Kotlin based on code property graphs. Discord https://discord.gg/vv4MH284Hc
- code-analysis
- query-language
- code-browser
- fuzzy-parsing
In-memory dimensional time series database.
A better build tool for Java, Scala and Kotlin: Simpler than Maven, easier than Gradle, with 3-7x faster dev workflows than other JVM build tools
- scala
- build-tool
- build-system
- java
A Scala API for Apache Beam and Google Cloud Dataflow.
- scala
- bigquery
- google-cloud
- beam
深圳地铁大数据客流分析系统🚇🚄🌟
TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning
Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.
- clickhouse
- simd
- spark-sql
- vectorization
MLeap: Deploy ML Pipelines to Production
- scikit-learn
- spark
- data-pipelines
- transformers
This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]
- apache-spark
- spark
- structured-streaming
- spark-sql
A type-safe, reflection-free, powerful enumeration implementation for Scala with exhaustive pattern match warnings and helpful integrations.
- scala
- enum
- value-enum
- enumerations
A Time Series Library for Apache Spark
- spark
- timeseries
Flexible Scala code linting tool
- scala
- compiler-plugin
- macros
- linter
Scientific workflow engine designed for simplicity & scalability. Trivially transition between one off use cases to massive scale production environments
A collection of Kafka Connect sinks and sources maintained by Lenses.io.
FireSim: Fast and Effortless FPGA-accelerated Hardware Simulation with On-Prem and Cloud Flexibility
- fpga
- risc-v
- simulation
- datacenter
This repository contains the development code for sparkMeasure, an Apache Spark performance analysis and troubleshooting library. It simplifies collecting, aggregating, and exporting Spark task/stage metrics, and is designed for practical use by developers and data engineers in interactive analysis, testing, and production monitoring workflows.
- spark
- apache-spark
- performance-troubleshooting
- performance-metrics
XiaoMi Natural Language Processing Toolkits
- nlp
- tensorflow
- python3
A Scala port of the popular Python Requests HTTP client: flexible, intuitive, and straightforward to use.
Low-code tool for automating actions on real time data | Stream processing for the users.
- flink
- flink-kafka
- apache-flink
- gui
OS-Lib is a simple, flexible, high-performance Scala interface to common OS filesystem and subprocess APIs
[DEPRECATED] Tensorflow wrapper for DataFrames on Apache Spark