Trending repositories

1.apache / spark

Apache Spark - A unified analytics engine for large-scale data processing

• python
• scala
• r
• java
• big-data
• jdbc
• +2 more

2.twitter / the-algorithm

Source code for the X Recommendation Algorithm

3.lichess-org / lila

♞ lichess.org: the forever free, adless and open source chess server ♞

• scala
• chess
• play-framework
• non-profit
• functional-programming
• type-safe
• +4 more

4.delta-io / delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

• spark
• acid
• big-data
• analytics
• delta-lake

5.rtyley / bfg-repo-cleaner

Removes large or troublesome blobs like git-filter-branch does, but faster. And written in Scala

• git

6.gitbucket / gitbucket

A Git platform powered by Scala with easy installation, high extensibility & GitHub API compatibility

• scala
• gitbucket
• git
• scalatra

7.softwaremill / elasticmq

In-memory message queue with an Amazon SQS-compatible interface. Runs stand-alone or embedded.

• scala
• sqs-interface
• elasticmq
• amazon-sqs
• aws
• aws-sqs
• +1 more

8.apache / pekko

Build highly concurrent, distributed, and resilient message-driven applications using Java/Scala

• actor-model
• cloud-native
• concurrency
• distributed-actors
• distributed-systems
• high-performance
• +4 more

9.scala / scala

Scala 2 compiler and standard library. Scala 2 bugs at https://github.com/scala/bug; Scala 3 at https://github.com/scala/scala3

• scala
• scala-compiler
• scala-programming-language
• scala-library
• jvm-languages
• functional-programming
• +1 more

10.com-lihaoyi / mill

A better build tool for Java, Scala and Kotlin: Simpler than Maven, easier than Gradle, with 3-7x faster dev workflows than other JVM build tools

• scala
• build-tool
• build-system
• java
• scala-js
• scala-native
• +4 more

11.gatling / gatling

Modern Load Testing as Code

• netty
• scala
• loadtesting
• automation
• gatling
• load-testing
• +13 more

12.typelevel / cats

Lightweight, modular, and extensible library for functional programming.

13.microsoft / SynapseML

Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark

• spark
• pyspark
• azure
• scala
• microsoft
• ml
• +14 more

14.snowplow / snowplow

The leader in Customer Data Infrastructure

• snowplow
• analytics
• data
• data-pipeline
• data-collection
• product-analytics
• +3 more

15.apache / kyuubi

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

• spark
• hive
• sql
• thrift
• jdbc
• spark-sql
• +4 more

16.akka / akka-core

A platform to build and run apps that are elastic, agile, and resilient. SDK, libraries, and hosted environments.

• reactive
• distributed-systems
• concurrency
• high-performance
• akka
• actor-model
• +3 more

17.awslabs / deequ

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

• dataquality
• spark
• unit-testing
• scala

18.lhartikk / ArnoldC

Arnold Schwarzenegger based programming language

19.Netflix / atlas

In-memory dimensional time series database.

20.apache / openwhisk

Apache OpenWhisk is an open source serverless cloud platform

• openwhisk
• apache
• serverless
• cloud
• faas
• functions-as-a-service
• +5 more

21.playframework / playframework

The Community Maintained High Velocity Web Framework For Java and Scala.

• scala
• java
• reactive
• web-framework
• restful
• play
• +5 more

22.graphframes / graphframes

GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs

• apache-spark
• big-data
• connected-components
• dataframe
• dataframes
• graphs
• +8 more

23.apache / predictionioArchived

PredictionIO, a machine learning server for developers and ML engineers.

• scala
• big-data
• predictionio

24.prisma / prisma1Archived

💾 Database Tools incl. ORM, Migrations and Admin UI (Postgres, MySQL & MongoDB) [deprecated]

• orm
• database
• graphql
• datamapper
• serverless
• dao
• +1 more

25.JohnSnowLabs / spark-nlp

State of the Art Natural Language Processing

• nlp
• natural-language-processing
• spark
• pyspark
• named-entity-recognition
• sentiment-analysis
• +14 more

26.yahoo / CMAK

CMAK is a tool for managing Apache Kafka clusters

• kafka
• scala
• cluster-management
• big-data

27.typelevel / fs2

Compositional, streaming I/O library for Scala

• scala
• stream
• streaming-computation
• fp
• functional-programming

28.coursier / coursier

Pure Scala Artifact Fetching

• scala
• sbt-plugin
• launcher
• scalajs
• scala-native

29.nymanjens / facto

Family Accounting Tool

• accounting
• personal
• tool
• family
• website

30.broadinstitute / cromwell

Scientific workflow engine designed for simplicity & scalability. Trivially transition between one off use cases to massive scale production environments

• workflow-execution
• workflow
• cloud
• hpc
• bioinformatics
• executor
• +7 more

31.apache / cassandra-spark-connector

Apache Spark to Apache Cassandra connector

• cassandra
• scala
• spark

32.combust / mleap

MLeap: Deploy ML Pipelines to Production

• scikit-learn
• spark
• data-pipelines
• transformers
• tensorflow
• scala
• +1 more

33.softwaremill / sttp

The Scala HTTP client you always wanted!

• scala
• http
• httpclient
• interpolator
• uri
• asynchronous
• +12 more

34.TouK / nussknacker

Low-code tool for automating actions on real time data | Stream processing for the users.

• flink
• flink-kafka
• apache-flink
• gui
• touk
• real-time
• +13 more

35.nymanjens / piga

List editor for power users, backed by a self-hosted server

• selfhosted
• todolist
• website

36.monix / monix

Asynchronous, Reactive Programming for Scala and Scala.js.

• scala
• monix
• typelevel
• functional-programming
• reactive-programming
• fp
• +4 more

37.scalalandio / chimney

Scala library for boilerplate-free, type-safe data transformations

• scala
• boilerplate
• generic-programming
• automatic-conversion
• auto-mapping
• data-rewriting
• +12 more

38.bigdatagenomics / adam

ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.

• spark
• big-data
• bioinformatics
• genomics
• parquet
• avro
• +4 more

39.apache / livy

Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.

• livy
• bigdata
• spark
• apachelivy

40.Interana / eventsim

Event data simulator. Generates a stream of pseudo-random events from a set of users, designed to simulate web traffic.

41.scalaz / scalaz

Principled Functional Programming in Scala

• scalaz
• scala
• functional-programming
• scala-native
• scalajs

42.circe / circe

Yet another JSON library for Scala

• json
• generic-derivation
• scala

43.typelevel / skunk

A data access library for Scala + Postgres.

• scala
• postgres
• functional-programming
• cats
• cats-effect
• fs2
• +3 more

44.scalapb / ScalaPB

Protocol buffer compiler for Scala.

• scalapb
• protocol-buffers
• scala

45.scalacenter / bloop

Bloop is a build server and CLI tool to compile, test and run Scala fast from any editor or build tool.

• scala
• productivity
• developer-tools
• compilation-server
• java
• build-system
• +1 more

46.linkedin / isolation-forest

A distributed Spark/Scala implementation of the isolation forest and extended isolation forest algorithms for unsupervised outlier detection, featuring support for scalable training and ONNX export for easy cross-platform inference.

• isolation-forest
• spark
• linkedin
• outlier-detection
• unsupervised-learning
• machine-learning
• +3 more

47.twitter / util

Wonderful reusable code from Twitter

• finagle
• scala
• utility

48.scalatest / scalatest

A testing tool for Scala and Java developers

49.twitter / scalding

A Scala API for Cascading

50.milessabin / shapeless

Generic programming for Scala

• scala
• typelevel
• functional-programming
• generic-programming
• fp

51.sangria-graphql / sangria

Scala GraphQL implementation

• sangria
• graphql
• scala
• api

52.scopt / scopt

command line options parsing for Scala

• options-parsing
• scala
• command-line

53.h2oai / sparkling-water

Sparkling Water provides H2O functionality inside Spark cluster

• h2o
• spark
• machine-learning
• integration
• pysparkling
• rsparkling
• +3 more

54.higherkindness / droste

recursion schemes for cats; to iterate is human, to recurse, divine

• scala
• recursion-schemes
• functional-programming

55.galax-io / gatling-kafka-plugin

Gatling plugin for Apache Kafka — produce, request-reply, and consume load testing with Avro, Protobuf, and Schema Registry support

• gatling
• kafka
• performance
• performance-testing
• avro
• java
• +5 more

56.sryza / aas

Code to accompany Advanced Analytics with Spark from O'Reilly Media

57.filodb / FiloDB

Distributed Prometheus time series database

• scala
• time-series
• database
• distributed
• prometheus
• metrics
• +2 more

58.com-lihaoyi / fastparse

Writing Fast Parsers Fast in Scala

59.com-lihaoyi / upickle

uPickle: a simple, fast, dependency-free JSON & Binary (MessagePack) serialization library for Scala

60.apache / incubator-toree

Mirror of Apache Toree (Incubating)

• toree

61.com-lihaoyi / utest

A simple testing framework for Scala

62.helgeho / ArchiveSpark

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

• archivespark
• spark-framework
• spark
• web-archiving
• webarchive
• internet-archive
• +1 more

63.archivesunleashed / aut

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

• spark
• hadoop
• webarchives
• analysis
• apache-spark
• scala
• +8 more

64.jokade / slogging

A Typesafe-logging (and slf4j) compatible logging library based on macros for Scala/JVM, Scala.js, and Scala Native

• scala
• slf4j
• scala-js
• log-statements
• scala-native

65.ekrich / sblas

Scala Native BLAS (Basic Linear Algebra Subprograms) supporting Linux and macOS

• scala
• scala-native
• math
• linear-algebra
• blas
• linux
• +1 more

66.galax-io / gatling-picatinny

Gatling DSL extensions — feeders, profile management, transactions, assertions, Redis integration, and utility functions

• gatling
• performance
• performance-testing
• gatling-plugin
• dsl
• feeders
• +6 more

67.galax-io / gatling-jdbc-plugin

Gatling plugin for JDBC — SQL queries, batch operations, and stored procedures with HikariCP connection pooling

• gatling
• performance
• performance-testing
• jdbc
• gatling-plugin
• hikaricp
• +6 more

68.spark-jobserver / spark-jobserver

REST job server for Apache Spark

• spark
• rest-api
• spark-jobserver
• scala

69.com-lihaoyi / Ammonite

Scala Scripting

70.typelevel / scalacheck

Property-based testing for Scala

• scala
• scalacheck
• property-testing

71.holdenk / spark-testing-base

Base classes to use when writing tests with Spark

72.wavesplatform / Waves

⛓️ Reference Waves Blockchain Node (client) implementation on Scala

• blockchain
• cryptography
• smart-contracts
• decentralized-applications

73.ghostdogpr / caliban

Functional GraphQL library for Scala

• scala
• graphql
• graphql-server
• functional-programming
• graphql-client

74.typelevel / squants

The Scala API for Quantities, Units of Measure and Dimensional Analysis

75.softwaremill / quicklens

Modify deeply nested case class fields

• scala
• lenses
• functional-programming

76.plokhotnyuk / jsoniter-scala

Scala macros for compile-time generation of safe and ultra-fast JSON codecs + circe booster

• scala
• json
• high-performance
• serialization
• parsing
• jsoniter-scala
• +10 more

77.com-lihaoyi / scalatags

ScalaTags is a small XML/HTML construction library for Scala.

78.dbpedia-spotlight / dbpedia-spotlightArchived

DBpedia Spotlight is a tool for automatically annotating mentions of DBpedia resources in text.

• dbpedia-spotlight
• nlp
• semantic-web
• entity-linking
• text-annotation
• content-tagging
• +2 more

79.gearpump / gearpump

Lightweight real-time big data streaming engine over Apache Pekko

• akka
• stream-processing
• bigdata
• scala

80.etorreborre / specs2

Software Specifications for Scala

• scala
• specs2
• specification
• test
• bdd

81.bkirwi / decline

A composable command-line parser for Scala.

82.felixgborrego / simple-docker-ui

Native Docker UI implemented using Scala.js and React - DEPRECATED

• docker
• scalajs
• react
• deprecated-repo

83.outr / scribe

The fastest logging library in the world. Built from scratch in Scala and programmatically configurable.

• scribe
• scala
• slf4j
• logging
• logging-library
• logback
• +1 more

84.argonaut-io / argonaut

Purely functional JSON parser and library in scala.

• argonaut
• scala
• json
• json-parser
• scalaz
• functional-programming

85.com-lihaoyi / sourcecode

Scala library providing "source" metadata to your program, similar to Python's __name__, C++'s __LINE__ or Ruby's __FILE__.

86.scalameta / munit

Scala testing library with actionable errors and extensible APIs

87.twitter / storehaus

Storehaus is a library that makes it easy to work with asynchronous key value stores

88.neo4j / neo4j-spark-connector

Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs

• spark
• neo4j-connector
• cypher
• neo4j-driver
• bolt
• hacktoberfest

89.scalaprops / scalaprops

property based testing library for Scala

• scalaz
• testing
• scala
• scalaprops
• prng
• mersenne-twister
• +5 more

90.apache / hbase-connectors

Apache HBase Connectors

• database
• java
• hbase

91.com-lihaoyi / fansi

Scala/Scala.js library for manipulating Fancy Ansi colored strings

92.com-lihaoyi / mainargs

A small, convenient, dependency-free library for command-line argument parsing in Scala

93.lolgab / snunit

Scala Native HTTP server based on FreeUnit

• nginx-unit
• scala-native
• http-server
• scala
• serverless
• cask
• +3 more

94.ekrich / sconfig

Scala configuration library supporting HOCON for Scala, Java, Scala.js, and Scala Native

• scala
• scala-native
• scala-js
• config
• hocon
• java
• +1 more

95.outr / reactify

The first and only true Functional Reactive Programming framework for Scala.

• scala
• reactive
• frp
• frp-library
• rx

96.lolgab / scalaui

Scala Native GUI framework

• scala
• scala-native
• gui
• win32
• immediate-mode
• immediate-mode-gui
• +3 more

97.h0ngcha0 / bitcoin4s

A Bitcoin Script Interpreter and Debugger in Scala

• scala
• bitcoin
• cryptocurrency

98.sparsetech / toml-scalaArchived

TOML parser with codec derivation for the Scala platform

• scala
• scala-native
• toml
• shapeless
• scalajs

99.lolgab / scala-native-jdbc

JDBC Implementation for Scala Native

• jdbc
• scala-native
• sqlite

100.edadma / ncurses

Scala Native bindings for the GNU Ncurses C library

• scala
• scala-native
• ncurses-library
• bindings