Trending repositories

1.twitter / the-algorithm

Source code for the X Recommendation Algorithm

2.apache / spark

Apache Spark - A unified analytics engine for large-scale data processing

• python
• scala
• r
• java
• big-data
• jdbc
• +2 more

3.lichess-org / lila

♞ lichess.org: the forever free, adless and open source chess server ♞

• scala
• chess
• play-framework
• non-profit
• functional-programming
• type-safe
• +4 more

4.delta-io / delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

• spark
• acid
• big-data
• analytics
• delta-lake

5.rtyley / bfg-repo-cleaner

Removes large or troublesome blobs like git-filter-branch does, but faster. And written in Scala

• git

6.scala / scala

Scala 2 compiler and standard library. Scala 2 bugs at https://github.com/scala/bug; Scala 3 at https://github.com/scala/scala3

• scala
• scala-compiler
• scala-programming-language
• scala-library
• jvm-languages
• functional-programming
• +1 more

7.softwaremill / elasticmq

In-memory message queue with an Amazon SQS-compatible interface. Runs stand-alone or embedded.

• scala
• sqs-interface
• elasticmq
• amazon-sqs
• aws
• aws-sqs
• +1 more

8.apache / pekko

Build highly concurrent, distributed, and resilient message-driven applications using Java/Scala

• actor-model
• cloud-native
• concurrency
• distributed-actors
• distributed-systems
• high-performance
• +4 more

9.gatling / gatling

Modern Load Testing as Code

• netty
• scala
• loadtesting
• automation
• gatling
• load-testing
• +13 more

10.gitbucket / gitbucket

A Git platform powered by Scala with easy installation, high extensibility & GitHub API compatibility

• scala
• gitbucket
• git
• scalatra

11.com-lihaoyi / mill

A better build tool for Java, Scala and Kotlin: Simpler than Maven, easier than Gradle, with 3-7x faster dev workflows than other JVM build tools

• scala
• build-tool
• build-system
• java
• scala-js
• scala-native
• +4 more

12.akka / akka-core

A platform to build and run apps that are elastic, agile, and resilient. SDK, libraries, and hosted environments.

• reactive
• distributed-systems
• concurrency
• high-performance
• akka
• actor-model
• +3 more

13.typelevel / cats

Lightweight, modular, and extensible library for functional programming.

14.apache / kyuubi

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

• spark
• hive
• sql
• thrift
• jdbc
• spark-sql
• +4 more

15.awslabs / deequ

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

• dataquality
• spark
• unit-testing
• scala

16.snowplow / snowplow

The leader in Customer Data Infrastructure

• snowplow
• analytics
• data
• data-pipeline
• data-collection
• product-analytics
• +3 more

17.apache / openwhisk

Apache OpenWhisk is an open source serverless cloud platform

• openwhisk
• apache
• serverless
• cloud
• faas
• functions-as-a-service
• +5 more

18.microsoft / SynapseML

Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark

• spark
• pyspark
• azure
• scala
• microsoft
• ml
• +14 more

19.lhartikk / ArnoldC

Arnold Schwarzenegger based programming language

20.playframework / playframework

The Community Maintained High Velocity Web Framework For Java and Scala.

• scala
• java
• reactive
• web-framework
• restful
• play
• +5 more

21.JohnSnowLabs / spark-nlp

State of the Art Natural Language Processing

• nlp
• natural-language-processing
• spark
• pyspark
• named-entity-recognition
• sentiment-analysis
• +14 more

22.Netflix / atlas

In-memory dimensional time series database.

23.graphframes / graphframes

GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs

• apache-spark
• big-data
• connected-components
• dataframe
• dataframes
• graphs
• +8 more

24.yahoo / CMAK

CMAK is a tool for managing Apache Kafka clusters

• kafka
• scala
• cluster-management
• big-data

25.apache / predictionioArchived

PredictionIO, a machine learning server for developers and ML engineers.

• scala
• big-data
• predictionio

26.prisma / prisma1Archived

💾 Database Tools incl. ORM, Migrations and Admin UI (Postgres, MySQL & MongoDB) [deprecated]

• orm
• database
• graphql
• datamapper
• serverless
• dao
• +1 more

27.nymanjens / facto

Family Accounting Tool

• accounting
• personal
• tool
• family
• website

28.coursier / coursier

Pure Scala Artifact Fetching

• scala
• sbt-plugin
• launcher
• scalajs
• scala-native

29.broadinstitute / cromwell

Scientific workflow engine designed for simplicity & scalability. Trivially transition between one off use cases to massive scale production environments

• workflow-execution
• workflow
• cloud
• hpc
• bioinformatics
• executor
• +7 more

30.TouK / nussknacker

Low-code tool for automating actions on real time data | Stream processing for the users.

• flink
• flink-kafka
• apache-flink
• gui
• touk
• real-time
• +13 more

31.typelevel / fs2

Compositional, streaming I/O library for Scala

• scala
• stream
• streaming-computation
• fp
• functional-programming

32.typelevel / skunk

A data access library for Scala + Postgres.

• scala
• postgres
• functional-programming
• cats
• cats-effect
• fs2
• +3 more

33.apache / livy

Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.

• livy
• bigdata
• spark
• apachelivy

34.scalaz / scalaz

Principled Functional Programming in Scala

• scalaz
• scala
• functional-programming
• scala-native
• scalajs

35.bigdatagenomics / adam

ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.

• spark
• big-data
• bioinformatics
• genomics
• parquet
• avro
• +4 more

36.nymanjens / piga

List editor for power users, backed by a self-hosted server

• selfhosted
• todolist
• website

37.Interana / eventsim

Event data simulator. Generates a stream of pseudo-random events from a set of users, designed to simulate web traffic.

38.circe / circe

Yet another JSON library for Scala

• json
• generic-derivation
• scala

39.combust / mleap

MLeap: Deploy ML Pipelines to Production

• scikit-learn
• spark
• data-pipelines
• transformers
• tensorflow
• scala
• +1 more

40.scalalandio / chimney

Scala library for boilerplate-free, type-safe data transformations

• scala
• boilerplate
• generic-programming
• automatic-conversion
• auto-mapping
• data-rewriting
• +12 more

41.apache / cassandra-spark-connector

Apache Spark to Apache Cassandra connector

• cassandra
• scala
• spark

42.softwaremill / sttp

The Scala HTTP client you always wanted!

• scala
• http
• httpclient
• interpolator
• uri
• asynchronous
• +12 more

43.scalacenter / bloop

Bloop is a build server and CLI tool to compile, test and run Scala fast from any editor or build tool.

• scala
• productivity
• developer-tools
• compilation-server
• java
• build-system
• +1 more

44.linkedin / isolation-forest

A distributed Spark/Scala implementation of the isolation forest and extended isolation forest algorithms for unsupervised outlier detection, featuring support for scalable training and ONNX export for easy cross-platform inference.

• isolation-forest
• spark
• linkedin
• outlier-detection
• unsupervised-learning
• machine-learning
• +3 more

45.filodb / FiloDB

Distributed Prometheus time series database

• scala
• time-series
• database
• distributed
• prometheus
• metrics
• +2 more

46.galax-io / gatling-picatinny

Gatling DSL extensions — feeders, profile management, transactions, assertions, Redis integration, and utility functions

• gatling
• performance
• performance-testing
• gatling-plugin
• dsl
• feeders
• +6 more

47.milessabin / shapeless

Generic programming for Scala

• scala
• typelevel
• functional-programming
• generic-programming
• fp

48.sangria-graphql / sangria

Scala GraphQL implementation

• sangria
• graphql
• scala
• api

49.ghostdogpr / caliban

Functional GraphQL library for Scala

• scala
• graphql
• graphql-server
• functional-programming
• graphql-client

50.twitter / util

Wonderful reusable code from Twitter

• finagle
• scala
• utility

51.monix / monix

Asynchronous, Reactive Programming for Scala and Scala.js.

• scala
• monix
• typelevel
• functional-programming
• reactive-programming
• fp
• +4 more

52.holdenk / spark-testing-base

Base classes to use when writing tests with Spark

53.scalapb / ScalaPB

Protocol buffer compiler for Scala.

• scalapb
• protocol-buffers
• scala

54.scalatest / scalatest

A testing tool for Scala and Java developers

55.softwaremill / quicklens

Modify deeply nested case class fields

• scala
• lenses
• functional-programming

56.h2oai / sparkling-water

Sparkling Water provides H2O functionality inside Spark cluster

• h2o
• spark
• machine-learning
• integration
• pysparkling
• rsparkling
• +3 more

57.neo4j / neo4j-spark-connector

Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs

• spark
• neo4j-connector
• cypher
• neo4j-driver
• bolt
• hacktoberfest

58.twitter / scalding

A Scala API for Cascading

59.typelevel / scalacheck

Property-based testing for Scala

• scala
• scalacheck
• property-testing

60.scopt / scopt

command line options parsing for Scala

• options-parsing
• scala
• command-line

61.com-lihaoyi / sourcecode

Scala library providing "source" metadata to your program, similar to Python's __name__, C++'s __LINE__ or Ruby's __FILE__.

62.scalameta / munit

Scala testing library with actionable errors and extensible APIs

63.com-lihaoyi / mainargs

A small, convenient, dependency-free library for command-line argument parsing in Scala

64.helgeho / ArchiveSpark

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

• archivespark
• spark-framework
• spark
• web-archiving
• webarchive
• internet-archive
• +1 more

65.plokhotnyuk / jsoniter-scala

Scala macros for compile-time generation of safe and ultra-fast JSON codecs + circe booster

• scala
• json
• high-performance
• serialization
• parsing
• jsoniter-scala
• +10 more

66.bkirwi / decline

A composable command-line parser for Scala.

67.archivesunleashed / aut

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

• spark
• hadoop
• webarchives
• analysis
• apache-spark
• scala
• +8 more

68.com-lihaoyi / Ammonite

Scala Scripting

69.com-lihaoyi / fastparse

Writing Fast Parsers Fast in Scala

70.ReactiveMongo / ReactiveMongo

:leaves: Non-blocking, Reactive MongoDB Driver for Scala

• scala
• reactivemongo
• mongodb
• database
• driver
• reactive
• +1 more

71.com-lihaoyi / upickle

uPickle: a simple, fast, dependency-free JSON & Binary (MessagePack) serialization library for Scala

72.apache / incubator-toree

Mirror of Apache Toree (Incubating)

• toree

73.outr / scribe

The fastest logging library in the world. Built from scratch in Scala and programmatically configurable.

• scribe
• scala
• slf4j
• logging
• logging-library
• logback
• +1 more

74.scalaprops / scalaprops

property based testing library for Scala

• scalaz
• testing
• scala
• scalaprops
• prng
• mersenne-twister
• +5 more

75.twitter-archive / flockdbArchived

A distributed, fault-tolerant graph database

76.dbpedia-spotlight / dbpedia-spotlightArchived

DBpedia Spotlight is a tool for automatically annotating mentions of DBpedia resources in text.

• dbpedia-spotlight
• nlp
• semantic-web
• entity-linking
• text-annotation
• content-tagging
• +2 more

77.Hydrospheredata / mist

Serverless proxy for Spark cluster

• apache-spark
• api
• big-data
• serverless

78.jokade / slogging

A Typesafe-logging (and slf4j) compatible logging library based on macros for Scala/JVM, Scala.js, and Scala Native

• scala
• slf4j
• scala-js
• log-statements
• scala-native

79.ekrich / sblas

Scala Native BLAS (Basic Linear Algebra Subprograms) supporting Linux and macOS

• scala
• scala-native
• math
• linear-algebra
• blas
• linux
• +1 more

80.sparsetech / toml-scalaArchived

TOML parser with codec derivation for the Scala platform

• scala
• scala-native
• toml
• shapeless
• scalajs

81.twitter / summingbirdArchived

Streaming MapReduce with Scalding and Storm

82.wavesplatform / Waves

⛓️ Reference Waves Blockchain Node (client) implementation on Scala

• blockchain
• cryptography
• smart-contracts
• decentralized-applications

83.cloudera / livy

Livy is an open source REST interface for interacting with Apache Spark from anywhere

84.com-lihaoyi / scalatags

ScalaTags is a small XML/HTML construction library for Scala.

85.etorreborre / specs2

Software Specifications for Scala

• scala
• specs2
• specification
• test
• bdd

86.argonaut-io / argonaut

Purely functional JSON parser and library in scala.

• argonaut
• scala
• json
• json-parser
• scalaz
• functional-programming

87.databricks / spark-xmlArchived

XML data source for Spark SQL and DataFrames

88.twitter / storehaus

Storehaus is a library that makes it easy to work with asynchronous key value stores

89.pawelkaczor / akka-ddd

Akka CQRS/ES framework

• ddd
• event-sourcing
• cqrs
• microservices
• akka

90.Stratio / Spark-MongoDBArchived

Spark library for easy MongoDB access

91.com-lihaoyi / fansi

Scala/Scala.js library for manipulating Fancy Ansi colored strings

92.com-lihaoyi / castor

Castor is a lightweight, typed Actor library for Scala and Scala.js

93.lolgab / snunit

Scala Native HTTP server based on FreeUnit

• nginx-unit
• scala-native
• http-server
• scala
• serverless
• cask
• +3 more

94.Team846 / potassium

A framework for writing robot software with functional programming in Scala

• scala
• robotics
• reactive
• functional