Sign in

Repository Index

47,133 repositories indexed

Filters

Filters

Clear all filters

1–23 of 23 · Most stars

[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.

  • data
  • data-cleaning
  • data-pipelines
  • data-processing

🪽 An open, easy, fast, reliable and battery-efficient solution for real-time communications

  • api
  • web-api
  • server-sent-events
  • subscriptions

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

Glow is an easy-to-use distributed computation system written in Go, similar to Hadoop Map Reduce, Spark, Flink, Storm, etc. I am also working on another similar pure Go system, https://github.com/chrislusf/gleam , which is more flexible and more performant.

golang long polling library. Makes web pub-sub easy via HTTP long-poll servers and clients :smiley: :coffee: :computer:

  • longpolling
  • longpoll-requests
  • longpoll-api
  • longpoll

Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.

A distributed Spark/Scala implementation of the isolation forest and extended isolation forest algorithms for unsupervised outlier detection, featuring support for scalable training and ONNX export for easy cross-platform inference.

  • isolation-forest
  • spark
  • linkedin
  • outlier-detection

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

  • archivespark
  • spark-framework
  • spark
  • web-archiving

A go library for easy configure and run command chains. Such like pipelining in unix shells.

  • golang
  • go
  • library
  • command

Message Broker for IoT/Mobile/Web. Mainly uses MQTT v3.x and v5. Aims to be easy to use, scalable and reliable