TranslatedBig Data Beginner's Guide :star:
- hadoop
- hdfs
- yarn
- mapreduce
Repository Index
47,133 repositories indexed
1–16 of 16 · Most stars
Translatedflink learning blog. http://www.54tianzhisheng.cn/ Covers Flink introduction, concepts, principles, hands-on practice, performance tuning, source code analysis, and more. Includes learning examples involving Flink Connector, Metrics, Library, DataStream API, Table API & SQL, and also shares large-scale project cases of Flink in production (PV/UV, log storage, real-time deduplication of 10 billion records, monitoring and alerting). You are welcome to support my column 《大数据实时计算引擎 Flink 实战与性能优化》 ("Big Data Real-Time Computing Engine Flink: Hands-On Practice and Performance Optimization")
Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learn...
- java
- gpu
- deeplearning
- neural-nets
Upserts, Deletes And Incremental Processing on Big Data.
- hudi
- apachehudi
- datalake
- bigdata
A better compressed bitset in Java: used by Apache Spark, Netflix Atlas, Apache Pinot, Tablesaw, and many others
- java
- bitset
- roaring-bitmaps
- roaringbitmap
Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.
DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.
- workflow
- governance
- azkaban
- davinci
Spoon is a metaprogramming library to analyze and transform Java source code. :spoon: is made with :heart:, :beers: and :sparkles:. It parses source files to build a well-designed AST with powerful analysis and transformation API.
- code-analysis
- code-transformation
- metaprogramming
- code-generation
Elassandra = Elasticsearch + Apache Cassandra
- cassandra
- elasticsearch
- search
- completion
Nessie: Transactional Catalog for Data Lakes with Git-like semantics
- data
- spark
- java
- iceberg
Open scientific N-dimensional image processing :microscope: :sparkler:
Hopsworks - Data-Intensive AI platform with a Feature Store
- feature-store
- aws
- azure
- data-science
The MongoDB Spark Connector
The Deep Learning training framework on Spark
Honeypot that mimics Tomcat manager endpoints. Logs requests and saves attacker's WAR file for later study
- honeypot
- spring-boot
- tomcat
A Splitable Hadoop InputFormat for Concatenated GZIP Files and *.(w)arc.gz