大数据入门指南 :star:
- hadoop
- hdfs
- yarn
- mapreduce
47,133 repositories indexed
1–16 of 16 · Most stars
大数据入门指南 :star:
flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例,还有 Flink 落地应用的大型项目案例(PVUV、日志存储、百亿数据实时去重、监控告警)分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》
Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learn...
Upserts, Deletes And Incremental Processing on Big Data.
A better compressed bitset in Java: used by Apache Spark, Netflix Atlas, Apache Pinot, Tablesaw, and many others
Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.
DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.
Spoon is a metaprogramming library to analyze and transform Java source code. :spoon: is made with :heart:, :beers: and :sparkles:. It parses source files to build a well-designed AST with powerful analysis and transformation API.
Elassandra = Elasticsearch + Apache Cassandra
Nessie: Transactional Catalog for Data Lakes with Git-like semantics
Open scientific N-dimensional image processing :microscope: :sparkler:
Hopsworks - Data-Intensive AI platform with a Feature Store
The MongoDB Spark Connector
The Deep Learning training framework on Spark
Honeypot that mimics Tomcat manager endpoints. Logs requests and saves attacker's WAR file for later study
A Splitable Hadoop InputFormat for Concatenated GZIP Files and *.(w)arc.gz