This is a repo with links to everything you'd ever want to learn about data engineering
Repository Index
110,088 visible repositories in the index
1–7 of 7 · Most stars
Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks
- spark
- python
- pyspark
- data-analysis
An easy/swift-to-adapt PyTorch-Lighting template. 套壳模板,简单易用,稍改原来Pytorch代码,即可适配Lightning。You can translate your previous Pytorch code much easier using this template, and keep your freedom to edit all the functions as well. Big-project-friendly as well. No need to rewrite your config in hydra.
- pytorch
- pytorch-lightning
- pytorch-lightning-template
- best-practices
This tutorial playlist covers data structures and algorithms in python. Every tutorial has theory behind data structure or an algorithm, BIG O Complexity analysis and exercises that you can practice on.
Useful scripts, udfs, views, and other utilities for migration and data warehouse operations in BigQuery.
- bigquery
- google-cloud-platform
- data-warehouse
- sql
PySpark-Tutorial provides basic algorithms using PySpark
Big Data essentials: Hadoop, MapReduce, Spark. Explore tutorials and demos in Jupyter notebooks—most are self-contained and live, ready to run with a click.