Repository Index

🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

• crawler
• crawling
• crawling-python
• playwright

LlamaIndex is the document processing platform for AI

• agents
• application
• data
• fine-tuning

[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.

• data
• data-cleaning
• data-pipelines
• data-processing

Superduper: End-to-end framework for building custom AI applications and agents.

• ai
• mlops
• torch
• transformers

Mimesis is a Python library for generating fake but realistic data in multiple languages and locales.

• mimesis
• fake
• data
• generator

Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.

• dataops
• dataops-platform
• elt
• open-source

Clean APIs for data cleaning. Python implementation of R package Janitor

• pandas
• dataframe
• data
• cleaning-data

Main yt repository

• data
• visualization
• analysis
• python

:chart_with_upwards_trend: A live cryptocurrency historical trade data blotter. Download live historical trade data from any cryptoexchange, be it for machine learning, backtesting/visualizing trading strategies or for Quantopian/Zipline.

• cryptocurrency
• exchange
• trade
• data

Stock price prediction using a deterministic algorithm inspired by LSTM, focusing on pattern recognition in historical data.

• crypto
• deterministic
• finance
• forex