Repository Index

🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

• crawler
• crawling
• crawling-python
• playwright

LlamaIndex is the document processing platform for AI

• agents
• application
• data
• fine-tuning

Superduper: End-to-end framework for building custom AI applications and agents.

• ai
• mlops
• torch
• transformers

Mimesis is a Python library for generating fake but realistic data in multiple languages and locales.

• mimesis
• fake
• data
• generator

Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.

• dataops
• dataops-platform
• elt
• open-source