AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
- aitools
- crawl
- scrape
- serp
132,241 visible repositories in the index
457–480 of 2,770 · Most stars
AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
A tool to snap pixels to a perfect grid. Designed to fix messy and inconsistent pixel art generated by AI.
Fast Portable Noise Library - C# C++ C Java HLSL GLSL JavaScript Rust Go
Make optimisation of images part of your automated build process
Open-source inference server and production cluster for all the models your agent needs.
:package: Android Parcelables made easy through code generation.
This repo contains the source code in my personal column (https://zhuanlan.zhihu.com/zhaoyeyu), implemented using Python 3.6. Including Natural Language Processing and Computer Vision projects, such as text generation, machine translation, deep convolution GAN and other actual combat code.
Open-source AI humanizer: rewrite AI-generated text into natural, human-sounding prose. LLM rewriting + multi-engine translation, with step-by-step traces. Python CLI, n8n & Docker.
✨ AsrTools: Smart Voice-to-Text Tool | Efficient Batch Processing | User-Friendly Interface | No GPU Required | Supports SRT/TXT Output | Turn your audio into accurate text in an instant!
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
A graphical processor simulator and assembly editor for the RISC-V ISA
TextAttack 🐙 is a Python framework for adversarial attacks, data augmentation, and model training in NLP https://textattack.readthedocs.io/en/master/
Kotlin Symbol Processing API
Breeze is/was a numerical processing library for Scala.
Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.
🚀 EvoAgentX: Building a Self-Evolving Ecosystem of AI Agents
Parser for Rust source code
Memphis.dev is a highly scalable and effortless data streaming platform
A collection of tools developed by other researchers in the Computer Science area to process network traces. All the right reserved for the original authors.
Insane(ly slow but wicked good) PNG image optimization
Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
A minimalist command line knowledge base manager
Learn how to design, develop, deploy and iterate on production-grade ML applications.
DDSP: Differentiable Digital Signal Processing