Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Repository Index
47,133 repositories indexed
1–24 of 24 · Most stars
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
- deep-learning
- document-parsing
- machine-learning
- nlp
Plupload is JavaScript API for building file uploaders. It supports multiple file selection, file filtering, chunked upload, client side image downsizing and when necessary can fallback to alternative runtimes, like Flash and Silverlight.
- plupload
- file-upload
- file-utility
This framework implements a strict JSON parser and generator in Objective-C.
- sbjson
- parsing
- objective-c
- chunk
FileAPI — a set of javascript tools for working with files. Multiupload, drag'n'drop and chunked file upload. Images: crop, resize and auto orientation by EXIF.
An implementation of chunked, compressed, N-dimensional arrays for Python.
- zarr
- ndimensional-arrays
- compressed
- python
Modern file uploading - components & hooks for React
- react
- file-upload
- file-uploader
- hooks
The mature, battle-tested, high-end, OG self-hosted image and video hosting solution trusted since 2007. Build your own Flickr / Imgur media sharing platform with complete control over your content, data, and platform rules.
- image-host
- image-hosting
- image-sharing
- image-sharing-website
This is the lua implementation of nvim-hlchunk, you can use this neovim plugin to highlight your indent line and the current chunk (context) your cursor stayed
- lua
- neovim
- indentline
- chunk
This Symfony bundle provides a server implementation for handling single and multiple file uploads using either FineUploader, jQuery File Uploader, YUI3 Uploader, Uploadify, FancyUpload, MooUpload, Plupload or Dropzone. Features include chunked uploads, orphanages, Gaufrette and Flysystem support.
- php
- symfony
- fineuploader
- gaufrette
An extensible Java framework for building event-driven applications that break up XML and non-XML data into chunks for data integration
- java
- smooks
- enterprise-integration
- etl
Seamless long-form MiniMax H3 video generation for ComfyUI with native AV latent continuity, chunked sampling, session resume, and Spectrum/Sage/Sol compatibility.
A view for display markdown text.support markdown streaming like gpt&claude&gemini&deepseek
- aiconversation
- markdown
- markdown-viewer
- streaming-text
Read and write Neuroglancer datasets programmatically.
- neuroglancer
- volumetric-data
- python
- cloud
A framework-agnostic state management library that keeps your app’s state clean and simple. It uses a fine-grained state model, breaking state into independent, manageable chunks.
- state-management
- typescript
- angular
- react
Grok WebGL2 and GLSL through a sequence of guided tutorials, each chunked into atomic Q&A cards suitable for spaced repetition, with hands-on projects and solution code integrated throughout.
- creative-coding
- educational-resources
- glsl
- graphics-programming
hignlight chunk numbercolumn plug of nvim
An Elixir library for generating SVG images
Transform the first chunk in a stream
forked from hlchunk.nvim and removed indent. only chunk and context, simple and faster.
Deno KV file system, compatible with Deno deploy. Saves files in 64kb chunks. You can organize files into directories. You can control the KB/s rate for saving and reading files, rate limit, user space limit and limit concurrent operations, useful for controlling uploads/downloads. Makes use of Web Streams API.
Ruby library for generating images from GeoJSON
Split array/TypedArray to chunks of given size
The Sitecore Item Versioner module adds a new ribbon into the versions chunk of the Content Editor. With the new ribbon it is possible to initially create an item version in all configured languages.