Repository Index

A collection of handy Bash One-Liners and terminal tricks for data processing and Linux system maintenance.

• oneliner-commands
• bash
• data-processing
• linux-administration

Computing with Python functions.

• python
• parallel-computing
• caching
• multiprocessing

Image processing algorithms in pure Go

• algorithm
• parallelism
• histogram
• image-processing

PcapPlusPlus is a multiplatform C++ library for capturing, parsing and crafting of network packets. It is designed to be efficient, powerful and easy to use. It provides C++ wrappers for the most popular packet processing engines such as libpcap, Npcap, WinPcap, DPDK, AF_XDP, WinDivert and PF_RING.

• pf-ring
• dpdk
• packet-parsing
• winpcap

Cross-platform desktop GUI app to clean image metadata

• exif
• exiftool
• electron
• javascript

Open source implementation of Apple's Combine framework for processing values over time.

• swift
• combine
• linux
• macos

Concurrent and multi-stage data ingestion and data processing with Elixir

• elixir
• genstage
• data-ingestion
• data-processing

General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). Blazing fast, mobile-enabled, asynchronous and optimized for advanced GPU data processing usecases. Backed by the Linux Foundation.

• vulkan
• vulkan-compute
• vulkan-example
• vulkan-tutorial

C++ image processing and machine learning library with using of SIMD: SSE, AVX, AVX-512, AMX for x86/x64, NEON, SVE for ARM, HVX for Hexagon

• simd
• avx
• neon
• image-processing

Distributed Stream Processing

• stream-processing
• stream-processor
• stream-processing-engine
• pony-language

NFF-Go -Network Function Framework for GO (former YANFF)

• dpdk
• golang
• networking
• vnf

GRASS - free and open-source geospatial processing engine

• grass-gis
• geospatial
• geospatial-analysis
• raster

GD Graphics Library

• graphics
• 2d
• vector
• processing

DSP IIR realtime filter library written in C++

• signal-processing
• filters
• filter-plugin
• iir

A Python platform to perform parallel computations of optimisation tasks (global and local) via the asynchronous generalized island model.

• optimization
• optimization-algorithms
• optimization-methods
• optimization-problem

VeloView performs real-time visualization and easy processing of live captured 3D LiDAR data from Velodyne sensors (Alpha Prime™, Puck™, Ultra Puck™, Puck Hi-Res™, Alpha Puck™, Puck LITE™, HDL-32, HDL-64E). Runs on Windows, Linux and MacOS. This repository is a mirror of https://gitlab.kitware.com/LidarView/VeloView-Velodyne.

• lidar
• lidar-camera-calibration
• lidar-data-manipulation
• lidar-measurements

Open-source image viewer and editor for Linux. View HEIC, AVIF, JPEG XL, RAW previews, and Motion Photos in fullscreen or floating windows.

• avif
• heic
• image-editor
• image-viewer

Fast, memory-safe camera RAW decoder in Rust: ~40 formats, SIMD, GPU, WebAssembly, ICC colour management. CLI, C, C++, Python and JavaScript bindings.

• camera-raw
• decoder
• dng
• image-processing

A blazing fast job processing system backed by GenStage & Redis.

• elixir-lang
• genstage
• background-jobs
• concurrent

Scramjet Platform is a distributed runtime supervisor that can run data processing programs called Sequences and manage local resources on any Linux server, Docker on small edge servers, and even large-scale Kubernetes clusters in the cloud or datacenters without exposing network ports to the public internet.

• nodejs
• stream-processing
• transform-as-a-service
• real-time

Parallelize _anything_ //

• ocaml-library
• parallel-computing
• stream-processing
• multi-processing

Ordered-concurrently a library for concurrent processing with ordered output in Go. Process work concurrently and returns output in a channel in the order of input. It is useful in concurrently processing items in a queue, and get output in the order provided by the queue.

• concurrent
• golang
• golang-library
• data-science

pipelines contains generic functions for concurrent processing

• concurrency
• go
• golang
• pipelines

A modular Linux telemetry engine built with eBPF, libbpf CO-RE, and Modern C++ that captures kernel-level process, file, syscall, and network events through a portable event-processing pipeline for decoding, enrichment, filtering, and structured output—forming the foundation for higher-level runtime intelligence.

• cpp20
• ebpf
• event-logger
• filesystem