Crawl a site to generate knowledge files to create your own custom GPT from a URL
Repository Index
47,133 repositories indexed
49–72 of 754 · Most stars
Generative Agents: Interactive Simulacra of Human Behavior
Remove large amounts of unwanted applications quickly.
- uninstall
- uninstaller
- cleaner
- bulk-actions
TranslatedA Python web scraping tutorial series, learning Python web scraping from 0 to 1, including browser packet capture and mobile APP packet capture with tools such as fiddler and mitmproxy, the use of the various modules involved in web scraping, such as requests, beautifulSoup, selenium, appium, scrapy, etc., as well as IP proxies, CAPTCHA recognition, using Mysql and MongoDB databases with Python, multi-threaded and multi-process scraping, reverse engineering and cracking of CSS scraping encryption, JS scraping reverse engineering, distributed scraping, practical scraping project examples, etc.
- python3
- python-script
- python-spider
⚡ Automatically decrypt encryptions without knowing the key or cipher, decode encodings, and crack hashes ⚡
- decryption
- natural-language-processing
- cryptography
- cipher
LLM Wiki is a cross-platform desktop application that turns your documents into an organized, interlinked knowledge base — automatically. Instead of traditional RAG (retrieve-and-answer from scratch every time), the LLM incrementally builds and maintains a persistent wiki from your sources。
TranslatedSelf-hosted TikTok, Douyin & Bilibili scraper and no-watermark video downloader — async REST API, MCP server for AI agents, CLI and web console, plus offline speech-to-text for downloaded videos. Self-healing identity pool, PostgreSQL archive, one docker compose up.
FLOSS kanban, built with Meteor. Official Public Support at GitHub issues only. Official Private Pre-Paid Support at https://wekan.fi/commercial-support/ only. Translation PRs to imports/i18n/data/en.i18n.json, other translations at https://app.transifex.com/wekan/wekan . No telemetry.
- kanban
- meteor
- wekan
- docker-image
❤️ 1000+ Hand-Crafted Go Examples, Exercises, and Quizzes. 🚀 Learn Go by fixing 1000+ tiny programs.
- golang
- go
- course
- exercise
🛠️⚡ Step-by-step tutorial to build a modern JavaScript stack.
An AI-powered research assistant that performs iterative, deep research on any topic by combining search engines, web scraping, and large language models. The goal of this repo is to provide the simplest implementation of a deep research agent - e.g. an agent that can refine its research direction overtime and deep dive into a topic.
PdfCraft: An open-source PDF reader and editor written by scratch in pure Rust
- document-processing
- documents
- pdf-generation
One has no future if one couldn't teach themself.
A lightweight WebAssembly runtime that is fast, secure, and standards-compliant
Generate any location from the real world in Minecraft with a high level of detail.
Premium hand-crafted icons built by Ionic, for Ionic apps and web apps everywhere 🌎
Turn any website into a structured API. Extract, automate, search and monitor the web.
- automation
- no-code
- scraper
- web-scraper
A next-generation crawling and spidering framework.
- crawler
- web-spider
- gocrawler
- spider-framework
🧰 The Rust SQL Toolkit. An async, pure Rust SQL crate featuring compile-time checked queries without a DSL. Supports PostgreSQL, MySQL, and SQLite.
FilmCraft: An open-source, nonlinear video editor written by scratch in pure Rust
- art
- rust
- video
- video-editing
An open-source, clean-room reimplementation of Microsoft Word in pure Rust
Translated7 days golang programs from scratch (web framework Gee, distributed cache GeeCache, object relational mapping ORM framework GeeORM, rpc framework GeeRPC etc) A series on writing/implementing things from scratch in 7 days with Go
- learning
- starter-project
- golang
- scratch
Best DDoS Attack Script Python3, (Cyber / DDos) Attack With 60 Methods
- ddos
- ddos-attacks
- ddos-tool
- attack
Air-gapped, privacy-focused, open-source NotebookLM alternative. AI agent that researches, transforms, and edits your documents. Join our Discord: https://discord.gg/ejRNvftDp9