TranslatedDistributed web crawler admin platform for spiders management regardless of languages and frameworks.
- webcrawler
- scrapy
- crawlab
- spiders-management
47,133 repositories indexed
1–4 of 4 · Most stars
TranslatedDistributed web crawler admin platform for spiders management regardless of languages and frameworks.
Open-source, self-hosted enterprise & site search server built on OpenSearch. Crawls web / file / DB / cloud sources, 20+ languages, REST API, and AI/RAG & semantic search. Apache-2.0.
Slack Developer Kit (including Bolt for Java) for any JVM language
💻 Update a pinned gist to contain languages of your recent commits in GitHub