Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard and designing lighteval!
- evaluation
- evaluation-metrics
- guidebook
- large-language-models
Repository Index
87,075 visible repositories in the index
73–96 of 138 · Most stars
An on-premises, OCR-free unstructured data extraction, markdown conversion and benchmarking toolkit. (https://idp-leaderboard.org/)
- document
- document-analysis
- extraction
- llms
Xinfra Monitor monitors the availability of Kafka clusters by producing synthetic workloads using end-to-end pipelines to obtain derived vital statistics - E2E latency, service produce/consume availability, offsets commit availability & latency, message loss rate and more.
- kafka-monitor
- kafka-cluster
- monitor-topic
- partition
:cloud: :rocket: :bar_chart: :chart_with_upwards_trend: Evaluating state of the art in AI
An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
- deep-learning
- evaluation
- foundation-models
- instruction-following
:satellite: BroadcastChannel to send data between different browser-tabs or nodejs-processes :satellite: + LeaderElection over the channels https://pubkey.github.io/broadcast-channel/
- crosstab
- broadcast-channel
- broadcast
- polyfill
A modern, responsive admin framework for Ruby on Rails
- ruby
- rails
- admin-dashboard
Dromara MaxKey 🗝️ SSO ,Leading-Edge IAM-IDaas(Identity and Access Management) Product , Under Apache-2.0 is free ，业界领先的IAM-IDaas身份管理和认证产品，遵循Apache-2.0开源免费，支持OAuth2.x、OpenID Connect、SAML2.0、CAS、JWT、SCIM等SSO标准协议，基于RBAC统一权限控制，实现用户生命周期管理，开源、安全、合规、自主可控。
- saml
- jwt
- cas
- rbac
The leading open-source AI copilot for JetBrains. Connect to any model in any environment, and customize your coding experience in any way you like.
- intellij
- intellij-plugin
- jetbrains
- codellama
🚨 CVE-2023-45866 - BlueDucky Implementation (Using DuckyScript) 🔓 Unauthenticated Peering Leading to Code Execution (Using HID Keyboard)
A mod manager for Baldur's Gate 3. This is the only official source!
googleads-mobile-android
The Common Data Model (CDM) is a standard and extensible collection of schemas (entities, attributes, relationships) that represents business concepts and activities with well-defined semantics, to facilitate data interoperability. Examples of entities include: Account, Contact, Lead, Opportunity, Product, etc.
- csharp
- typescript
- java
- python
ViroReact is the leading library for building AR and VR experiences and applications using React Native and Expo.
CogDL: A Comprehensive Library for Graph Deep Learning (WWW 2023)
- graph-neural-networks
- pytorch
- graph-embedding
- node-classification
Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard
- glue
- language-understanding
- bert
- pre-trained-model
Chat2API enables zero-cost access to leading AI models by leveraging official web UIs. It supports providers such as DeepSeek, GLM, Kimi, MiniMax, Qwen, and Z.ai, and seamlessly integrates with tools like openlcaw, Cline, and Roo-Code.
- chatgpt-api
- deepseek-chat
- free-api
- glm-5
Industry-leading free, high-performance, AI and semantic technology Web Application Firewall and API Security Gateway (WAAP) - UUSEC WAF.
- waf
- application-security
- web-application-firewall
- modsecurity
The repository host gives no description.
Books for people who are or aspire to manage/lead team(s) of software engineers
- leadership
- culture
- management
- engineering
The repository host gives no description.
Here's how to use it:
- dsa
- cpp
- leetcode
Uma lista selecionada de conteúdos sobre liderança técnica, com preferência em conteúdos em português
A developer's guide to management: an open-sourced handbook for leading software engineering teams.