5,362,129 AI resources indexedWorking toward the world’s largest AI resource index.

PDF

Tools & apps

AI software for creative and professional work.

How to use the library

Local Inference Engines RAG and Retrieval AI Evaluation Tools AI Monitoring

Browse Browser Add-ons

Resources

Search results
Search stays within tools & apps.
Tool

NetEase-Media/grps_trtllm

Higher performance OpenAI LLM service than vLLM serve: A pure C++ high-performance OpenAI LLM service implemented with GPRS+TensorRT-LLM+Tokenizers.cpp, supporting chat and function call, AI agents, distributed multi-GPU inference, multimodal capabilities, and a Gradio chat interface.

NetEase-Media161
Apache-2.0View resource

Platform labels describe intended use. Read each resource's author credits, requirements and available access methods.