Throughput
The work a system completes in a period, such as requests per second or tokens per second. High throughput is different from a short wait for one request.
By Mega AI Hub Editorial · Compute & hosting
5,108,791 AI resources indexedWorking toward the world’s largest AI resource index.
The work a system completes in a period, such as requests per second or tokens per second. High throughput is different from a short wait for one request.
By Mega AI Hub Editorial · Compute & hosting