TTFT
Time to first token
The time from sending a request until the first output token becomes available. It measures responsiveness for streaming language models.
By Mega AI Hub Editorial · Compute & hosting
5,108,791 AI resources indexedWorking toward the world’s largest AI resource index.
Time to first token
The time from sending a request until the first output token becomes available. It measures responsiveness for streaming language models.
By Mega AI Hub Editorial · Compute & hosting