Estimates and errors
Hardware specifications, model information, memory calculations, context assumptions, task-fit inputs and performance estimates may be incomplete, outdated or wrong. Real results vary with drivers, inference software, quantization, context length, operating system, CPU, GPU, memory configuration and other settings.
Purchases and decisions
Do not rely on this tool alone when buying hardware or making another significant decision. Check current specifications, independent benchmarks and the requirements of the runtime and model you plan to use.
Model licences and third parties
Models and third-party services have their own licences, acceptable-use terms and privacy practices. A model appearing in this tool is not a statement that it is suitable or licensed for your intended use. Check the publisher's current terms.
No affiliation
Product and model names belong to their respective owners. Their appearance is for identification and comparison and does not imply sponsorship or endorsement.