← Back to Vault

Provider Variation Surprise

Tom Spencer · Category: stories_and_anecdotes

Tom was surprised to discover up to 10% variation in benchmark outcomes for the same open-source model across different inference providers.