Running Out of Tokens

"We're running out of tokens. We need to figure out a way to generate synthetic data that's effective for pushing the frontier of intelligence in these models out." — Google DeepMind researcher