When OpenAI co-founder and CEO Sam Altman speaks these days, it makes sense to listen. His latest venture has been on everyone’s lips since the release of GPT-4 and ChatGPT, one of the most sophisticated large language model-based interface created to date. But Altman takes a deliberate and humble approach, and doesn’t necessarily believe that when it comes to large language models, that bigger is always going to be better.
Altman, who was interviewed over Zoom at the Imagination in Action event at MIT yesterday believes we are approaching the limits of LLM size for size’s sake. “I think we’re at the end of the era where it’s gonna be these giant models, and we’ll make them better in other ways,” Altman said.
He sees size as a false measurement of model quality and compares it …
