We’ve Been Training LLMs Backwards

I’ll be honest…this MIT paper flipped a switch for me.

We’ve been treating large language models like they’re incapable of logic. “They’re just fancy autocomplete machines,” people say. But what if we’ve been looking at it the wrong way?

The breakthrough wasn’t in a bigger model. It wasn’t in throwing more data at the problem. It was in the teaching metho…