Discussion about this post

User's avatar
Michael G Wagner's avatar

People can complain what the want, but I learned more about English grammar in the last few months than in the 57 years before. I never knew em-dashes existed, but now that I know, I really like them. :)

Expand full comment
Alejandro Piad Morffis's avatar

Very good insights, Nick. Especially the ones about training objectives and reward, I hadn't thought of how this kind of human supervision can embed very subtle biases.

I'm lately becoming interested in seeing LLMs more and more as objects of study in themselves, as a kind of dynamic corpora that can be poked to understand how language is used throughout different contexts. Especially smaller LLMs trained on regional or historical variants of languages.

What do you think about this? Is there something useful to learn about language itself by analyzing LLMs?

Expand full comment
9 more comments...

No posts