Discussion about this post

User's avatar
Kathleen Weber's avatar

Since LLMs are by definition based 100 percent on what is written down, they are gloriously ignorant of everything about the human condition that isn't written down.

Suppose an LLM were asked, “Will people like New Coke or Old Coke better?” If an LLM were conscious of its limitations, it would answer, "How on earth would I know?”

svengineer99's avatar

+1 for the replication crisis?

It could be interesting to ask a frontier LLM to scrutinize the Vivalt paper for any signs of 'Why Most Published Research Findings Are False' Ioannidis (2005) including LLM reward hacking.

10 more comments...

Ready for more?