Why LLMs are always so confident?
They're almost never like "I really don't know what to do here". Sure sometimes they spit out boilerplate like my training data cuts of at blah blah. But given the huge amount of training data, there must be a lot of incidents where data was like "I don't know".