Quotessence
Home / Topics / Information Theory Quotes

Information Theory Quotes

Browse 3 quotes about Information Theory.

Information Theory Quotes

“Confabulation, or hallucination, is ubiquitous in AI/GPT output already. Efforts to correct this by self-learning algos and back propagation are unlikely to solve the problem because they add to the complexity of the system as a whole, which increases the likelihood of emergent ghosts. The difficulty is that duplicity is hard to detect unless you're a subject matter expert in the topic or you conduct your own research to test its accuracy. This begs the question — if you have to be a subject matter expert to spot the flaws in AI/GPT output, what good is the system in the first place?”

“When you are famous it is hard to work on small problems. This is what did Shannon in. After information theory, what do you do for an encore? The great scientists often make this error. They fail to continue to plant the little acorns from which the mighty oak trees grow. They try to get the big thing right off. And that isn't the way things go. So that is another reason why you find that when you get early recognition it seems to sterilize you.”