What are the weaknesses of ChatGPT?
For some aspects, ChatGPT does not offer any reliability: He doesn't tell the truth. ChatGPT says what people want to hear from the information it has. He only knows a compartmentalized version of what people say about the real world, using that information to create compelling language to convey what he's learned. He can't count. I tried to replicate Jonas Degrave's simulation at Engraved using a more complicated calculation and got the wrong result. It correctly tries to multiply the two numbers from this Python command that it knows how to simulate, which is quite remarkable. However, he simply does not know how to count. He can't think. He often writes relevant descriptions and claims about what I asked of him and confidently misapplies them. He cannot reason; it is not a finite automaton (FSM). His false modesty is somewhat embarrassing. ChatGPT writes with aplomb and authority, but shyly tells you he's only ...