One thing beyond debate is that the workings of GPT-4 and other powerful AI language models do not resemble the biology of brains or the processes of the human mind. The algorithms must be fed an absurd amount of training data—a significant portion of all the text on the internet—far more than a human needs to learn language skills. The “experience” that imbues GPT-4, and things built with it, with smarts is shoveled in wholesale rather than gained through interaction with the world and didactic dialog. And with no working memory, ChatGPT can maintain the thread of a conversation only by feeding itself the history of the conversation over again at each turn
Knight, W. (2023, April 18). Some Glimpse AGI in ChatGPT. Others Call It a Mirage. Wired. https://www.wired.com/story/chatgpt-agi-intelligence/