The latest Mindscape podcast (1hr 41min and somewhat technical) does a great job at capturing what an #LLM does and doesn't do.
Worth it, if you have the interest: https://www.preposterousuniverse.com/podcast/2024/06/24/280-francois-chollet-on-deep-learning-and-the-meaning-of-intelligence/
My notes, if you don't have the time: https://r.dallaway.com/posts/llms-look-up-and-interpolate-programs-they-don-t-reason