Calling things modern that are updates to techniques to use technologies only invented a few years ago is borderline illiterate. Modern vs what, classical LLM sampling?
That’s exactly what this article is describing. There’s been a lot of development in this space over the last seven years or so, and e.g. GPT 1, 2, and 3 are certainly very outdated at this point, i.e. not modern in the above sense.
LLM are way older. The Nobel prize for it shows how they made many of the breakthroughs decades ago
ChatGTP was the popular breakthrough.
Even then your Smartphone keyboard has been using an LLM for a decade.
