Scaling and reasoning: What is the future of language models?

In a detailed statement to the Science Media Centre (SMC) Germany, TU professor Kristian Kersting gave his view on the question ‘Scaling and reasoning: what next for language models?’

In his statement, Kersting analyses, among other things, the architecture underlying Deep Seek and provides an assessment of Open AI o3. He also takes a look at the direction research is likely to take in order to further develop large language models (LLMs).

More can be found here.