Replying to @⁨Wakko@hell.cloud⁩

The pace of advancement is still going strong, especially in math and “reasoning”. For example the frontier math benchmark is showing big strides for the frontier models. A year ago they were only getting <10% of questions, now sol from openai is scoring 89% and they’re reporting the unreleased astra is at 98% .

They even had to create a new frontier math benchmark called erdos that all previous models scored 0% on and astra got 3% , which may not look like much but is a huge relative jump.

Replying to @⁨Not_mikey@lemmy.dbzer0.com⁩

We use AI as an umbrella term for so many things. Literally the type of machine learning you’re talking about has been in use in science and mathematics for quite some time and unrelated to all this buzz. It is decidedly not what OpenAI, Anthropic and Meta’s product are. Those are LLMs friend. The promised harbinger of AGI via agenetic AI. So far, all it’s been is an embarrassingly expensive and destructive waste of resources.

en