Hallucinations, or factually inaccurate responses, continue to plague large language models (LLMs). Models falter particularly when they are given more complex tasks and when users are looking for ...

PsyEval is a new benchmark that tests how large language models perform on mental health knowledge, diagnostic assessment, ...

LMEval also includes LMEvalboard, a visual dashboard that lets you view overall performance, analyze individual models, or compare multiple models. As mentioned, LMEval has been used to create the ...

DevRev, maker of the agentic AI product Computer, today announced Enterprise-Bench, an open, vendor-neutral benchmark for evaluating whether AI agents can operate in production enterprise environments ...

Simbian today announced the “AI SOC LLM Leaderboard,” a comprehensive benchmark to measure LLM performance in Security Operations Centers (SOCs). The new benchmark compares LLMs across a diverse range ...

AUSTIN, Texas & OSLO, Norway--(BUSINESS WIRE)--Cognite, the global leader in AI for industry, today announced the launch of the Cognite Atlas AI™ LLM & SLM Benchmark Report for Industrial Agents. The ...

OpenAI today detailed o3, its new flagship large language model for reasoning tasks. The model’s introduction caps off a 12-day product announcement series that started with the launch of a new ...

Modulate's enterprise transcription API combines leading speech recognition accuracy, production-ready streaming ...

After months of testing local LLMs, I found that productivity depends on tools, not just models.

Every AI model release inevitably includes charts touting how it outperformed its competitors in this benchmark test or that evaluation matrix. However, these benchmarks often test for general ...

I stopped chasing every new LLM release and finally built a local AI setup that works for me.