MLCommons today released AILuminate, a new benchmark test for evaluating the safety of large language models. Launched in 2020, MLCommons is an industry consortium backed by several dozen tech firms.

Claude Opus 4.6 and Gemini 3.1 Pro across 100 expert-level questions infinance, law, medicine and technology, with no ...

A Caltech Lab at PrismML Just Fit an 8 Billion Parameter AI Model Into 1.15 GB. Announcing a Breakthrough in AI Compression: ...

According to the study, current testing being done for AI and LLM’s work by assigning scores to its results. These results ...

With the surprise release of their new "Harrier" family of embedding models, Microsoft is making a massive play for the ...

PrismML's approach is based on work done by Caltech electrical engineering professor Babak Hassibi and colleagues. The ...

Every AI model release inevitably includes charts touting how it outperformed its competitors in this benchmark test or that evaluation matrix. However, these benchmarks often test for general ...

A new large language model, Qehwa, has been developed by Junaid Ahmed, in a solo effort, to serve more than 60 million Pashto ...

Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources. Soroosh Khodami discusses why we aren't ready ...

AI models code simple games, but struggle to play them ...