what is humanity's last exam

Humanity's Last Exam is a project launched by Scale AI and the Center for AI Safety (CAIS) to measure how close AI systems are to achieving expert-level capabilities. It aims to create the world's most difficult public AI benchmark by gathering questions from experts in various fields, with a prize pool of $500,000 for accepted contributions^[1][3].

The exam expects to challenge current AI models, as they have begun to outperform existing benchmarks, indicating a need for more rigorous testing methods. The questions target multiple domains, testing the models' reasoning capabilities against expert-level knowledge^[2][3].