The Center for AI Safety (CAIS) and Scale AI have launched an ambitious project called “Humanity’s Last Exam.” The goal is to create a 1,000-question quiz that will test the limits of artificial intelligence (AI) and determine if it can reach human-level expertise. Dan Hendrycks, the director of CAIS, said that current academic tests are not enough to measure the abilities of modern AI systems. While AI can do well on these tests, it still has trouble with tasks that need advanced planning or abstract thinking.
Experts from around the world are being asked to submit questions for the quiz. The questions will be reviewed by other experts. Contributors can earn up to $5,000 in prizes for the best submissions.
However, no questions related to weapons will be allowed due to safety concerns.
Experts invited to submit AI questions
Alexandr Wang, the CEO of Scale AI, stressed the importance of these tests keeping up with AI advancements.
Both specialists and the general public are invited to help create this ultimate test. If you have a lot of experience in a technical field or have a PhD, you are welcome to submit a question. This is a chance to participate in a groundbreaking project that will challenge AI’s capabilities.
The initiative aims to design tests that can accurately measure AI’s abilities in complex, high-level areas. The goal is to find out if AI can truly achieve human-level expertise. As AI continues to advance rapidly, it is crucial to have tests that can properly assess its capabilities and limitations.
Rashan is a seasoned technology journalist and visionary leader serving as the Editor-in-Chief of DevX.com, a leading online publication focused on software development, programming languages, and emerging technologies. With his deep expertise in the tech industry and her passion for empowering developers, Rashan has transformed DevX.com into a vibrant hub of knowledge and innovation. Reach out to Rashan at [email protected]
