Researchers at Stanford University’s HAI Research Institute are advocating for the redesign of tests to better assess artificial intelligence (AI) skills. These researchers have discovered that AI capabilities have reached a level comparable to that of an average person in various tests. The annual reports published by the HAI Research Institute provide insights into different versions of AI and their capabilities.
The latest 500-page review, released in April, highlights that the best AI models are now competing with humans in various tasks, including image classification, language understanding, and everyday deduction based on visual cues. Significant advancements in AI capabilities have been observed particularly in the last decade, with notable progress seen in tests such as Stanford’s MATH test.
For instance, a recent test revealed that OpenAI’s artificial intelligence was able to solve 84.3% of math problems, a dramatic improvement from the 6.9% it could solve back in 2021. However, despite these impressive advancements, there are still challenges and limitations to be addressed, such as the tendency for large language models to make errors or “hallucinations.”
As advancements in AI continue to improve language models and image generation capabilities, researchers at Stanford University are now looking towards creating new tests that can not only better compare artificial intelligences but also pinpoint the areas where human skills still surpass those of artificial intelligence. The introduction of new models like GPT-5 is expected to further influence the development of these tests and shed light on the ongoing progress and challenges in the field of artificial intelligence.
