STAT+: OpenAI leaps into health care with AI benchmark to evaluate models
\n \t
\n
<\/BR>
\n
\n \t
\n
<\/BR><\/p>\n
OpenAI on Monday released a large dataset for evaluating how well large language models answer questions related to health care. Experts lauded the open-source data and detailed evaluation rubrics, calling them \u201cunprecedented\u201d in scale and breadth. <\/p>\n
The project, HealthBench<\/a>, marks OpenAI\u2019s first foray into health care applications of AI, outside of external partnerships<\/a>.<\/p>\n \u201cOur mission as OpenAI is to ensure AGI is beneficial to humanity,\u201d said Karan Singhal, who leads OpenAI\u2019s health AI team, referring to OpenAI\u2019s goal of developing artificial general intelligence. \u201cOne part of that is building and deploying technology. Another part of it is ensuring that positive applications like health care have a place to flourish and that we do the right work to ensure that the models are safe and reliable in these settings,\u201d he said.<\/p>\n Continue to STAT+ to read the full story\u2026<\/a><\/p>\n<\/div>\n