FeTS 2022 challenge<\/a> in which MedPerf took part, took place across 32 participating sites on six continents.\u00a0<\/p>\n“Furthermore, MedPerf was validated through a series of pilot studies with academic groups involved in multi-institutional collaborations for the purposes of research and development of medical AI models,” the authors said.<\/p>\n
MedPerf expects it will expand the platform to many more participants, declaring, “We are currently working on general purpose evaluation of healthcare AI through larger collaborations.”<\/p>\n
The paper describes MedPerf as being now past an initial “proof-of-concept” stage, and in the midst of a transition from an alpha to a beta stage. Next steps include opening up the benchmarking task generally to outside participants.<\/p>\n
Also:\u00a0<\/strong>Generative AI could lower drug prices. Here's how<\/strong><\/p>\nPart of the paper is a call for parties in medicine to step up and contribute, including “healthcare stakeholders to form benchmark committees that define specifications and oversee analyses,” and “Data owners (for example, healthcare organizations, clinicians) to register their data in the platform (no data sharing required).”<\/p>\n
Code for MedPerf is posted on GitHub.<\/a><\/p>\n<\/div>\n