*2023 AMIA Artificial Intelligence Evaluation Showcase*

- Submission for Stage 3 https://tinyurl.com/aishowcase is now open. Submission deadline: *July 11, 2023.*

https://amia.org/education-events/amia-2023-artificial-intelligence-evaluati...

Regulators, researchers, and clinical practitioners have all been exploring how to best evaluate the different phases of the health AI deployment lifecycle. The American Medical Informatics Association (AMIA), the world's largest professional society for medical informaticists, has been actively helping the community identify new and flexible oversight mechanisms to ensure the safe, effective use of artificial intelligence (AI) applications in healthcare.

In the AMIA AI Evaluation Showcase Series, we aim to select and present the current use cases in the field and form a community to help build consensus around the best practice. The formed community and the curated best practice examples are expected to help strengthen the thought leadership position of the AMIA community in the industrial standard understanding and setting.

In Stage III, we invite submissions for projects to summarize the comprehensive evaluation of the Health AI implementation – from the Stage I results of technical model performance (including bias detection and mitigation) to the Stage II results of workflow/usability studies to new research results in Stage III that measure the impact of the AI implementation.

Authors should report on the impacts of the AI implementation based on the measures of their choice, e.g., clinical outcomes, patient-reported outcome measures (PROMs), patient-reported experience measures (PREMs), clinician experience and adoption measures, cost of care, healthcare quality, or other measures from health economic studies.

Those who did not submit for Stage I and Stage II but still wish to participate in Stage III should follow the Stage I and Stage II submission guideline to include the evaluation plan for all three stages and the result for all three stages. The best work will be considered for publication in *JAMIA Open* https://amia.org/news-publications/journals/jamia-open.

If your organization has AI/ML initiatives or departments, please help pass the CFP to your colleagues involved in those initiatives and departments. This year, we invite health AI researchers and practitioners in this area to join this community for more discussion. We want to start the conversations in the community and collect best practice examples. Your help in disseminating this CFP to them would be highly appreciated.

*Presentation at the AMIA Annual Symposium, November 11-15, 2023, New Orleans, LA*

*Submission Deadline: **July 11, 2023 *

*How to Participate?*

Visit: https://amia.org/education-events/amia-2023-artificial-intelligence-evaluati...

https://tinyurl.com/aishowcase

Email Co-Chairs:

Sabrina Hsueh, PhD, FAMIA pyhsueh@berkeley.edu

Li Zhou, MD, PhD, FACMI, FAMIA, FIAHSI LZHOU@bwh.harvard.edu