Apple’s new study looks to improve the effectiveness of AI health tools
TL;DR
Apple announced a new study today with the goal of better understanding how people interact with conversational AI health tools and how useful their responses actually are. The company is conducting the Apple Health AI Usage Study in collaboration with OpenEvidence, a clinical AI platform used by healthcare professionals that generates answers based on medical information from sources like The New England Journal of Medicine.
Nauti's Take
For AI product teams, the study design is the important part: it evaluates answers to real health questions from ordinary users in real usage situations. Teams assessing similar tools should first test source coverage, errors in individual cases, and how sensitive health data is handled.
Apple has published no results or independent validation so far.