CARAT is the world's first independent benchmark for clinical AI accuracy, safety, sovereignty, clinician trust, consent, edit rate and data destruction. Because a wrong drug name in a note is not a software bug. It is a patient safety event.
Independent standard. Powered by MedTalk AI. Validated by clinical advisory board. August 2026 scores release.
Every ambient AI company claims accuracy. Every vendor promises safety. Every sales deck shows a time savings graph. But when a hospital CEO asks to see the hallucination rate, the clinical error data, or the sovereignty audit — the room goes quiet.
CARAT changes that. It is an open, independently validated benchmark that scores clinical AI platforms across four dimensions that actually determine whether a system is safe to deploy in a public health environment. No marketing language. No cherry picked numbers. Just the score.
"In healthcare, the question is never whether AI can save time. The question is whether it can be trusted with a life."
CARAT Clinical Advisory BoardSeven dimensions. Each one independently measurable. Together they define whether a clinical AI platform is genuinely ready for a public health environment — not just a private clinic demo.
The first independently scored ranking of ambient clinical AI platforms in the world. Scores are derived from published peer reviewed research, vendor disclosures, and real world deployment data. The first full scored release publishes August 2026.
| Platform | Accuracy | Safety | Sovereignty | Clinician Trust | Consent | Edit Rate | De-ID and Destruction | CARAT Score |
|---|---|---|---|---|---|---|---|---|
|
MedTalk AI
Gov Contracted
Canberra Health Services, Australia
|
Aug 26 | Aug 26 | Aug 26 | Aug 26 | Aug 26 | Aug 26 | Aug 26 | |
|
Nuance DAX
Pending
Microsoft, United States
|
— | — | — | — | — | — | — | |
|
Abridge
Pending
Abridge AI, United States
|
— | — | — | — | — | — | — | |
|
Suki
Pending
Suki AI, United States
|
— | — | — | — | — | — | — | |
|
Heidi Health
Pending
Heidi Health, Australia
|
— | — | — | — | — | — | — |
Scores are derived from published peer reviewed research, public vendor disclosures, and where available, real world deployment data. Vendors are invited to submit their own data for independent verification. Methodology published openly at CARATscore.org/methodology.
Every score is derived from a combination of standardised test scenarios, published research, and real world deployment data. No vendor pays for inclusion. No score is negotiated. The methodology is published openly so any researcher in the world can replicate it.
CARAT scores are validated by an international clinical advisory board of practising clinicians with direct experience deploying AI in live healthcare environments across multiple countries. Every board member is independent. No member is employed by or has a financial interest in any platform scored by CARAT.
Are you a practising clinician? We are building the most credible independent clinical AI advisory board in the world. If you have direct experience with AI documentation tools in a clinical setting and want to contribute to the global standard, we want to hear from you. Board members are not paid. They are credited. And they help shape the standard that every hospital procurement team will reference.
Express Your InterestWe are publicly inviting every ambient clinical AI company to submit their hallucination rate for independent verification. Publish your number or we will publish ours — and the contrast will speak for itself.
Follow the ChallengeWhether you are a clinician who wants to join the advisory board, a vendor who wants to submit your platform data, a journalist covering clinical AI, or a hospital procurement team with questions about the CARAT standard — there is a right door for you below.
Every platform in the CARAT leaderboard is invited to submit their own data for independent verification. Transparency is not a weakness. It is the only way to build trust.
hello@caratscore.org →We are recruiting independent practising clinicians from North America, Europe and Asia Pacific. No vendor ties. No payment. Just the most credible seat at the most important table in clinical AI right now.
hello@caratscore.org →The first CARAT scores publish August 2026. If you are a journalist, editor or producer covering clinical AI, health technology or patient safety and want early access or an embargo briefing, we would love to talk.
hello@caratscore.org →