跳至主要内容
临床试验/NCT07597499
NCT07597499已完成不适用

ANCHOR (Auditable Navigation of Clinical Hazards With Oversight and Reasoning) Multicenter Randomized Validation Study: A Pragmatic Three-Arm (1:1:1) Patient-Level Randomized Controlled Trial of a Structural Verification Layer for AI-Assisted High-Risk Multidisciplinary Care Across Three U.S. States

Waymark1 个研究点 分布在 1 个国家目标入组 240 人开始时间: 2026年5月15日最近更新:
适应症
干预措施

试验速览

阶段
不适用
状态
已完成
发起方
入组人数
240
试验地点
1
主要终点
Per-encounter clinical safety failure (adjudicated binary composite)

研究概览

简要总结

This pre-registered, pragmatic, three-arm (1:1:1) patient-level randomized controlled trial with mixed-effects analysis at the encounter level tests two questions in real high-risk multidisciplinary clinical encounters at the Waymark clinically integrated network across three U.S. states (Ohio, Washington, Virginia): (1) does adding ANCHOR - a clinical AI structural verification layer - to a Gemini 3.1 Pro-assisted supervising-physician workflow reduce the rate of clinically meaningful safety failures, compared with the same Gemini 3.1 Pro-assisted workflow without ANCHOR? (2) does the Gemini 3.1 Pro-assisted workflow itself reduce the same safety endpoint compared with unassisted standard care in which the supervising physician writes their own SOAP assessment/plan from a blank template?

ANCHOR is a single-call structural verification layer combining a Logical Neural Network (Riegel et al. 2020) certificate, six specialist agents, and concept-decomposed output with PMID citation provenance. ANCHOR is physician-facing only and is used by supervising physicians, not by the multidisciplinary clinical team they oversee.

The trial randomizes 240 patients 1:1:1 across the Waymark clinically integrated network over a 12-week active-enrolment window (80 per arm). Eligible patients are adults (age 18+) identified as high-risk by combined claims-based and clinical criteria. Eligible encounters span three integrated Waymark service modalities: high-risk primary care, specialty care coordination, and real-time telemedicine urgent care. The primary endpoint is a per-encounter binary composite: any of (a) failure to mention a do-not-miss diagnosis, (b) under-triage, (c) contraindicated medication recommendation, (d) failure to recommend escalation when clinically warranted; adjudicated by a blinded panel of 3 board-certified physicians with majority-of-three scoring. The primary contrast is Arm 3 (LLM+ANCHOR) versus Arm 2 (LLM with safety prompt), isolating ANCHOR's marginal contribution over a deployment-equivalent LLM safety stack. The pre-specified secondary contrast is Arm 2 versus Arm 1.

The trial is sized to the operational ceiling of the Waymark integrated-network workflow across the three states (240 enrollees over 12 weeks). At realistic effect sizes derived from the retrospective evaluation, the trial is underpowered for definitive efficacy declaration on either pairwise contrast and is reported as an initial deployment-feasibility validation cohort with effect estimates and 95 percent confidence intervals; full power calculations are pre-registered in the Statistical Analysis Plan.

Single-blind outcome adjudication: 3 adjudicators score only the supervising physician's final clinical decision, so all three arms produce adjudication packets in identical format and arm allocation is structurally invisible. Statisticians remain blinded until database lock. A full waiver of informed consent is requested per 45 CFR 46.116(f)(3) with a companion HIPAA waiver of authorization under 45 CFR 164.512(i)(2)(ii). The study is registered on the Open Science Framework prior to first enrollment and reported under CONSORT-AI 2020.

详细描述

DESIGN. Pragmatic, multicenter, encounter-level, three-arm parallel randomized controlled trial. 1:1:1 patient-level stratified permuted-block randomization, block size 6, stratified by site and acuity stratum. Once a patient is randomized at first eligible encounter, all subsequent encounters for that patient remain in the same arm.

ARMS.

  • Arm 1 (Unassisted standard care, n=80): No LLM. No ANCHOR. The supervising physician opens a blank SOAP note template and writes their own assessment and plan from scratch.
  • Arm 2 (Gemini 3.1 Pro with safety prompt, n=80): Gemini 3.1 Pro generates the recommendation under a clinical-safety system prompt, content filters, and retrieval-augmented generation. The supervising physician reviews the LLM output directly. This stack is operationally equivalent to LLM-assisted clinical-decision-support deployments already in routine use at major U.S. health systems.
  • Arm 3 (Gemini 3.1 Pro + ANCHOR, n=80): Gemini 3.1 Pro generates the recommendation under the same safety prompt as Arm 2; ANCHOR augments that output with the Logical Neural Network certificate, specialist-agent verification, and concept-decomposed audit trail.

OPERATIONAL SIZING. The Waymark integrated-network workflow across Ohio, Washington, and Virginia captures approximately 20 eligible high-risk multidisciplinary encounters per week. With 12 weeks of active enrolment, total enrolment is 240 encounters (80 per arm at 1:1:1).

POWER CALCULATION. Anchored on the architectural-argument retrospective cohort. For each pairwise contrast at n=80 per arm, the plausible effect range is 5 to 11 percentage points absolute reduction (midpoint 8 percentage points). At the midpoint planning effect (Arm 2 event rate 25 percent versus Arm 3 17 percent), power is approximately 0.50 for the verification-layer-specific contrast (Arm 3 versus Arm 2) at alpha = 0.05. The trial functions as a calibration cohort with effect estimates and 95 percent confidence intervals.

研究设计

研究类型
Interventional
分配方式
Randomized
干预模型
Parallel
主要目的
Health Services Research
盲法
Single (Outcomes Assessor)

入排标准

年龄范围
18 Years 至 —(Adult, Older Adult)
性别
All
接受健康志愿者

入选标准

  • Age 18 years or older.
  • Attributed to a participating Waymark provider (academic medical center, community-hospital network, federally qualified health center, or independent physician practice in Ohio, Washington, or Virginia; full TIN-consolidated list deposited at the Open Science Framework).
  • Meets high-risk multidisciplinary criteria (combined claims-based and clinical: 2 or more emergency-department visits or 1 or more hospitalization in the prior 12 months, 5 or more active medications, 2 or more active specialist relationships, 2 or more chronic conditions, or claims-based equivalents).
  • Encounter occurs in one of the three Waymark service modalities: high-risk primary care, specialty care coordination, or real-time telemedicine urgent care.
  • English-language clinical documentation.
  • Encounter requires clinical reasoning (not administrative-only).

排除标准

  • Pediatric (age less than 18 years).
  • Hospice or palliative-care-exclusive care plan.
  • Active psychiatric crisis routed to crisis line.
  • Encounter is administrative only.
  • Pharmacy-only encounter that does not surface a clinical decision to the supervising physician.
  • Encounter where the supervising physician is the principal investigator.
  • Patient enrolled in a competing AI-safety study within the prior 90 days.

研究组 & 干预措施

Arm 1 - Unassisted standard care (control)

No Intervention

n=80. No LLM. No ANCHOR. The supervising physician opens a blank SOAP note template and writes their own assessment and plan from scratch based on the patient context and any prior chart review. Existing Waymark integrated-network multidisciplinary clinical-team support continues unchanged.

Arm 2 - Gemini 3.1 Pro with safety prompt (active comparator)

Active Comparator

n=80. Gemini 3.1 Pro generates the care-management recommendation under a clinical-safety system prompt, content filters, and retrieval-augmented generation. The supervising physician reviews the LLM output directly without ANCHOR augmentation. This stack is operationally equivalent to LLM-assisted clinical-decision-support deployments already in routine use at major U.S. health systems. Decision support only; the supervising physician retains all clinical decision authority.

干预措施: Gemini 3.1 Pro with Safety Prompt (Behavioral)

Arm 3 - Gemini 3.1 Pro + ANCHOR (intervention)

Experimental

n=80. Same Gemini 3.1 Pro generation as Arm 2, with ANCHOR additionally applied: a single-call structural verification layer (Logical Neural Network certificate over a 3,206-rule clinical logic library; six specialist agents - drug interaction, lab interpretation, guideline compliance, citation verification, safety net, differential-diagnosis breadth; concept-decomposed output with PMID provenance) augments the LLM output. Supervising physician reviews the ANCHOR-augmented output. Decision support only; clinician retains all clinical decision authority.

干预措施: ANCHOR Clinical AI Verification Layer (with Gemini 3.1 Pro) (Behavioral)

结局指标

主要结局

Per-encounter clinical safety failure (adjudicated binary composite)

时间窗: At the encounter (encounter-level outcome adjudicated within 4 weeks post-encounter)

Adjudicated binary composite of any of: (a) failure to mention a do-not-miss diagnosis appropriate for the presentation; (b) under-triage (routine/semi-urgent when emergent/urgent appropriate); (c) recommendation of a medication contraindicated by documented allergies/conditions/comorbidities; (d) failure to recommend escalation when clinically warranted. Adjudicated by a blinded panel of 3 board-certified physicians (Internal Medicine, Family Medicine, or Medicine-Pediatrics); final scoring by majority of three. Reported as proportion of encounters with composite safety failure.

次要结局

  • Appropriate triage escalation rate(At the encounter)
  • Time-to-physician-decision(Within the encounter (real-time))
  • 30-day emergency-department visit rate (exploratory)(30 days post-randomization)
  • 30-day hospitalization rate (exploratory)(30 days post-randomization)

研究者

发起方
Waymark
申办方类型
Industry
责任方
Principal Investigator
主要研究者

Sanjay Basu

Principal Investigator

Waymark

研究点 (1)

Loading locations...

相似试验