Development of an AI-Agent for Diagnosis and Treatment of Urological Diseases
试验速览
- 阶段
- 不适用
- 状态
- 招募中
- 入组人数
- 2,000
- 试验地点
- 3
- 主要终点
- Diagnostic Accuracy of UroAgent
研究概览
简要总结
Urological diseases such as urinary stones, prostate cancer, and bladder cancer are very common and often require highly specialized diagnosis and treatment. Today, the quality of care can vary between doctors, and there are not enough urology specialists to meet patient demand. Artificial intelligence (AI) may help doctors make faster and more consistent decisions.
This study aims to develop and test an AI-powered assistant called "UroAgent" that supports doctors in diagnosing and treating urological diseases. UroAgent is built on a large language model trained specifically for urology and is connected to tools that help it retrieve medical knowledge and analyze images. To build and test UroAgent, the research team will use 1,500 past patient records from 2010-2025 and collect 500 new patient cases for validation, for a total of 2,000 cases. This is an observational study: no patient's medical treatment will be changed because of it. The goal is to create a reliable AI tool that helps improve urological care for patients.
详细描述
This study protocol describes an observational study aiming to develop and validate UroAgent, an artificial-intelligence agent for the diagnosis and treatment of urological diseases. A total of 2,000 urological disease cases will be collected, comprising 1,500 retrospective cases recorded at the center between 2010 and 2025 for model development and 500 prospectively enrolled cases for independent performance validation. The primary evaluation is the concordance between UroAgent's diagnostic and treatment recommendations and the reference standards established by senior urologists, assessed through diagnostic accuracy, recommendation appropriateness, completeness, and safety; secondary evaluations include the agent's performance across disease subtypes (urinary stones, prostate cancer, bladder cancer) and its image-interpretation capability. All records will undergo de-identification, and the study will adhere to rigorous ethical standards and a pre-specified statistical analysis plan to provide robust evidence for the clinical application of this urology-specific AI agent.
研究设计
- 研究类型
- Observational
- 观察模型
- Cohort
- 时间视角
- Other
入排标准
- 性别
- All
- 接受健康志愿者
- 否
入选标准
- •Diagnosed with a urological disease (e.g., urinary stones, prostate cancer, bladder cancer, and other urological conditions).
- •Availability of complete clinical information, imaging data, and surgical video required for model development and validation.
排除标准
- •1. Missing clinical information, imaging data, or surgical video.
结局指标
主要结局
Diagnostic Accuracy of UroAgent
时间窗: Retrospective cases - at data extraction (single time point); Prospective cases - at enrollment (single time point); no longitudinal follow-up.
The primary outcome is UroAgent's diagnostic accuracy, measured as the F1 score of its leading diagnosis against the reference-standard final diagnosis. The reference standard is established by senior urologists from pathology, imaging, and clinical course. F1 = 2 × Precision × Recall / (Precision + Recall), computed per case and aggregated as macro-F1 across the 2,000-case cohort (1,500 retrospective + 500 prospective). Unit of measure: F1 score (range 0-1).
次要结局
- Expert Subjective Accuracy Rating(Retrospective cases - at data extraction (single time point); Prospective cases - at enrollment (single time point); no longitudinal follow-up.)
- Treatment Recommendation Appropriateness of UroAgent(Retrospective cases - at data extraction (single time point); Prospective cases - at enrollment (single time point); no longitudinal follow-up.)
- Clinical Safety of UroAgent Recommendations(Retrospective cases - at data extraction (single time point); Prospective cases - at enrollment (single time point); no longitudinal follow-up.)
- Concordance and Non-Inferiority of UroAgent versus Clinician Diagnoses(Retrospective cases - at data extraction (single time point); Prospective cases - at enrollment (single time point); no longitudinal follow-up.)
研究者
Xu Kewei
Principal Investigator, Clinical Professor
Sun Yat-Sen Memorial Hospital of Sun Yat-Sen University
