Accuracy and Calibration of Evidence-Grounded Biomedical Signal Extraction From Free-Text Symptom Descriptions: A Prospective Observational Registry Using the OpenGenome Automated Research Instrument
试验速览
- 阶段
- 不适用
- 状态
- 招募中
- 发起方
- 入组人数
- 1,000
- 试验地点
- 1
- 主要终点
- Internal signal-source concordance rate
研究概览
简要总结
This registry prospectively collects anonymized free-text symptom descriptions submitted voluntarily by adults through the OpenGenome platform at opengenome.bio. For each submission, the system retrieves real biomedical literature from PubMed and ClinicalTrials.gov in parallel, applies a constrained reasoning model operating under a strict output schema, and returns a structured biological signal report. The study evaluates the internal consistency of extracted signals, the calibration of confidence scores relative to dataset size and symptom specificity, and the distribution of biological signal categories across a large anonymous population. No intervention is assigned. No participant contact occurs. All data is anonymized at the point of collection.
详细描述
OpenGenome is a publicly accessible, anonymous research instrument that maps free-text symptom descriptions to structured biological signals grounded in primary biomedical literature. Upon submission, the platform dispatches parallel queries to PubMed via NCBI E-utilities and ClinicalTrials.gov v2 API, retrieving up to 16 real sources per submission. A reasoning model constrained by a strict schema extracts a primary biological signal, up to five secondary signals, a plain-language correlation explanation, a confidence score, and a signal strength score. All scores are integers on a 0 to 100 scale. Sources are included by PMID or NCT identifier and are directly linkable for independent verification. This registry will analyze aggregate anonymized outputs to characterize signal consistency, score calibration, and population-level signal distributions.
研究设计
- 研究类型
- Observational
- 观察模型
- Ecologic Or Community
- 时间视角
- Prospective
入排标准
- 年龄范围
- 18 Years 至 —（Adult, Older Adult）
- 性别
- All
- 接受健康志愿者
- 是
入选标准
- •Automated or programmatically generated submissions detected by rate limiting
- •Submissions containing no discernible symptom or health-related content
排除标准
- 未提供
研究组 & 干预措施
Voluntary Submitters
Adults aged 18 or older who voluntarily submit a free-text symptom description via the OpenGenome platform and receive a structured biological signal report. No intervention is assigned.
干预措施: OpenGenome AI Platform (Other)
结局指标
主要结局
Internal signal-source concordance rate
时间窗: At point of automated report generation, assessed continuously over 12 months
Proportion of primary signal claims in generated reports that are traceable to at least one retrieved PubMed or ClinicalTrials.gov source included in the same report
次要结局
未报告次要终点