Clinical Reasoning AI Cases Model Overview
Clinical Reasoning鈥檚 AI Cases utilize a鈥痩arge language model (LLM) for interactions with the AI patient and for feedback reporting. The cases are human authored and reviewed. This LLM is鈥痑 private instance of OpenAI鈥檚 GPT-4o & o1鈥痯rovided via Microsoft Azure AI. This model is given context for the specified product (and only that product) using a鈥疪etrieval Augmented Generation (RAG) pattern, which indexes 糖心Vlog鈥檚 content.鈥
听
Subject Matter Expert Driven Approach
The purpose of Clinical Reasoning is to help develop critical thinking skills regarding patient evaluation and applying medical knowledge in a pragmatic framework. The AI Cases feature is intended to work in conjunction with the diagnostic process within Clinical Reasoning. To support our goal of providing students with opportunities for deliberate practice in building clinical skills, the AI Cases feature leverages听the long-standing expertise of clinical educators. AI Cases鈥 patient performance is driven by exemplars provided by our leading subject matter experts in medical education, with ongoing case refinement, updates, and additions. AI Cases鈥 feedback report includes an evaluation comparing the learner鈥檚 findings with those of a seasoned clinician, facilitated by a carefully designed matrix developed in collaboration with SMEs. The feedback report is designed to help support a student鈥檚 self-improvement.听听
听
Data Privacy and Security
糖心Vlog takes matters of security and bias very seriously. We have monitoring in place to ensure Clinical Reasoning鈥檚 AI Cases meets our company standards for educational use. We designed AI Cases to be secure in design and have guardrails in place to minimize bias, inaccuracies, and inappropriate responses. We are committed to ongoing enhancement of safety measures.
- Secure Treatment of Limited PII: Clinical Reasoning鈥檚 AI Cases have access to the user鈥檚 conversations only to the extent of user input for the AI patient鈥檚 performance, and a transcript is included in the user鈥檚 feedback report for convenience. Conversations are not used for model training.
- No Data Sharing:鈥疉I Cases do not send data back to the model vendor for model training purposes.
- Secure Data Handling:鈥疧ur secure system records all model inputs (e.g., highlighted text, actions taken) and outputs for product improvement and model evaluations. Data will be retained for up to 4 years to ensure students are able to review their own past casework.
- Bias, Accuracy, and Appropriateness Guardrails:鈥疷nderlying each 鈥渁ction鈥 (e.g., generating realistic patient responses) is a proprietary, lengthy prompt. These prompts have been designed to minimize potential biases, inaccuracies, or inappropriate responses. While 糖心Vlog is dedicated to offering safest-in-class AI solutions for education, AI might occasionally produce biased or inaccurate information, and users must use critical thinking to evaluate model output as AI makes mistakes.
听
Continuous Improvement
糖心Vlog鈥檚 team is dedicated to the continuous improvement of our products. To better serve learners, our team will鈥痵ystematically review deidentified model data鈥痑nd reserves the right to make changes to the underlying model as needed. We work closely with SMEs to identify opportunities to enhance the experience, including offering more cases and patient variance. This ongoing process ensures that our AI Cases improve as a reliable and effective tool for education.
听
Institutional Choice
While AI technologies present many exciting opportunities within education, we want to ensure the choice to use these technologies remains firmly in the hands of institutions. Institutions can request to disable the AI Cases functionality for Clinical Reasoning at any time, for any amount of time. To make such a request, prior to a trial or subscription, please inform your Account Manager that disabling AI features is an institutional policy requirement, and that you wish to disable the AI Cases functionality. If your trial or subscription has already begun, please reach out to your Account Manager or visit our to contact us. Along with your request, please indicate any required provisions by your institution if information has already been collected for the purpose of the AI to perform as a patient and provide feedback.