ToC of Course 4/5: Evaluations of AI Applications in Healthcare
#
Module 1: AI in Healthcare
#
- Learning Objectives
- Common Definitions
- Overview
- Why AI is needed in Healthcare
- Examples of AI in Healthcare
- Growth of AI in Healthcare
- Questions Answered by AI
- AI Output
- Think beyond area under the curve
Module 2: Evaluations of AI in Healthcare
#
- Learning Objectives
- Recap: Framework
- Stakeholders
- Clinical Utility
- Outcome: Action Pairing, An Overview
- Lead Time
- Type of Action
- OAP Examples
- Number Needed to Treat
- Net Benefits
- Decision Curves
- Feasibility overview
- Implementation Costs
- Clinical Evaluation and Uptake
- Summary
Module 3: AI Deployment
#
- Learning Objectives
- The Problem
- Practical Questions Prior to Deployment
- Deployment Pathway
- Design and Development
- Stakeholder Involvement
- Data Type and Sources
- Settings
- In Silico Evaluation
- Net Utility & Work Capacity
- Statistical Validity
- Care Integration, Silent Mode
- Clinical Integration, Considerations
- Technical Integration
- Deployment Modalities
- Continuous Monitoring and Maintenance
- Challenges of Deployment
- Sepsis Example
- Summary
Module 4: Downstream Evaluations of AI in Healthcare: Bias and Fairness
#
- Learning Objectives
- Real World Examples of AI Bias
- Introduction - Types of Bias
- Historical Bias
- Representation Bias
- Measurement Bias
- Aggregation Bias
- Evaluation Bias
- Deployment Bias
- What is algorithmic Fairness
- Anti-classification
- Parity Classification
- Calibration
- Applying Fairness Measures
- Lack of Transparency
- Minimal Reporting Standards
- Opportunities and Challenges
- Summary
Module 5: The Regulatory Environment for AI in Healthcare
#
- Learning Objectives
- The Problem
- International Definitions Used for Regulatory Purposes
- Definition Statement & Risk Framework
- Valid Clinical Association
- Analytical Evaluation
- Clinical Evaluation
- General Control
- de novo Notifications
- Software Modification
- TPLC
- Locked vs Adapted AI solutions
- Examples
- Non-Regulated Products
- EU Regulations
- Chinese Guidelines
- OMB Guidelines
- Summary
Module 7: AI and Medicine (Optional Content)
#
- Introduction: Navigating the Intersections of AI and Medicine
- Life Cycle of AI
- A Deep Dive into Historical and Societal Dimensions
- Race-Based Medicine and Race-Aware Approach
- Bias Mitigation Strategies
- Exploring Potentials and Ethical Quandaries
- Dismantling Race-Based Medicine
- Deploying AI into Healthcare Settings
- Conclusion