Course Agenda

Day One

08:30	Registration and refreshments
09:00	Model Risk Management & Governance Definitions of models and model risk Model types and model approaches Sources and key drivers of model risk Evolution of model risk management OSFI guidelines and other regulations on model risk management Model governance framework including three lines of defence Coverage of model workflows including model interconnectivity *Speaker:* *Yaping Jiang, Managing Director, JW Matrix*
10:30	Morning break
11:00	How to Build a Model Risk Management Framework Development, quantification, integration, implementation Setting risk appetite, policy & standards for model risk Model inventory process Model lifecycle management (development, validation, implementation, use, periodic review) Estimating capacity for risk Speaker: *Olga Streltchenko, Director, Export Development Canada*
12:30	Lunch
1:30	Model Validation & Performance Analysis What is validation? Improving the models Validation tools Performance analysis review How to quantify model limitations Vendor and third-party model validation
3:00	Afternoon Break
3:30	Model Risk Management for Pricing Models Best approach to pricing models Products in balance sheet Market of products vs. pricing and hedging Source of valuation adjustments in pricing Identification and mitigation of model and input risk Establishing pricing and validation framework
5:00	End of day one

Day Two - Thursday, 26 September

08:30	Refreshments
09:00	Model Risk Management of Non-Pricing Models Retail models (credit scoping/marketing) IFRS 9 overview & progress since implementation The similarities and difference of CECL compared to IFRS 9 and other regulatory credit models Sources of model risk in IFRS 9 models What new strategies need to be put in place for testing IFRS 9 models and assumptions? Speaker: Grigoris Karakoulas, President and Founder, InfoAgora Inc.
10:30	Morning break
11:00	Utilizing Machine Learning for Model Validation and Monitoring of Valuation models Why banks need larger validation throughput and how to use AI to speedup Measuring data quality with ML Building AI challenger models for model risk uncertainty measurement Generating test scenarios with ML Solving PDE’s with deep reinforcement learning Validation with AI of market data generation algorithms (IR curve building, volatility surface construction) Monitoring valuation models with ML (PnL & XVA)
12:30	Lunch
1:30	A Deep Dive into Validation of Natural Language Processing Models Statistical foundations of NLP and implications for model risk governance Use case: word embeddings and recurrent neural networks Validation techniques for models with text input Responsible AI: fairness and interpretability Applications of recent advances in Machine Learning for NLP validation Speakers: Greg Kirczenow, Senior Director - Model Risk Management, RBC Ali Fathi, Senior Manager AI Research, RBC
3:00	Afternoon Break
3.30	Model Risk into the Future Applying models to new challenges Data challenges Automation vs. human judgement Big data and advanced analytics Treatment and governance of near-models and non-models Future of regulation; possible futures Further evolution of models
5:00	End of Course

Course Agenda

Agenda

Model Risk Management - Toronto

Course Agenda

Day One

Registration and refreshments

Model Risk Management & Governance

Morning break

How to Build a Model Risk Management Framework

Lunch

Model Validation & Performance Analysis

Afternoon Break

Model Risk Management for Pricing Models

End of day one

Day Two - Thursday, 26 September

Refreshments

Model Risk Management of Non-Pricing Models

Morning break

Utilizing Machine Learning for Model Validation and Monitoring of Valuation models

Lunch

A Deep Dive into Validation of Natural Language Processing Models

Afternoon Break

Model Risk into the Future

End of Course