Workshop 1 (York 13th-14th February 2017) : Widening Access to the Professions; experience from medical selection
Description: This event brought together experts to clarify the lessons learned from several decades of experience in attempting to widen access to under-represented groups in medicine. This included work on understanding how widening access may be conceptualised and implemented within a global context.
The following talks were presented :
- ‘DREAMing big…’: Welcome and introduction, Paul Tiffin, University of York
- Widening access to the professions: potential benefits and challenges, Paul Tiffin, University of York Developing-and-researching-the-economics-and-mathematics-of-selection (PDF , 1,975kb)
- Markers of Widening Access status and undergraduate performance in UK medical students, Jen Cleland, University of Aberdeen Markers-widening-access-status-undergraduate-performance-in-UK-medical-students (PDF , 2,110kb)
- The potential benefits of Widening Access to medicine- the Australian experience, Annette Mercer, University of Western Australia Potential-benefits-widening-access-to-medicine (PDF , 589kb)
- Widening Access in Selection: A Look at GMA, SJT & HDI, Anton Botha, United Nations Widening-access-in-selection (PDF , 715kb)
- Widening Access: Perspectives from the Teaching Profession, Rob Klassen & Lisa Kim, University of York Widening-access-perspectives-from-teaching-profession (PDF , 4,611kb)
- Breaking the class ceiling: can situational judgement testing support widening access to the professions? Fiona Patterson, Work Psychology Group Breaking-the-class-ceiling (PDF , 2,276kb)
- Workforce selection- economic perspectives, Martin Chalkley & Idaira Rodríguez Santana, University of York Workforce-selection-economic-perspectives (PDF , 115kb)
- Use of contextual data in selection: secondary school level performance and undergraduate outcomes in UK medical students, Lazaro M. Mwandigha, University of York Should-offers-to-widening-participation-applicants-be-discounted (PDF , 510kb)
- Fitness to Practice events in undergraduate medical students: Early findings from the UK Medical Education Database, Lewis Paton, University of York
Workshop 2 (Sydney 24th-25th July 2017): Situational Judgment Tests (SJTs); optimising design and role in selection
Description: SJTs present a series of scenarios that challenge professional judgment and related questions for a candidate to respond to (e.g. the best action must be selected). SJTs are being increasingly used in high stakes selection situations. They also show potential as a tool for widening access and for evaluating and improving cultural competence. However, there is currently no consensus on how the tests should be best designed, scored and used in selection.
The following talks were presented:
- Design of SJTs for measuring Emotional Intelligence, Carolyn MacCann, The University of Sydney (DREAMS2_MacCann (PDF , 1,157kb)
- Developing an SJT for medical selection at the University of Cape Town (Faculty of Health Sciences) to predict an expanded criterion domain: Charting a course and ‘setting the sails’ Francois De Kock, University of Cape Town (DREAMS2_deKock (PDF , 1,945kb)
- Design of CJTs for in course assessment, Narelle Shadbolt and Chris Roberts, Sydney Medical School (DREAMS2_Shadbolt_Roberts (PDF , 1,160kb)
- Design and use of video stimulus for selection testing, Kelly Dore, McMaster University
- Overview of principles and practice of IRT, Paul Tiffin and Lewis Paton, University of York
- Impact of scoring systems on SJT reliability and impact on candidate selection, Wendy de Leng, Erasmus MC (DREAMS2_deLeng (PDF , 1,298kb)
- IRT for modelling SJT responses, Paul Tiffin, University of York
- Optimising SJTs in practice for staff selection, Ceylan Cizmeli, United Nations
- Development and implementation of SJTs for health sciences selection – preliminary findings and current challenges, Margaret Hay, Monash University (DREAMS2_Hay (PDF , 1,955kb)
- Modelling of SJTs for medical school selection and measuring in course professional development, Deborah O’Mara and Imogene Rothnie, Sydney Medical School (DREAMS2_OMara_Rothnie (PDF , 1,016kb)
Workshop 3 (York 4th-5th December 2017): The economics of workforce selection
Description: This event brought together methodologists from health economics, workforce scientists and educationalists to clarify the main direct and indirect costs and benefits in healthcare selection and develop and extend frameworks for evaluating these
The following talks were presented:
- Gender and productivity in medicine, Karen Bloor (DREAMS3_Bloor (PDF , 2,239kb)
- Thinking about selection and productivity, Adrian Castelli (DREAMS3_Castelli (PDF , 1,470kb)
- Selection as an optimisation problem: the pareto-optimal model, Lazaro Mwandigha (DREAMS3_Chalkley_IRS (PDF , 1,455kb)
- The economic benefits of selecting good teachers, Rob Klassen and Lisa Kim (DREAMS3_Klassen_Kim (PDF , 8,505kb)
- Choice of medical specialty and demographics – economic implications, Martin Chalkley and Idaira Rodriguez Santana (DREAMS3_Chalkley_IRS (PDF , 1,455kb)
- The footprint of medical revalidation, Nils Gutacker
- Regulation as selection: The potential costs and benefits of registering overseas doctors to practise in the UK, Amelia Kehoe (DREAMS3_Kehoe (PDF , 835kb)
- Ghent University/University of York (Lazaro Mwakesi): Develop an understanding and extend of pareto-optimal models of selection.
- University of Leeds/University of York (Lewis Paton): Develop further methodological expertise in numerical simulation.
- United Nations/University of York (Charlotte Renwick): Develop conceptualisation of the economic and social impact of selection approaches within the context of low and middle income countries.
- University of York/University of Sydney (Indako Clarke): understand approaches to managing and analysing big data relating to selection and consider how certain undesirable traits (e.g. self-handicapping and narcissism) could be identified using SJTs at selection.
- University of Western Australia/University of York (Paul Tiffin and Lewis Paton): collaborate on how medical selection measures such as the Undergraduate Medicine and Health Sciences Admission Test (UMAT) and Graduate Medical Sciences Admissions Test (GAMSAT) can be further developed and validated, feeding into the revisions and online implementation planned by 2019.
- University of Sydney/University of York (Paul Tiffin and Lewis Paton): explore the further development of SJTs within Australian medical selection, specifically considering how the measurement of additional concepts such as emotional intelligence can be incorporated.