Home Article
International Journal of Healthcare Simulation
image
Exploring accessible, inclusive and sustainable simulation-based education in remote and rural communities: a realist review
DOI:10.54531/porh1951, Pages: 1-14
Article Type: Original Research, Article History
Abstract

Introduction

Access to and inclusion in simulation-based education (SBE) for remote and rural (RR) healthcare practitioners, irrespective of geographic setting, professional background and workplace context, is challenging. This challenge is compounded because simulation in healthcare education is acknowledged as a complex intervention, and healthcare systems are in and of themselves complex.

Methods

A realist review of published and grey literature was conducted, seeking to identify programme theories and to explore what works, how and why, in respect of mobile and distance SBE for healthcare practitioners in RR and harder-to-reach communities.

Results

There is limited rigorous research in this field. Mobile and distance simulation programmes exist in physical, digital and hybrid forms. This makes simulation more accessible and inclusive for RR healthcare professionals in respect of facilitating simulation. It allows for clinical and simulation centres of expertise to collaborate with harder-to-reach communities enabling the contextualizing of learning with, from and about the needs of a target population. However, the challenges of implementing and sustaining mobile and distance simulation interventions are underexplored.

Discussion

Mobile and distance programmes of SBE are introduced into and are subject to dynamic and heterogeneous social contexts. The intended outcomes of such programmes are dependent on building relationships, trust and networks between geographically distanced communities of practice. These social connections are the key mechanisms which support accessibility, inclusivity and sustainability. Further explorations of mobile and distance simulation innovations are critical to building capacity, sustainable solutions and enhancing future use.

Somerville, Howden, Ker, and Schofield: Exploring accessible, inclusive and sustainable simulation-based education in remote and rural communities: a realist review

What this study adds

  • It contributes valuable knowledge to a growing interest in mobile and distance simulation modalities.
  • It offers evidence to advance the scholarly conversations and practice of the Healthcare Distance Simulation Collaborative.
  • It responds to calls for research which adopts theory, innovative methodologies and methods to study simulation-based education.
  • It adopts a novel, realist, theory-driven approach to conducting a literature review exploring simulation-based education programmes.
  • It acknowledges and advances our understanding of complexity in relation to the implementation of simulation interventions.

Introduction

Implementing simulation-based education (SBE) programmes can be complex [1,2] requiring careful attention to organizational contexts [3,4]. An exponential increase in SBE publications and empirical evidence advocates its benefits [5], yet few publications have focussed on exploring or explaining the implementation of SBE interventions in general, and far less in remote and rural (RR) healthcare communities. This research explored a simulation programme implemented in RR Scotland where, in common with other countries worldwide, there is inequity of access to SBE for healthcare professionals across geographical and professional boundaries [6,7].

Although Scotland is a small country, its population and healthcare workforce are unevenly distributed, geographically disadvantaging the highlands, islands and mainland RR communities [8]. The geographic distinctions of no bypass hospitals, remote, isolated and single practitioner islands convey the nuances of the challenges experienced with the provision of infrastructures and services for those living in and practising healthcare within these communities [8]. These challenges extend to healthcare education for staff where there is considerable variation in equity of access to clinical skills training, using SBE [7].

Simulation-based education

SBE is an embedded component of undergraduate, postgraduate and continuing professional education and training in healthcare professions curricula and workplaces worldwide [9]. The widespread adoption of simulation is underpinned by a growing body of published evidence affirming its benefits, supporting preparedness for practice, and improvements in patient safety and patient care [10]. However, the hegemony of SBE has emerged from hospital-based specialities, and bespoke simulation centres in academic or clinical locations [11]. Typically, SBE is adopted in strategic locations with geographic concentrations of simulation personnel, facilities and resources, which benefits convenience and cost for many and consolidates simulation faculty expertise and capacity [12]. However, many healthcare communities continue to face challenges connecting with and sustaining SBE initiatives [13,14]. This research explored an innovative programme aimed at addressing this challenge by implementing a mobile simulation facility, funded as part of a National Clinical Skills and Simulation Strategy by NHS Education for Scotland [15]. A key objective of this strategy was to provide high-quality SBE across geographical and professional boundaries. The Mobile Skills Unit (MSU) (Figure 1) was one element of the strategy and provides a peripatetic, versatile space for clinical and surgical skills education and simulation faculty development [7] and aims to promote accessible, inclusive and sustainable SBE for healthcare communities in RR Scotland [16].

The Mobile Skills Unit (photo courtesy of NHS Education for Scotland)
Figure 1:

The Mobile Skills Unit (photo courtesy of NHS Education for Scotland)

RR health professions education

Health and social care staff living in RR Scotland report feeling professionally and physically isolated from clinical colleagues and specialities and some services [17]. These challenges impact upon the retention and recruitment of staff across the diverse RR healthcare contexts and workforces of NHS Scotland [18,19]. These issues are not unique but echo a global challenge for health professions education in complex healthcare systems [20]. Initiatives to promote new ways of providing health and social care and improve access to continuing education include UK national strategies [21,22] and international Global Policy recommendations for RR workforce development [23].

In RR communities such as in Scotland there is an acceptance of healthcare role and skill diversity and resilience [19] to address the tyranny of distance , the challenge of delivering healthcare in remote communities by heterogeneous healthcare teams [24,25]. This includes providing services for acute and chronic healthcare conditions, and the infrequent but urgent need to assess, stabilize and manage a critically ill or injured patient with limited resource, knowledge or skills until transfer to a tertiary care centre is possible. Training for these high acuity and low occurrence (HALO) events [2628] typically means RR staff have to travel long distances. The time and cost of being away from home and work is inconvenient, but moreover may be prohibitive [25,29]. Recognizing these challenges, the National Clinical Skills and Simulation Strategy and the MSU were seen as proposed solutions to the ‘inequity of provision of high-quality clinical skills education using simulation’ affecting RR Scotland [7] (p.221).

However, Greenhalgh and Papoutsi argue that creative innovations which are designed to offer solutions and opportunities are complex to implement, with respect to their spread (replication) and scale-up (building infrastructure) [30]. This is particularly true in diverse social contexts such as in RR Scotland and other global contexts in which communities are harder to reach [2,31,32]. Therefore, this realist review was conducted as part of a longitudinal study and realist evaluation [33] and sought to explore the evidence base for SBE interventions targeting RR communities.

Methods

Realist methodological approaches to research are considered an appropriate theoretical lens when exploring the implementation of complex interventions within heterogeneous social contexts [34], and are advocated in health and social care and education research [3538]. Realist reviews are a theory-driven, literature review methodology seeking to explore how complex interventions function in complex environments, pursuing an explanatory rather than a judgemental approach to expressing research findings [39]. Searching the literature during a realist review is iterative, creative, non-linear and continuous [40,41]. Figure 2 illustrates a comparison of a realist with a systematic review [42].

Realist review compared to systematic review [42]
Figure 2:

Realist review compared to systematic review [42]

Realist reviews seek a very broad range of evidence sources, not exclusively the peer-reviewed literature [32,43]. This is because realist reviews propose and test programme theories , which are the assumptions that stakeholders proposition about how and why interventions will work in practice [44]. Therefore, programme theories are the underlying unit of analysis for realist research [45]. Whilst, materially, interventions are comprised of the resources, activities, services, equipment and personnel offered to communities, in the realist research world, these combined tangible elements are considered programme theories. The underpinning principle of realist philosophy assumes that ‘Nothing works unconditionally in all circumstances’ [46] (p.126). Therefore, realist reviews typically ask the questions – what works, why, how, for whom? They ask: in what respects and circumstances, do interventions generate intended or unintended outcomes when introduced into diverse social contexts? Realist research seeks to explain the underpinning causative mechanisms [47]. Exploring contexts, mechanisms and outcomes is fundamental to realist reviews and evaluations.

Realist reviews like other literature review methodologies are guided by quality standards. The Realist And Meta-narrative Evidence Syntheses: Evolving Standards (RAMESES ) Project Quality Standards [41] was funded by the UK National Institute of Health Research’s Health and Social Care Delivery Research Programme. The RAMESES projects produced the quality standards and training materials for realist review and evaluation and informed this realist review: https://www.ramesesproject.org/media/RS_qual_standards_researchers.pdf.

Literature review strategies in realist reviews

Booth et al. [48] assert that an explicit and transparent reporting of the search logic counters the tensions between the creative realist and rigid systematic review protocols and demonstrates rigour consistent with realist inquiry. The six steps of a realist search and synthesis proposed by Booth et al. [48] guided the search logic adopted in this review (Figure 3).

Steps of a realist search [48]
Figure 3:

Steps of a realist search [48]

Overview of the realist search and synthesis

The guiding search question (step 1 ) was formulated in consultation with stakeholders and in accordance with the RAMESES Quality Standards [41] who advocate stakeholders are key informants in decision-making about the focus of the research, we asked: What does the published evidence say about the phenomena of mobile SBE in RR healthcare? Step 2, a background search and scope of published literature was followed by a review of stakeholder documentation (step 3 ) to identify initial programme theories and captured tacit and historical insights from these key informants [49]. Next, an iterative search for empirical evidence (step 4) explored a wider conceptual framework of simulation literature and innovative programmes targeting harder-to-reach communities. Step 5 , the testing and refining of initial programme theories, was conducted as part of a realist evaluation with empirical data collection [33]. This step is not reported in this publication; instead, this realist review documents and reports the realist search and synthesis (step 6) of the published literature identified.

Ethical approval

Ethical approval was requested since this realist review involved stakeholder consultation and documentary analysis [38,41]. Ethical approval was granted by the University of Dundee Research Ethics Committee (UREC 16037).

Step 2 - The background search & scope of the literature

The initial search of databases included the NHS Knowledge Network, Medline (via the OVID interface) and Google Scholar, adopting recommendations to use a restricted range of generic sources at this stage [39,50]. Medical Subject Headings (MeSH) controlled language terms and Boolean operators were adopted, minimal restrictions were applied and the search looked at a 10-year period (2005–2015), the time during which the MSU was proposed, designed and launched. In consultation with a librarian colleague [51], the following search terms were adopted:

(TITLE-ABS-KEY (simulation OR simulation-based) AND TITLE-ABS-KEY (“mobile clinical skills” OR “mobile learning lab” OR “mobile unit” OR “static unit” OR “mobile simulation” OR “mobile training” OR “mobile skills unit” OR “mobile surgical skills”) AND TITLE-ABS-KEY (clinical OR healthcare OR medical OR hospital* OR health OR nursing) AND TITLE-ABS-KEY (education OR course* OR training OR trainers OR educator* OR delivery OR programmes* OR pilot OR programme*)

Evidence appraisal

Literature selection and appraisal were based on relevance (contribution to theory building) and rigour (data are credible and trustworthy), the key criteria by which literature is appraised in realist reviews [39,52,53]. Selection, appraisal and exclusion criteria were also guided by a Realist Review Appraisal Form from a publication by Jagosh et al. [54] to guide the identification of papers of relevance. Endnote reference management software was used for data extraction of published literature to organize citations, explore and analyse pdfs.

Results of the background search – step 2

After screening and appraisal nine resources describing approaches to address the SBE needs of RR communities were identified. Three pertained to the MSU of this study [5557]; however, one was excluded as this conference abstract proposed a qualitative research study which was not conducted. The remaining publications included an in-depth critique of an in situ intervention in the USA [58]; a descriptive report of a rural surgical bus in New Zealand providing education and mentorship to nursing and surgical staff remotely [59]; and a discussion of a UK-based clinical skills bus for undergraduate students [60]. A report for the World Organization of Family Doctors (WONCA) discussed case studies of clinical skills and SBE for RR practitioners, although it did not describe a mobile facility exclusively [25], and two papers reported surgical skills training specifically using mobile vehicles for simulation interventions [61,62].

Synthesis of the background realist search

Empirical research on mobile vehicles for simulation is lacking, and only one original research paper was identified amongst the eight reviewed, which were published between 2006 and 2014. The common focus of these mobile SBE publications was procedural skills acquisition, particularly HALO, acute and emergency skills and drills, and laparoscopic and minor surgical procedures. Learning opportunities were vaguely and varyingly described as facilitator-led and self-directed. The most frequently reported outcomes were learner satisfaction, and skills acquisition, which is typical of, but also a criticism of the quality and value of SBE publications [6365]. What these papers shared were largely positive descriptions of SBE interventions, based on the reflections of participants and authors. They discussed creative and innovative solutions for engaging with SBE on-site rather than in a fixed simulation centre, thus making simulation more accessible and inclusive for RR communities in respect of the physical and/or human resources which facilitate SBE. However, none of the papers added to the literature on the sustainability of these interventions.

The nine papers analysed varied in their richness of descriptions of contexts and mechanisms, supporting the outcomes of the SBE programmes they advocated. Longer term outcomes of the interventions in respect of enablers and barriers were difficult to discern as none of the papers took a longitudinal view of the innovations they described. Common motives were driven by needs assessments underpinning the training for HALO events. Expressions of forging social connections, collaborative partnerships and informal networks within and across healthcare organizations, created opportunities to facilitate and capitalize on shared educational and physical SBE resources.

Step 3 – Searching to identify programme theories

The search for programme theories (step 3) expanded on the background search to include programme documents via stakeholder consultation. These stakeholders were employees of NHS Education for Scotland, including the original architects of the MSU and staff responsible for its design, operationalization and facilitation of SBE. A large volume of programme documents included historic business plans, steering group meeting minutes, training needs analysis, annual reports, training records, course programmes and timetables, course feedback and evaluations from facilitators and participants and were shared in digital and paper formats.

During consultations, the social connections that were identified as causative mechanisms in the literature were also discussed and echoed by stakeholders who proposed that the MSU – works at the level of informal networks – and that supplying a mobile simulation vehicle alone was – a recipe for failure [66]. Seminal SBE publications have similarly asserted the fundamental need for simulation faculty development for specific educational and professional contexts [3,67,68] and argue that the inherent value of SBE is ‘unrealisable without skilled educators and technicians… and professional networks for simulation specialists’ [6] (p.5). The key mechanisms for implementing SBE interventions advocated by stakeholders are nurturing social connections alongside longitudinal faculty development to avoid a mere ‘train and hope’ [69] (p.6) approach to implementing SBE.

Stakeholder consultation and documentary analysis is recommended in realist reviews as a participatory way to identify authentic, contextually situated evidence [48]. Capturing the tacit knowledge and experiences of stakeholders narrowed and prioritized the focus of the study to three initial programme theories. These programme theories (Figure 4) are constructed as an if–then–because hypothesis, a realist research heuristic [49]. The reader may interpret this as – if we deliver a programme in this way (context) then this will bring about an improved outcome, because… (mechanism).

Initial programme theories (step 3)
Figure 4:

Initial programme theories (step 3)

Step 4 – Iterative searching for empirical evidence

Iterative strategies were employed to search for empirical evidence to test the programme theories proposed. This included additional database searches for published literature in Scopus, Web of Science and PubMed using the search terms above. In addition, search strategies included CLUSTER searching [70] (Citations; Lead author; Unpublished materials; Scholar searches; Theories; Early examples; Related projects), and ‘berry picking ; the foraging and browsing for information which is proximate to items of interest’ [48] (p.157). These complementary search strategies included exploring simulation journals for conference abstracts, library repositories for doctoral theses, ResearchGate for unpublished manuscripts, podcasts, webinars and Google for training courses or promotional materials. The rationale for this unconventional searching approach is advocated by the RAMESES Standards [39]. The purposive iterations of searching pursued titles and abstracts if they implied aspects of mobile or distance simulation, but not exclusively describing a mobile vehicle. Date restrictions were not applied during iterative searching; the oldest paper identified was from 2004 and the last was in 2020 when the search concluded.

Results of the iterative search – step 4

After screening and appraisal of publications and grey literature, three mobile simulation typologies and five simulation programmes were considered of relevance. The iterative searching identified publications which have in common the concepts of hub and spokes [71] and outreach [72], programmes seeking to make simulation accessible and inclusive to harder-to-reach communities. Whilst the initial focus of this research was an exploration of the MSU, a physical unit, this is an example of ‘a family of programmes’ [73] (p.25) of mobile and distance approaches to simulation. It is a fundamental aspect of a realist review to seek relevant literature which identifies programmes in diverse contexts, with variable outcomes so as to explore the reasons (the causative mechanisms) for what, how and why they work (or not). The iterative searching strategies and metaphorical zooming out and in [74] of the literature created the opportunity to illuminate and magnify [75] a body of evidence of contrasting simulation interventions, identifying key features, variables and relationships between heterogeneous simulation phenomena [67].

Synthesis of the iterative realist search

Defining mobile simulation

The term mobile simulation is defined by the Healthcare Simulation Dictionary as mobile in the digital sense, inferring simulations with minimal or no equipment, such as tabletop, or computerized modalities without manikins and in the portable sense, a physical simulator that can be moved, operatable with or without power cords or communication cables [76]. Mobile simulation enables access to SBE opportunities by removing or restricting distance-orientated barriers and generating point-of-care, in situ simulation (ISS) opportunities [77]. This may be in a transient environment such as a large mobile vehicle, or the use of mobile cart situated within or shared between institutions, or transport and delivery of part-task simulators [77].

Typologies of mobile simulation

Distributed simulation

Distributed simulation (DS) intends to create simulation opportunities which are on-site, real enough, near enough, flexible, practical and low cost. Kneebone et al. argue that the widespread adoption of SBE will not be realized unless innovative solutions acknowledge barriers to multi-professional access [11]. The original concept of DS used an inflatable tent-like surround, to represent an operating theatre, using local equipment, and images of a clinical space. This aimed to minimize the restrictions of access to fixed-site simulation centres, the organizational limitations of in situ opportunities and the predominance of medical speciality-focused simulation activities. DS has been validated in the UK in a tertiary hospital setting [78] and a district general hospital [79] however, no publications beyond these were identified describing DS. The evidence for DS confirms accessibility and inclusivity reducing barriers for some, but as a mobile simulation concept or terminology, the evidence of sustainability is limited.

In situ simulation

ISS is very widely reported as a learning event conducted in the real clinical environment [80]. ISS allows the participation in and observation of everyday or atypical activities and behaviours of healthcare professionals (HCPs) [81] to introduce, develop and test existing or new practices, procedures and systems [82] such as those rapidly introduced during the COVID-19 pandemic [83]. Examples of ISS demonstrate the effectiveness of SBE for improving patient outcomes through translational simulation [84], for example with multi-professional staff in obstetric departments, standardized educational materials and faculty development [8587]. However, the empirical evidence also reports that individual and team knowledge and skills can be learned equally well in ISS, on-site or fixed simulation centres, whereas organizational learning is most suited to ISS [85,8892]. The purpose of, rather than the setting for, simulation is key to achieving intended outcomes [88,93,94]. Aspects of ISS were restricted by COVID-19; however, publications emerged describing ISS in response to COVID-19, recognizing its value for individual, team and organizational learning, developing and refining new and safe approaches to clinical skills practices, and diagnosing human and organizational latent safety threats [83,95,96]. ISS is an established mobile simulation typology, giving rise to the use of simulation as the focus of and an instrument for researching organizational learning and sociocultural experiences [97,98]. The wealthy continuum of evidence and diversity of ISS supports the notions of making ISS accessible, inclusive and sustainable.

Telesimulation

Based on the concept of telemedicine, telesimulation, telefacilitation, telementoring and teledebriefing use digital and technological solutions to create social connections for remote participation in SBE [99]. Telecommunication and simulation resources used together provide largely synchronous education, training or assessment at distant locations with specialist clinicians or more experienced simulation faculty, supporting remote colleagues [27,99]. Telesimulation descriptions vary according to faculty–student ratios, types of simulation conducted and the degree of involvement of the facilitating versus remote site [100]. The literature describes applications of the use of telesimulation for procedural skills learning [101], surgical skills [102], scenario-based training [103,104], simulation-based assessment [13] and interprofessional education [99]. The use of both a physical mobile unit and telesimulation to deliver procedural skills training provided expert mentorship for simulation facilitators, overcoming barriers including cost and distance to delivering SBE in RR locations [27]. An experimental study taught and assessed approximately 70 medical students in the insertion of surgical chest drains using telesimulation for procedural skills simulation with expert mentorship, overcoming geographical barriers to SBE in RR communities [27]. Globally democratizing SBE through technology is a notion promoted by Ahmed [105] who reports digital and technology-based solutions including successful live streaming of both simulated and live surgery for educational purposes between centres of excellence and developing countries. As a modality, telesimulation has increasing currency as the simulation community expands and learns from responses to the pandemic and generates creative ways to facilitate access to simulation within physical centres and support communities constrained by access to and transport of simulation faculty and equipment [106108]. The pandemic has created an impetus to advance synchronous and asynchronous forms of flexible learning [109] increasing the potential for creating accessible, inclusive and sustainable formats of telesimulation.

Mobile simulation programmes

Community Outreach Mobile Education Training

The INSPIRE simulation network describes an innovation involving flying faculty from a North American centre of paediatric expertise commuting to regional community hospitals who have limited opportunities for SBE [110]. This simulation intervention known as the Community Outreach Mobile Education Training (COMET) programme embraces the three typologies of mobile (portable), distributive and ISS described above and was developed to enhance the confidence and skills of community-based staff in responding to HALO paediatric emergencies. It closely aligns with the aforementioned key mechanisms of creating meaningful community-based partnerships, facilitating the communication of best practice, and distributing up-to-date policies, education and training, providing opportunity for system testing at these community sites [110]. A particularly revealing causal insight expressed by the authors is that of a professional courtship [111] which has been key to relationship building and developing trust between the hub and spokes. The sharing of expert knowledge and nuances of specialist clinical management are combined with an appreciation of local contexts aimed towards an improved level of paediatric care in rural communities. The forging of interpersonal connections and mutual respect for colleagues is key to enhancing the translation of learning from simulation experiences to changes in clinical practice. Framing simulation courses as quality and safety initiatives over and above educational opportunities has been key to securing local buy-in and the sustainability of this programme. A notable outcome was an increase in patient referral patterns post simulation courses, attributed to the connections forged and increased awareness of the benefits of early contact with tertiary centres [110]. The COMET programme proposes a longer-term sustainability goal of upskilling locally based clinical staff as future faculty to support participation in and dissemination of the COMET programme enacted through a community of practice.

Neonatal Outreach Simulation Programme

A Neonatal Outreach Simulation (NOS) programme illustrates the notion of hub and spokes for small rural hospitals in two settings in the USA and Canada which have a low frequency of neonatal deliveries [112]. Acknowledging similar simulation-based life support courses, the authors consider the unique feature of NOS as the longitudinal, interprofessional and in situ nature of the programme. This enables crucial relationship building between the hub and the spokes locations in respect of HCPs who work in rural communities (inclusivity) and the medical emergency retrieval services who deliver training and support, developing simulation faculty apprenticeships (sustainability) among local colleagues [112]. Two diverse centres are hosts of the NOS programme, having adapted the NOS programme for their own contexts (accessibility) via needs assessment to define and support local requirements using Kerns six-step approach to curriculum development [113]. An Indiana-based programme welcomes a flying faculty with simulation resources when required, whereas due to the vast distance constraints, a Yukon example engages in NOS through telesimulation. The latter example describes the Yukon’s centre as having all the physical simulators needed for delivering training but requiring NOS as the motivational dimension to trigger regular engagement in a programme of SBE. This is inferred as a key causal mechanism to invigorate locally based training to take place. The collegiate partnerships which developed supported quality improvement efforts and patient care practices (outcomes), within a context where multiple stakeholder engagement provided practical and financial support, and local commitment and investment in the NOS programme afforded protected time to release staff for training [112].

Helping Babies Breathe

Sustained clinical skills proficiency and patient safety outcomes have been demonstrated using outreach and minimal technology through the global training programme Helping Babies Breathe (HBB) [114]. This is an early example of programmes aiming for widespread implementation across low resource settings in Asia and sub-Saharan Africa to address WHO Millennium Goals [115,116]. Two systematic reviews of the HBB interventions described strategies which support the proposed outcomes of these programmes, including physical simulation resources to facilitate psychomotor skills training. However, these physical resources are not described as the key mediators for skills acquisition, effective and sustained learning in these low-resource contexts [116]. The causal mechanisms are attributed to resources such as peer-supported coaching, mentoring, assessment of skills and refresher practice which resulted in increased confidence leading to sustained local impact from the programme [116,117]. Although widely adopted, HBB has been criticized for improving simulated performance but not the clinical management of neonatal patients or perinatal mortality [118]. It is argued this is due to a lack of embedding HBB opportunities beyond the hospital setting, despite most of the perinatal and neonatal morbidity and mortality occurring in community settings [116,117]. Opportunities for high-frequency skills practice, skills maintenance and testing in community healthcare contexts are limited in low-resource settings, and hence a barrier to accessibility and inclusivity of sustaining the HBB programme beyond the hospital setting [119].

Shared simulation-based training

The opportunities and challenges of sharing SBE courses, resources and instructional materials between academic institutions, and investment in infrastructure to ‘facilitate downstream cost savings’ is reported by Laack et al. [120] (p.1), aiming to widen access to SBE and mitigate against barriers to implementation across academic institutions, states and continental boundaries. This programme of SBE was implemented, evaluated and enhanced in respect of interprofessional collaboration. It aligns with a seminal Lancet report which advocates ‘linking together through networks, alliances, and consortia between educational institutions worldwide’ [20] (p.1) to transform and strengthen education in low-resource health systems. This mixed methods study discussed the feasibility, benefits and challenges of sharing SBE courses across institutions, and the authors emphasized the need for consideration of local culture, context and needs when sharing resources and implementing programmes in distinctive institutions [120]. They identified that the considerable upfront costs of establishing the programme were offset by being a one-time outlay spread over time and institutions. The advantages described were cost and time saving for clinicians and faculty and were considered compelling motivators for sharing SBE courses. The planning and infrastructure building between the hub and spokes was felt to have potential and promise; however, in practice the outcomes were not fully realized in this pilot stage of implementation despite early lesson learned, and thus evidence of longevity and sustainability is limited.

NHET-Sim programme

The last mobile programme discussed is the NHET-Sim programme, a national strategy aiming to fulfil a need for accessible, inclusive SBE and sustainable faculty development across Australia [121]. The programme recognizes and seeks to address the challenges of simulation resource duplication, inconsistent facilities utilization, discipline-specific silos, and the intersection of academic institutions and health services sectors [121]. This government-funded directive stipulates that 25% of the NHET-Sim programme should focus on ensuring outreach to healthcare staff in RR settings, realized as distance learning and in-person education and training. Like the COMET programme, NHET-Sim encourages peer exchanges and the development of resources including locally contextualized scenarios which provide discussion opportunities about the challenges of working in smaller teams with limited resources. In turn this generates outcomes such as facilitating conversations about when and how to engage with medical retrieval colleagues to transfer patients to tertiary care. In this interprofessional context a simulation community of practice emerged, with a critical mass of participants, and shared language of SBE. Remotely connecting entry-level and emergent simulation education cultures with specialized simulation education support at a central hub, emanates accesibility and inclusivity. These strategies across local, regional and national levels created rapport and repeated opportunities for practice, knowledge exchange and scholarship. The authors assert that these hub and spokes and outreach forms of simulation were implemented to engage new groups of potential participants, and were anticipated to be more responsive to local needs because co-facilitation and learning took place in situ [121]. Nevertheless, this was not without challenges. Local resistance to buy-in and other competing priorities threatened the infrastructrual scale-up and sustainability of support for locally based facilitators [121]. Implementing SBE programmes is complex, and there is added contextual complexity in the RR setting where one-size does not fit all contexts [25]. However, this Australian national strategic approach, with a focus on sharing simulation expertise and resources, resulted in a network of widely distributed faculty. This community of practice promotes accessible and inclusive simulation and in turn enhances local buy-in, ownership and participation, the causative mechanisms for sustainability [121].

Discussion

Realist reviews do not intend to conclude a net effect that interventions work or not. Rather they explore heterogeneous interventions and modalities to illuminate and magnify phenomena of interest [75]. The concept of mobile simulation exists in idiosyncratic physical, virtual and social forms, with the intention of enabling simulation opportunities and overcoming distance and/or resource-orientated barriers. Moreover, it enables the contextualizing of learning with, from and about the specific needs of a target population, providing clinical and simulation expertise in harder-to-reach communities. The challenges of accessibility and inclusivity in SBE are addressed by the simulation programmes described in this review; however, there is less evidence of the sustainability of such innovations across diverse infrastructural contexts.

Programme theories and realist theorizing

Realist research asserts that interventions or programme theories are not implemented into a social vacuum and encourages researchers to explore the social architecture in other words – the structure and agency of a context to explain the mechanisms of how, why and for whom intended outcomes are achieved, or not [73]. Implementing programmes of mobile and distance simulation manifests in the tangible form of equipment, personnel and combinations of these and other resources into heterogeneous social contexts. These are the visible, observable and measurable outcomes of any SBE interventions which are compared here with the image of the tip of an iceberg (Figure 5). Explaining how and why these observable outcomes emerge requires a deeper exploration of social contexts, to explore the causative mechanisms. In other words, what motivates and triggers support, or conversely which barriers inhibit intended outcomes? These findings may be hidden below the metaphorical waterline.

A realist iceberg analogy (edited in https://www.canva.com/)
Figure 5:

A realist iceberg analogy (edited in https://www.canva.com/)

Social contexts are the complex, dynamic backdrop for the adoption of any intervention, which in turn becomes the product of its context [49], and so simulation stakeholders may assume that a proposed intervention (programme theory) offers innovative solutions to perceived challenges, generating learning and improvement. However, while observable outcomes may be highly visible and easy to make an early judgement about, they may also be transient and maladaptive in different contexts and may not support sustainable intentions.

The literature described in this realist review reveals a heterogeneity of interventions and contexts, and the intended outcomes are attributed to the strength of relationship building, social networks and connections which are the causative mechanisms resulting from insightful implementation approaches within the co-located communities of practice. This realist review proposes that the scale-up (infrastructure building) of SBE interventions is more socially and contextually contingent than dependent on the spread (replication) of its physical resources and environments [29].

Strengths and limitations

The strengths of this realist review are that it showcases to the simulation community a methodological approach for researching SBE using realist theory-driven approaches. It seeks to acknowledge, explore and advance our understanding of complexity in relation to the implementation of simulation interventions. This publication responds to calls for research which adopts theory, innovative methodologies and methods to study simulation for health and social care [65] and therefore contributes valuable knowledge to the Healthcare Distance Simulation Collaborative [122]. However, a limitation is that this realist review was conducted prior to the characterization of the Healthcare Distance Simulation Collaborative, and hence this concept was not identified as a search term during the review. This Collaborative has since generated much needed new evidence [122], and guidelines [123] as well as creating a nascent research and practice community [124] for the advancement of SBE for harder-to-reach communities. New evidence published subsequent to this review [125] also provides this community with rich and varied insights into mobile and distance simulation programmes. This realist review may now be a valued contribution to integrate with developing evidence-base of the Healthcare Distance Simulation Collaborative.

Conclusion

This realist review of mobile, distance, outreach, and hub & spokes programmes explored heterogeneous examples of simulation interventions. These simulation interventions provide improved geographical access and professional inclusivity for some RR and harder-to-reach communities. However, the longitudinal evidence of sustainability is limited, and against a backdrop of global conflict, of human, health, environmental and financial constraints, increased access, inclusion and sustainability are vital yet are arguably increasingly uncertain. Implementing SBE interventions is complex and non-linear, and more longitudinal sociological research is needed to explore and explain what works, for whom, in what circumstances, how, why and in what respects?

Declarations

Acknowledgements

Grateful thanks to Dr. Sean McAleer, for his time, kindness and critical reading, also, to Mr. Scott McGregor, librarian at the University of Dundee.

Authors’ contributions

Susan Somerville designed and conducted this research as a PhD candidate and was supervised by Stella Howden, Jean Ker and Susie Schofield. The manuscript was written by SS and critically reviewed by the co-authors.

Funding

NHS Education for Scotland (NES) funded this PhD study.

Availability of data and materials

None declared.

Ethics approval and consent to participate

Ethical approval was granted by the University of Dundee Research Ethics Committee (UREC 16037).

Competing interests

None declared.

References

1. 

Ferguson J, Astbury J, Willis S, Silverthorne J, Schafheutle E. Implementing, embedding and sustaining simulation based education: what helps, what hinders. Medical Education. 2020;54(10):915924.

2. 

McGaghie WC. Implementation science: addressing complexity in medical education. Medical Teacher. 2011;33(2):9798.

3. 

McGaghie WC, Issenberg SB, Petrusa ER, Scalese RJ. A critical review of simulation-based medical education research: 2003–2009. Medical Education. 2010;44(1):5063.

4. 

Monteiro S, Sibbald M. Choosing wisely-clinician educators’ guide to high-value simulation-based education. Archives of Medicine and Health Sciences. 2020;8(2):302305.

5. 

Nestel D, Hui J, Kunkler K, Scerbo MW, Calhoun AW. Healthcare simulation research. Cham: Springer Nature. 2019.

6. 

Nestel D, Pritchard S, Watson M, Andreatta P, Bearman M, Morrison T. Strategic approaches to simulation-based education: a case study from Australia. Journal of Health Specialties. 2013;1(1):412.

7. 

Ker J, Cachia P, Beasant B. A national approach for the use of simulation to educate and train the NHS workforce: the First National Clinical Skills Strategy. Scottish Medical Journal. 2015;60(4):220222.

8. 

SHIIAN. Health impact assessment of rural development: ScotPHN (public health network). 2015. Available from: https://www.scotphn.net/wp-content/uploads/2015/10/2015_05_28_SHIIAN_Final_Report.pdf [Accessed 12 March 2024].

9. 

Battista A, Nestel D. Simulation in medical education. In: Understanding Medical Education: Evidence, Theory, and Practice. 2018. p.151162.

10. 

McGaghie WC, Issenberg SB, Petrusa ER, Scalese RJ. Revisiting ‘A critical review of simulation-based medical education research: 2003–2009’. Medical Education. 2016;50(10):986991.

11. 

Kneebone R, Arora S, King D, et al. Distributed simulation – accessible immersive training. Medical Teacher. 2010;32(1):6570.

12. 

Stefanidis D, Sevdalis N, Paige J, et al. Simulation in surgery: what’s needed next? Annals of Surgery. 2015;261(5):846853.

13. 

Ahmed RA, Atkinson SS, Gable B, Yee J, Gardner AK. Coaching from the sidelines: examining the impact of teledebriefing in simulation-based training. Simulation in Healthcare. 2016;11(5):334339.

14. 

Gross IT, Whitfill T, Auzina L, Auerbach M, Balmaks R. Telementoring for remote simulation instructor training and faculty development using telesimulation. BMJ Simulation & Technology Enhanced Learning. 2021;7(2):61.

15. 

NHS Education for Scotland. The Scottish clinical skills strategy: partnerships for care. 2007. Available from: http://www.csmen.scot.nhs.uk/media/1867/scottish_clinical_skills_strategy_exec_summary.pdf [Accessed 26 July 2016].

16. 

Baker A, Hardie L, Somerville S, Ker J. Analysis of the use of a mobile simulation unit using the principles of a managed educational network. Rural Remote Health. 2021;21(1):5670.

17. 

The Scottish Government. Delivering for remote and rural healthcare: the final report of the remote and rural workstream. 2008. Available from: http://www.gov.scot/Publications/2008/05/06084423/0 [Accessed 31 March 2016].

18. 

MacVicar R, Nicoll P. NHS Education for Scotland: supporting remote and rural healthcare. NES Board Paper August. 2013 Available from: https://ruralhealthandcare.wales/wp-content/uploads/2017/08/remote-and-rural-healthcare-updated.pdf.

19. 

Bradley S, Munoz S-A, Hines F, editors. Sustainable remote and rural healthcare: UHI evaluation of the being here programme 2014-2017. Rethinking Remote & Rural 2018 Conference, May 24 & May 25, 2018: Innovative Solutions in Remote and Rural Communities Healthcare. 2018.

20. 

Frenk J, Chen L, Bhutta ZA, et al. Health professionals for a new century: transforming education to strengthen health systems in an interdependent world. The Lancet. 2010;376(9756):19231958.

21. 

Munoz S-A, Bradley S, Hines F. Final evaluation report of the being here programme: stakeholder experiences of changes to remote and rural healthcare services. 2018. Available from: https://pureadmin.uhi.ac.uk/ws/portalfiles/portal/16183962/BEING_HERE_EVALUATION_FINAL_REPORT_24052019.pdf.

22. 

Karas M, Sheen NJL, North RV, Ryan B, Bullock A. Continuing professional development requirements for UK health professionals: a scoping review. BMJ Open. 2020;10(3):e032781.

23. 

World Health Organization [WHO]. Increasing access to health workers in remote and rural areas through improved retention: global policy recommendations. Geneva: WHO Press. 2010.

24. 

Strasser R. Community engagement: a key to successful rural clinical education. Remote and Rural Health. 2010b;10(3):17.

25. 

Nestel D, Rogers L, Freeman K, Brotchie K, Watson MO. Advanced clinical skills: the use of simulation for the development and maintenance of skills for rural practitioners. The WONCA Rural Medical Education Guidebook. WONCA Working Party on Rural Practice. 2014. p.116. Available from: https://www.globalfamilydoctor.com [Accessed 7 March 2019].

26. 

Gutenstein M, Kiuru S. The Matthew effect in New Zealand rural hospital trauma and emergency care: why rural simulation-based education matters. The New Zealand Medical Journal. 2018;131(1476):7587.

27. 

Jewer J, Parsons MH, Dunne C, Smith A, Dubrowski A. Evaluation of a mobile telesimulation unit to train rural and remote practitioners on high-acuity low-occurrence procedures: pilot randomized controlled trial. Journal of Medical Internet Research. 2019;21(8):e14587.

28. 

McCarthy R, Gino B, Williams K-L, d’Entremont P, Renouf TS. Prehospital trauma care: a simulation scenario for rural-based healthcare providers. Cureus. 2020;12(6):112.

29. 

Campbell D, Shepherd I, McGrail M, et al. Procedural skills practice and training needs of doctors, nurses, midwives and paramedics in rural Victoria. Advances in Medical Education and Practice. 2015;6:183194.

30. 

Greenhalgh T, Papoutsi C. Spreading and scaling up innovation and improvement. BMJ. 2019;365:l2068.

31. 

Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.

32. 

Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist review – a new method of systematic review designed for complex policy interventions. Journal of Health Services Research & Policy. 2005;10(suppl 1):2134.

33. 

Somerville. S. An exploration of a Mobile Skills Unit in NHS Scotland: a realist research study of a complex intervention in a complex social system. [Student thesis: Doctoral Thesis › Doctor of Philosophy]. 2021. Available from: https://discovery.dundee.ac.uk/en/studentTheses/an-exploration-of-a-mobile-skills-unit-in-nhs-scotland [Accessed 31 January 2023].

34. 

Pawson R. The science of evaluation: a realist manifesto. London: Sage. 2013.

35. 

Greenhalgh T, Wong G, Jagosh J, et al. Protocol—the RAMESES II study: developing guidance and reporting standards for realist evaluation. BMJ Open. 2015;5(8):e008567.

36. 

Rycroft-Malone J, Burton CR, Wilkinson J, et al Collective action for implementation: a realist evaluation of organisational collaboration in healthcare. Implementation Science. 2015;11(1):17.

37. 

Wong G. Getting to grips with context and complexity – the case for realist approaches. Gaceta Sanitaria. 2018;32(2):109110.

38. 

Rees CE, Davis C, Nguyen VN, Proctor D, Mattick KL. A roadmap to realist interviews in health professions education research: recommendations based on a critical analysis. Medical Education. 2023. doi: 10.1111/medu.15270.

39. 

RAMESES I Project. Realist synthesis RAMESES training materials. 2013. Available from: https://www.ramesesproject.org/media/Realist_reviews_training_materials.pdf [Accessed 12 March 2024].

40. 

Booth A, Briscoe S, Wright JM. The “realist search”: a systematic scoping review of current practice and reporting. Research Synthesis Methods. 2020;11(1):1435.

41. 

Wong G, Greenhalgh T, Westhorp G, Pawson R. Development of methodological guidance, publication standards and training materials for realist and meta-narrative reviews: the RAMESES (Realist And Meta-narrative Evidence Syntheses - Evolving Standards) project. Health Services and Delivery Research. 2014;2(30):1.

42. 

SOPHIE. An introduction to realist reviews. 2013. Available from: http://www.sophie-project.eu/pdf/realistreview.pdf [Accessed 4 March 2017].

43. 

Emmel N. Sampling and choosing cases in qualitative research: a realist approach. London: Sage. 2013.

44. 

Westhorp G. Realist impact evaluation: an introduction. London: Overseas Development Institute. 2014. p.112.

45. 

Pawson R, Tilley N. Realistic evaluation. Sage. 1997.

46. 

Tilley N. What’s the “what” in “what works?”? Health, policing and crime prevention. Evaluating Crime Reduction Initiatives. 2009;24:121.

47. 

Jagosh J. Realist synthesis for public health: building an ontologically deep understanding of how programs work, for whom, and in which contexts. Annual Review of Public Health. 2019;40:361372.

48. 

Booth A, Wright J, Briscoe S. Scoping and searching to support realist approaches. In: Emmel N, Greenhalgh J, Manzano A, Monaghan M, Dalkin S, editors. Doing realist research. London: Sage. 2018. p.147166.

49. 

Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist synthesis: an introduction. ESRC research methods programme, University of Manchester, Manchester. RMP Methods Paper. 2004;2.

50. 

Dalkin S, Williams E. Introduction to realist approaches. 2016. Available from: https://nrl.northumbria.ac.uk/id/eprint/28002/1/Realist%20Synthesis_pre%20conf1.pdf.

51. 

McGregor S. Librarian, University of Dundee. Library consultation with Susan Somerville about literature review methodologies. Personal Communication. 8 July 2019.

52. 

Blane DN, Macdonald S, Morrison D, O’Donnell CA. Interventions targeted at primary care practitioners to improve the identification and referral of patients with co-morbid obesity: a realist review protocol. Systematic Reviews. 2015;4(1):1.

53. 

Wong G, Greenhalgh T, Westhorp G, Buckingham J, Pawson R. RAMESES publication standards: realist syntheses. BMC Medicine. 2013;11(1):114.

54. 

Jagosh J, Pluye P, Macaulay AC, et al. Assessing the outcomes of participatory research: protocol for identifying, selecting, appraising and synthesizing the literature for realist review. Implementation Science. 2011;6:24.

55. 

Cosh J. Skills on wheels. Nursing Standard (Royal College of Nursing (Great Britain): 1987). 2012;26(21):23.

56. 

Ker J, Rees JC, Race S, Stevenson J, Skinner J, O’Neill A, Morse J. Evaluating the impact of a mobile clinical skills facility – the pilot use of practitioner stories. 2011. Available from: http://www.asme.org.uk/images/ABSTRACTS_book_at_23rd_May_2011.pdf#page=17 [Accessed 16 May 2016].

57. 

Skinner J, Hardie L, Beasant B, et al. ‘Trochars no more’: teaching chest drain insertion to remote and rural practitioners using a mobile skills unit. Medical Teacher. 2014(0):14.

58. 

Guise JM, Lowe NK, Deering S, et al. Mobile in situ obstetric emergency simulation and teamwork training to improve maternal-fetal safety in hospitals. Joint Commission Journal on Quality and Patient Safety. 2010;36(10):443453.

59. 

Manchester A. Surgical bus serves communities and enhances the skills of rural nurses. Nursing New Zealand (Wellington, NZ: 1995). 2006;12(2):2021.

60. 

Nicol M, Warren A, Connolly J. Development of a clinical skills bus: making simulation mobile. International Journal of Clinical Skills. 2007;1:101113.

61. 

Shaikh FM, Hseino H, Hill ADK, Kavanagh E, Traynor O. Mobile surgical skills education unit: a new concept in surgical training. Simulation in Healthcare. 2011;6(4):226230.

62. 

Xafis V, Babidge W, Field J, Altree M, Marlow N, Maddern G. The efficacy of laparoscopic skills training in a Mobile Simulation Unit compared with a fixed site: a comparative study. Surgical Endoscopy. 2013;27(7):26062612.

63. 

Cheng A, Kessler D, Mackinnon R, et al Reporting guidelines for health care simulation research: extensions to the CONSORT and STROBE statements. Advances in Simulation. 2016;1(1):113.

64. 

McGaghie WC, Issenberg SB, Barsuk JH, Wayne DB. A critical review of simulation-based mastery learning with translational outcomes. Medical Education. 2014;48(4):375385.

65. 

Eppich W, Reedy G. Advancing healthcare simulation research: innovations in theory, methodology, and method. Advances in Simulation. 2022;7(1):23.

66. 

Cachia P. NHS Education for Scotland Medical Director. Stakeholder consultation with Susan Somerville about the origins of the MSU. Personal Communication. 18 September 2014.

67. 

Cheng A, Eppich W, Kolbe M, Meguerdichian M, Bajaj K, Grant V. A conceptual framework for the development of debriefing skills: a journey of discovery, growth, and maturity. Simulation in Healthcare. 2020;15(1):5560.

68. 

Issenberg SB, McGaghie WC, Petrusa ER, Gordon DL, Scalese RJ. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Medical Teacher. 2005;27(1):1028.

69. 

Fey MK, Auerbach M, Szyld D. Implementing faculty development programs: moving from theory to practice. Simulation in Healthcare. 2020;15(1):56.

70. 

Booth A, Harris J, Croot E, Springett J, Campbell F, Wilkins E. Towards a methodology for cluster searching to provide conceptual and contextual “richness” for systematic reviews of complex interventions: case study (CLUSTER). BMC Medical Research Methodology. 2013;13(1):118.

71. 

Elrod JK, Fortenberry JL. The hub-and-spoke organization design revisited: a lifeline for rural hospitals. BMC Health Services Research. 2017;17(4):795.

72. 

Eppich WJ, Schmutz JB. From ‘them’ to ‘us’: bridging group boundaries through team inclusiveness. Medical Education. 2019;53(8):756758.

73. 

Pawson R. Evidence-based policy: a realist perspective. London: Sage Publications. 2006.

74. 

Gordon L, Cleland JA. Change is never easy: how management theories can help operationalise change in medical education. Medical Education. 2021;55(1):5564.

75. 

Bordage G. Conceptual frameworks to illuminate and magnify. Medical Education. 2009;43(4):312319.

76. 

Lopreiato JO, Downing D, Gammon W. Society for simulation in healthcare. agency for healthcare research and quality healthcare simulation dictionary. 2016. Available from: https://www ahrq gov/sites/default/files/publications/files/sim-dictionary pdf [Accessed 28 February 2020].

77. 

Carstens PK. Comprehensive healthcare simulation: mobile medical simulation. Cham: Springer Nature. 2020.

78. 

Kassab E, Tun JK, Arora S, et al. “Blowing up the barriers” in surgical training: exploring and validating the concept of distributed simulation. Annals of Surgery. 2011;254(6):10591065.

79. 

Harris A, Kassab E, Tun JK, Kneebone R. Distributed simulation in surgical training: an off-site feasibility study. Medical Teacher. 2013;35(4):e1078e1081.

80. 

Rosen MA, Hunt EA, Pronovost PJ, Federowicz MA, Weaver SJ. In situ simulation in continuing education for the health care professions: a systematic review. Journal of Continuing Education in the Health Professions. 2012;32(4):243254.

81. 

Rall M, Stricker E, Reddersen S, et al. Mobile “in-situ” crisis resource management training: simulation courses with video-assisted debriefing where participants work. In: Kyle R, Murray BW, editors. Clinical simulation: operations, engineering, and management. Burlington, VT: Academic Press. p. 565581.

82. 

Petrosoniak A, Hicks C, Barratt L, et al. Design thinking-informed simulation: an innovative framework to test, evaluate, and modify new clinical infrastructure. Simulation in Healthcare: Journal of the Society for Simulation in Healthcare. 2020;15(3):205213.

83. 

Brazil V, Lowe B, Ryan L, et al Translational simulation for rapid transformation of health services, using the example of the COVID-19 pandemic preparation. Advances in Simulation. 2020;5(1):110.

84. 

McGaghie WC, Issenberg SB, Cohen MER, Barsuk JH, Wayne DB. Does simulation-based medical education with deliberate practice yield better results than traditional clinical education? A meta-analytic comparative review of the evidence. Academic Medicine: Journal of the Association of American Medical Colleges. 2011;86(6):706.

85. 

Crofts JF, Ellis D, Draycott TJ, Winter C, Hunt LP, Akande VA. Change in knowledge of midwives and obstetricians following obstetric emergency training: a randomised controlled trial of local hospital, simulation centre and teamwork training. BJOG: An International Journal of Obstetrics & Gynaecology. 2007;114(12):15341541.

86. 

Draycott T, Crofts J. Structured team training in obstetrics and its impact on outcome. Fetal and Maternal Medicine Review. 2006;17(03):229237.

87. 

Draycott TJ, Crofts JF, Ash JP, et al. Improving neonatal outcome through practical shoulder dystocia training. Obstetrics & Gynecology. 2008;112(1):1420.

88. 

Møller TP, Østergaard D, Lippert A. Facts and fiction – training in centres or in situ. Trends in Anaesthesia and Critical Care. 2012;2(4):174179.

89. 

Sørensen JL, Navne LE, Martin HM, et al. Clarifying the learning experiences of healthcare professionals with in situ and off-site simulation-based medical education: a qualitative study. BMJ Open. 2015;5(10):e008345.

90. 

Sørensen JL, Østergaard D, LeBlanc V, et al. Design of simulation-based medical education and advantages and disadvantages of in situ simulation versus off-site simulation. BMC Medical Education. 2017;17(1):20.

91. 

Sørensen JL, Van der Vleuten C, Lindschou J, et al. ‘In situ simulation’ versus ‘off site simulation’ in obstetric emergencies and their effect on knowledge, safety attitudes, team performance, stress, and motivation: study protocol for a randomized controlled trial. Trials. 2013;14(1):220.

92. 

Sørensen JL, van der Vleuten C, Rosthøj S, et al. Simulation-based multiprofessional obstetric anaesthesia training conducted in situ versus off-site leads to similar individual and team outcomes: a randomised educational trial. BMJ Open. 2015;5(10):e008344.

93. 

Brazil V. Translational simulation: not ‘where?’ but ‘why?’ A functional view of in situ simulation. Advances in Simulation. 2017;2(1):20.

94. 

Petrosoniak A, Brydges R, Nemoy L, Campbell DM. Adapting form to function: can simulation serve our healthcare system and educational needs? Advances in Simulation. 2018;3(1):8.

95. 

Begley JL, Lavery KE, Nickson CP, Brewster DJ. The aerosol box for intubation in COVID-19 patients: an in-situ simulation crossover study. Anaesthesia. 2020;75(8):10141021.

96. 

Fregene TE, Nadarajah P, Buckley JF, Bigham S, Nangalia V. Use of in situ simulation to evaluate the operational readiness of a high-consequence infectious disease intensive care unit. Anaesthesia. 2020;75(6):733738.

97. 

Purdy E, Alexander C, Caughley M, Bassett S, Brazil V. Identifying and transmitting the culture of emergency medicine through simulation. AEM Education and Training. 2019;3(2):118128.

98. 

Purdy E, Borchert L, El-Bitar A, Isaacson W, Bills L, Brazil V. Taking simulation out of its “safe container”—exploring the bidirectional impacts of psychological safety and simulation in an emergency department. Advances in Simulation. 2022;7(1):5.

99. 

McCoy CE, Sayegh J, Alrabah R, Yarris LM. Telesimulation: an innovative tool for health professions education. AEM Education and Training. 2017;1(2):132136.

100. 

Gross IT, Whitfill T, Auzina L, Auerbach M, Balmaks R. Telementoring for remote simulation instructor training and faculty development using telesimulation. BMJ Simulation and Technology Enhanced Learning. 2021;7(2):6165.

101. 

Mikrogianakis A, Kam A, Silver S, et al. Telesimulation: an innovative and effective tool for teaching novel intraosseous insertion techniques in developing countries. Academic Emergency Medicine. 2011;18(4):420427.

102. 

Okrainec A, Soper NJ, Swanstrom LL, Fried GM. Trends and results of the first 5 years of Fundamentals of Laparoscopic Surgery (FLS) certification testing. Surgical Endoscopy. 2011;25(4):11921198.

103. 

Christensen MD, Oestergaard D, Dieckmann P, Watterson L. Learners’ perceptions during simulation-based training: an interview study comparing remote versus locally facilitated simulation-based training. Simulation in Healthcare. 2018;13(5):306315.

104. 

Christensen MD, Rieger K, Tan S, Dieckmann P, Østergaard D, Watterson LM. Remotely versus locally facilitated simulation-based training in management of the deteriorating patient by newly graduated health professionals: a controlled trial. Simulation in Healthcare. 2015;10(6):352359.

105. 

Ahmed S. SESAM: Lou Oberndorf online lecture series: holograms, avatars and the extension to reality - paradigm shift for simulation and education. 2020. Available from: https://www.youtube.com/watch?app=desktop&v=2th8413QCoM [Accessed 12 September 2020].

106. 

Ingrassia PL, Capogna G, Diaz-Navarro C, Szyld D, Tomola S, Leon-Castelao E. COVID-19 crisis, safe reopening of simulation centres and the new normal: food for thought. Advances in Simulation. 2020;5(1):13.

107. 

Sa-Couto C, Nicolau A. How to use telesimulation to reduce COVID-19 training challenges: a recipe with free online tools and a bit of imagination. MedEdPublish. 2020;9:129.

108. 

Dieckmann P, Torgeirsen K, Qvindesland SA, Thomas L, Bushell V, Langli Ersdal H. The use of simulation to prepare and improve responses to infectious disease outbreaks like COVID-19: practical tips and resources from Norway, Denmark, and the UK. Advances in Simulation. 2020;5:3.

109. 

AdvanceHE. Beyond flexible learning - modes of learning: a practice guide. 2022 [updated 25/11/2022]. Available from: https://www.advance-he.ac.uk/knowledge-hub/beyond-flexible-learning-practice-guide [Accessed 25 November 2022].

110. 

Walsh BM, Auerbach MA, Gawel MN, Brown LL, Byrne BJ, Calhoun A. Community-based in situ simulation: bringing simulation to the masses. Advances in Simulation. 2019;4(1):30.

111. 

Simulcast. 99 - advances in simulation: bringing simulation to the masses. 2020. Available from: https://simulationpodcast.com/99-advances-in-simulation-bringing-sim-to-the-masses/ [Accessed 31 March 2020].

112. 

Byrne BJ, Manhas D. Neonatal outreach simulation. Seminars in perinatology. 2016;40(7):480488.

113. 

Kern DE. A six-step approach to curriculum development. In: Thomas P, Kern D, Hughes M, Chen B, editors. Curriculum development for medical education. 3rd edition. Baltimore, MD: John Hopkins University Press. 2016. p.59.

114. 

American Academy of Pediatrics. Guide for implementation of Helping Babies Breathe® (HBB): strengthening neonatal resuscitation in sustainable programs of essential newborn care. 2016. Available from: https://www. aap. org/en-us/Documents/hbs_implementationguide_english.pdf.

115. 

Budhathoki SS, Gurung R, Ewald U, Thapa J, Kc A. Does the Helping Babies Breathe programme impact on neonatal resuscitation care practices? Results from systematic review and meta-analysis. Acta Paediatrica. 2019;108(5):806813.

116. 

Dol J, Campbell-Yeo M, Murphy GT, Aston M, McMillan D, Richardson B. The impact of the Helping Babies Survive program on neonatal outcomes and health provider skills: a systematic review. JBI Database of Systematic Reviews and Implementation Reports. 2018;16(3):701737.

117. 

Perlman JM, Msemo G, Ersdal H, Ringia P. Designing and implementing the Helping Babies Breathe program in Tanzania. Journal of Pediatric Intensive Care. 2017;6(1):2838.

118. 

Ersdal H, Vossius C, Bayo E, et al. A one-day “Helping Babies Breathe” course improves simulated performance but not clinical management of neonates. Resuscitation. 2013;84(10):14221427.

119. 

Versantvoort JMD, Kleinhout MY, Ockhuijsen HDL, Bloemenkamp K, de Vries WB, van den Hoogen A. Helping Babies Breathe and its effects on intrapartum-related stillbirths and neonatal mortality in low-resource settings: a systematic review. Archives of Disease in Childhood. 2020;105(2):127133.

120. 

Laack TA, Lones EA, Schumacher DR, Todd FM, Cook DA. Sharing simulation-based training courses between institutions: opportunities and challenges. Advances in Simulation. 2017;2(1):1.

121. 

Nestel D, Bearman M, Brooks P, et al. A national training program for simulation educators and technicians: evaluation strategy and outcomes. BMC Medical Education. 2016;16(1):25.

122. 

Buléon C, Caton J, Park Y, et al The state of distance healthcare simulation during the COVID-19 pandemic: results of an international survey. Advances in Simulation. 2022;7(1):111.

123. 

Bajwa M, Ahmed R, Lababidi H, et al Development of distance simulation educator guidelines in healthcare: a Delphi method application. Simulation in Healthcare. 2023.

124. 

Gross IT, Clapper TC, Ramachandra G, et al Setting an agenda: results of a consensus process on research directions in distance simulation. Simulation in Healthcare. 2022.

125. 

Mossenson AI, Mukwesi C, Elaibaid M, Doverty J, May A, Murray M, et al. Vital Anaesthesia Simulation Training (VAST); immersive simulation designed for diverse settings. IJS Global Health. 2021;4(6):e64.