<?xml version="1.0" encoding="UTF-8" standalone="no"?><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="Essay" dtd-version="1.3d1" xml:lang="en">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">ijohs</journal-id>
<journal-title-group>
<journal-title>International Journal of Healthcare Simulation</journal-title>
<abbrev-journal-title>International Journal of Healthcare Simulation</abbrev-journal-title>
</journal-title-group>
<issn publication-format="electronic">2754-4524</issn>
<publisher>
<publisher-name>Adi Health + Wellness</publisher-name>
<publisher-loc>London, UK</publisher-loc>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">mxnk6952</article-id>
<article-id pub-id-type="doi">10.54531/mxnk6952</article-id>
<article-categories>
<subj-group subj-group-type="toc-heading"><subject>Essay</subject></subj-group>
</article-categories>
<title-group>
<article-title>Technology-enhanced training for central venous catheter insertion training: a reflective essay</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0001-5381-1091</contrib-id><name><surname>Cheung</surname><given-names>Victor</given-names></name><xref ref-type="aff" rid="AF0001"><sup>1</sup></xref><xref ref-type="corresp" rid="c1"/></contrib>
<contrib contrib-type="author"><name><surname>So</surname><given-names>Eric Hang-Kwong</given-names></name><xref ref-type="aff" rid="AF0001"><sup>1</sup></xref></contrib>
<contrib contrib-type="author"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0003-2941-2298</contrib-id><name><surname>Nestel</surname><given-names>Debra</given-names></name><xref ref-type="aff" rid="AF0002"><sup>2</sup></xref></contrib>
<contrib contrib-type="author"><name><surname>Hung</surname><given-names>Jeff Leung-Kit</given-names></name><xref ref-type="aff" rid="AF0001"><sup>1</sup></xref></contrib>
<contrib contrib-type="author"><name><surname>So</surname><given-names>Sze-Sze</given-names></name><xref ref-type="aff" rid="AF0001"><sup>1</sup></xref></contrib>
<contrib contrib-type="author"><name><surname>Chia</surname><given-names>Nam-Hung</given-names></name><xref ref-type="aff" rid="AF0001"><sup>1</sup></xref></contrib>
<contrib contrib-type="author"><name><surname>Ng</surname><given-names>George Wing-Yiu</given-names></name><xref ref-type="aff" rid="AF0001"><sup>1</sup></xref></contrib>
<aff id="AF0001"><label>1</label><institution>Multi-Disciplinary Simulation and Skills Centre, Queen Elizabeth Hospital</institution>, Kowloon, <country>Hong Kong</country></aff>
<aff id="AF0002"><label>2</label><institution>Department of Surgery, University of Melbourne</institution>, Melbourne, Victoria, <country>Australia</country></aff>
</contrib-group>
<author-notes>
<corresp id="c1"><bold>Corresponding author:</bold> Victor Cheung, <email>cheungklv.iop@gmail.com</email></corresp>
</author-notes>
<pub-date iso-8601-date="2024-04-19" pub-type="epub"><day>19</day><month>04</month><year>2024</year></pub-date>
<fpage>1</fpage>
<lpage>7</lpage>
<history>
<date date-type="received" iso-8601-date="2023-10-31"><day>31</day><month>10</month><year>2023</year></date>
<date date-type="accepted" iso-8601-date="2024-03-30"><day>30</day><month>03</month><year>2024</year></date>
</history>
<permissions>
<copyright-statement>© The Author(s). 2024</copyright-statement>
<copyright-year>2024</copyright-year>
<license license-type="open-access" xlink:href="https://creativecommons.org/licenses/by-sa/4.0/">
<license-p>This article is distributed under the terms of the Creative Commons Attribution-Share Alike 4.0 International License (<ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by-sa/4.0/">https://creativecommons.org/licenses/by-sa/4.0/</ext-link>), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (<ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/publicdomain/zero/1.0/">http://creativecommons.org/publicdomain/zero/1.0/</ext-link>) applies to the data made available in this article, unless otherwise stated).</license-p>
</license>
</permissions>
<self-uri xlink:href="mxnk6952.pdf" xlink:title="pdf"/>
<abstract><title>Abstract</title>
<p>With the advancement of innovative technology, healthcare professionals stand to benefit from adjustments to procedural skills training/assessment introduced during the COVID-19 pandemic. In this essay, we reflect on the development of a virtual reality (VR)-based training programme to support medical and nursing staff in procedural skills for central venous catheter (CVC) insertion, related communication skills and situation awareness. The remote delivery was a direct response to the impact of the pandemic and is likely to remain as an educational strategy on our centre.</p>
</abstract>
<custom-meta-group>
<custom-meta>
<meta-name>article-lifecycle</meta-name>
<meta-value>PAP</meta-value>
</custom-meta>
<custom-meta>
<meta-name>crossmark</meta-name>
<meta-value>2024-04-19T17:20:17</meta-value>
</custom-meta>
</custom-meta-group>
</article-meta>
</front>
<body>
<boxed-text position="float"><caption><title>What this study adds</title></caption>
<p><list list-type="bullet">
<list-item><p>Shares the process of development and application of a virtual reality (VR)-based training programme for central venous catheter (CVC) insertion and related skills.</p></list-item>
<list-item><p>Demonstrates distinctive features of VR-based approach in comparison with traditional training methods.</p></list-item>
<list-item><p>System integration: Enhances training quality and patient safety by integrating an innovative approach with our simulation training programme.</p></list-item>
<list-item><p>Discusses expected organizational impacts following full implementation of the programme.</p></list-item>
<list-item><p>Suggests future research which integrates service effectiveness with simulation centre management.</p></list-item>
</list></p>
</boxed-text>
<sec id="s1"><title>Introduction<span id="s1" nov-type="cross-ref"/></title>
<p>The COVID-19 pandemic has changed the way many people work and live, and increased attention to a global trend of digitalization, including the impacts of remote work and education on staff well-being, organizational performance, and training effectiveness. Virtual reality (VR) has been shortlisted by a group of world-renowned healthcare leaders as one of the top 10 healthcare innovations alongside other cutting-edge technologies such as 3D-printed devices, artificial intelligence and telehealth [<xref ref-type="bibr" rid="CIT0001">1</xref>].</p>
<p>VR has been used by clinical psychologists to work with patients suffering from anxiety attacks, psychosis, symptoms of Alzheimer’s disease, and acute or chronic pain or disability in a variety of settings including rehabilitation wards, outpatient units and community settings [<xref ref-type="bibr" rid="CIT0002">2</xref>–<xref ref-type="bibr" rid="CIT0005">5</xref>]. For example, immersive experiences where clients are exposed to specific stressors (e.g. crowed scene, dirty environment, spiders) could help them to progressively cope with that undesirable stimulus in a controlled environment [<xref ref-type="bibr" rid="CIT0002">2</xref>]. Beyond clinical applications, VR has another potential use in supporting training and development of healthcare professionals [<xref ref-type="bibr" rid="CIT0006">6</xref>].</p>
<p>In a meta-analysis of 92 studies examining technical and socio-emotional skills development using VR, Angel-Urdinola and colleagues highlighted that 78% of studies found comparable or better learning outcomes than traditional classroom teaching, including greater increases in confidence, self-efficacy, and efficiency as well as lower error rates (e.g. emergency evacuation of neonates, procedural sedation, robotic suturing, etc.) in diverse health and surgical education contexts [<xref ref-type="bibr" rid="CIT0007">7</xref>]. Blumstein and colleagues conducted a randomized controlled trial (RCT) of training for surgical management of tibial shaft fractures, in which they randomly assigned 20 medical students into an experimental group with VR as a major training modality or a control group with a learning guide [<xref ref-type="bibr" rid="CIT0008">8</xref>]. Medical students in the experimental group had assessment scores that were 2.3 times higher than their counterparts in the control group, as well as demonstrating greater accuracy and reduced procedure times [<xref ref-type="bibr" rid="CIT0008">8</xref>]. In this essay, we share our experience in developing a VR-based training for healthcare professionals after a brief summary of related background information and research findings.</p>
</sec>
<sec id="s2"><title>Importance of central venous catheter insertion training<span id="s2" nov-type="cross-ref"/></title>
<p>Central venous catheter (CVC) insertion is a medical procedure during which a doctor, with the assistance of a nurse or other health professional, places a catheter into a large vein, such as the internal jugular vein at the neck, subclavian and/or axillary vein on the chest, or femoral vein at around the groin [<xref ref-type="bibr" rid="CIT0009">9</xref>–<xref ref-type="bibr" rid="CIT0011">11</xref>]. This procedure is commonly used in clinical departments for haemodialysis (i.e. the administration of fluids and medications where using a peripheral vein is no longer available) and for hemodynamic monitoring [<xref ref-type="bibr" rid="CIT0011">11</xref>–<xref ref-type="bibr" rid="CIT0013">13</xref>]. CVC can lead to lethal complications following clinician errors such as failure to remove the guidewire, including but not limited to arrhythmias, myocardial perforation, central line-associated bloodstream infections (CLABSIs) and thrombosis [<xref ref-type="bibr" rid="CIT0008">8</xref>,<xref ref-type="bibr" rid="CIT0010">10</xref>,<xref ref-type="bibr" rid="CIT0012">12</xref>,<xref ref-type="bibr" rid="CIT0014">14</xref>]. Therefore, there is a need to ensure that clinicians are provided with highly effective training that reduces error rates as much as possible [<xref ref-type="bibr" rid="CIT0007">7</xref>].</p>
</sec>
<sec id="s3"><title>Existing knowledge: traditional training versus innovative approach<span id="s3" nov-type="cross-ref"/></title>
<p>Formal training is necessary to ensure a quality service and protect patient safety. Traditional training on real patients whilst guided by an experienced supervisor may still be prone to patient safety issues. Beyond simply understanding anatomical landmarks, surgical trainees require hands-on practice in a variety of surgical procedures to enhance cognitive knowledge of procedural steps and related surgical skills associated with tactile sensation [<xref ref-type="bibr" rid="CIT0011">11</xref>,<xref ref-type="bibr" rid="CIT0014">14</xref>]. Practice on real patients in a mentorship programme with experienced surgeons at consultant levels may result in experiences gained at high costs, in terms of higher risk ratio of mortality or complication (10%–25%), lack of opportunity for training in critical but rare procedures, inflexibility in training schedules and suboptimal use of clinical supervisor time [<xref ref-type="bibr" rid="CIT0010">10</xref>,<xref ref-type="bibr" rid="CIT0011">11</xref>]. VR enables healthcare professionals to practise the steps of certain clinical procedures in a virtual setting, prior to performing the same procedures on real patients [<xref ref-type="bibr" rid="CIT0006">6</xref>]. It can avoid unethical practice (e.g. violating general principles of beneficence/non-maleficence and competence in service provision) and can also ensure the quality and safety of healthcare services to safeguard the best interests of both service providers and users. An advanced training modality, such as part-task trainer (a device for training in CVC procedures in this study), is an alternative for the ‘see one, do one, teach one’ training model on real patients [<xref ref-type="bibr" rid="CIT0010">10</xref>,<xref ref-type="bibr" rid="CIT0014">14</xref>].</p>
<p>Despite scientifically proven enhancements in procedural skills, cognitive and affective aspects (including communication skills and empathy) cannot be addressed as easily through practice on part-task trainers [<xref ref-type="bibr" rid="CIT0014">14</xref>]. Guetterman and colleagues used VR to examine how medical students reacted to a simulated patient when breaking bad news (e.g. end-of-life issues for decision of do-not-resuscitate, DNR) during scenario-based simulation training [<xref ref-type="bibr" rid="CIT0015">15</xref>]. The results were encouraging; with the support of VR technology, their research team found that medical students would be able to share bad news with the patient or relative in a caring manner [<xref ref-type="bibr" rid="CIT0015">15</xref>]. Another study by Dyer and colleagues supported their findings, adding that medical students’ professionalism was improved, particularly with elderly patients [<xref ref-type="bibr" rid="CIT0016">16</xref>].</p>
</sec>
<sec id="s4"><title>Systems integration: virtual reality training for central venous catheter insertion<span id="s4" nov-type="cross-ref"/></title>
<p>The Multi-Disciplinary Simulation &amp; Skills Centre (MDSSC), a hospital-based simulation training centre in Queen Elizabeth Hospital (Hong Kong) has been changing healthcare education in alignment with organizational needs and international education, assessment and research standards. In order to develop an effective healthcare education programme, our multidisciplinary team started with needs identification, linking training objectives to results based on root cause analysis, a thorough investigation on leading cause of medical incidents (see <xref ref-type="table" rid="T1">Table 1</xref> for composition of multidisciplinary team and related KSAOs).</p>
<table-wrap id="T1" position="float"><label>Table 1:</label><caption><p>Composition of multidisciplinary team in developing central venous catheter insertion VR</p></caption>
<table cellpadding="5" frame="box" rules="all">
<thead>
<tr>
<th align="left">Role</th>
<th align="left">Knowledge, Skills, Abilities, Other factors (KSAOs)</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left">Centre Directors/ Training Advisors</td>
<td align="left">- who are specialized in surgery, anaesthesiology or intensive care at consultant level<break/>- skilful in performing central venous catheter (CVC) insertion procedures on real patients with experience in teaching CVC<break/>- able to apply extensive experience in clinical practice, knowledge and skills to develop simulation-based training with elements in crew resources management for patient safety climate<break/>- able to provide professional advice on standard procedures of CVC, setting of the simulation environment, with visionary mind-set</td>
</tr>
<tr>
<td align="left">Centre Manager/ Administrator</td>
<td align="left">- who are knowledgeable in procurement policy and operational guideline.<break/>- skilful in project and cost management, showing ability to build teams with good work ethics as well as systematic workflow under healthy and safety culture.<break/>- able to monitor system process with prior training in leadership skills, and communicate effectively with stakeholders at all levels</td>
</tr>
<tr>
<td align="left">Research Officer</td>
<td align="left">- who holds post-graduate qualification in occupational psychology with professional qualification as Registered Psychologist and Certified Healthcare Simulation Educator (CHSE) of Society of Simulation in Healthcare (SSH)<break/>- skilful in conducting scientific research project planning and management, data analysis, and psychometric assessment<break/>- able to perform abstract thinking, reasoning and problem solving; willing to work independently with adventurous and creative mind-set</td>
</tr>
<tr>
<td align="left">Technician/Programmer</td>
<td align="left">- who are at their sophomore or junior year in computer science or engineering major with professional experience in VR programme design<break/>- skilful in graphic design and practicable knowledge in VR software (e.g. Unity)<break/>- able to inform decision in model prototyping, with curiosity and motivation for innovation as a team player</td>
</tr>
<tr>
<td align="left">Simulation Operations Specialist</td>
<td align="left">- who are knowledgeable in chemistry with professional qualification in Certified Healthcare Simulation Operation Specialist (CHSOS) of Society of Simulation in Healthcare (SSH)<break/>- skilful in simulation environment preparation and set-up for training with VR programme<break/>- able to give advice on feasibility training modality as well as tentative flow, with innovative mind-set as a team player</td>
</tr>
<tr>
<td align="left">Executive Assistant</td>
<td align="left">-who plays active role at supporting rank in providing administrative, operational and technical support throughout the training process<break/>-able to provide clear instruction to instructors and participants in preparation phase, and maintain training and evaluation record according to service guideline and advice from program director and coordinator</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>In 2017, a hospital annual report on sentinel and serious untoward events regarding five CVC-related medical incidents raised public awareness of guidewire retentions following CVC insertion procedures, including the irreversible harm caused to patients, the negative impacts on self-efficacy of involved staff and damages to community trust [<xref ref-type="bibr" rid="CIT0017">17</xref>]. In 2021, the Quality &amp; Safety Department of Hospital Authority Head Office highlighted several recommendations at ‘Hospital Authority Risk Alert’ for the service enhancement plan [<xref ref-type="bibr" rid="CIT0018">18</xref>]:
<list list-type="simple">
<list-item><label>ii)</label><p>To improve communication to healthcare professionals regarding clear role delineation and responsibilities.</p></list-item>
<list-item><label>ii)</label><p>To strengthen knowledge and skills among doctors and nurses by organizing training in CVC procedures and after care, and reinforcing ‘1-set-1-time’ practice.</p></list-item>
<list-item><label>iii)</label><p>To strictly monitor compliance to CVC insertion guidelines, reinforce critical checking steps between doctors and nurses, and update bedside procedure safety checklist with standard workflow.</p></list-item>
</list></p>
</sec>
<sec id="s5"><title>Special features of simulator, simulation event and environment<span id="s5" nov-type="cross-ref"/></title>
<p>We developed a tailored VR programme to train doctors and nurses in CVC procedures in line the service enhancement plan. Distinctive from simulation training of CVC with a part-task trainer, our tailored VR programme synchronizes two sets of devices, enabling one doctor and one nurse to engage simultaneously in the entire CVC insertion procedure (see <xref ref-type="table" rid="T2">Table 2</xref>).</p>
<table-wrap id="T2" position="float"><label>Table 2:</label><caption><p>Central venous catheter insertion procedures for doctor and nurse</p></caption>
<graphic xlink:href="/dataresources/articles/contents-1714062303014-4cd5cd7d-95df-4d6f-8467-8bc3944fe0a7/assets/mxnk6952_t002.jpg"/>
</table-wrap>
<p>This feature strengthens teamwork and communication skills between doctors and nurses during the procedure, as well as their situation awareness (e.g. knowing when to prepare the ultrasound probe, pass equipment to the doctor, remind the doctor of missing a step with checklist) through interacting with the other professional’s ‘avatar’ within the virtual learning environment. This training modality is compatible with tele-education, enabling participants to attend the training at any site with equipment required, such as host computer, base station and head-mounted display. The space of the room for VR should be not less than 6.6 square feet (see <xref ref-type="fig" rid="F1">Figure 1</xref>).</p>
<fig id="F1" position="float"><label>Figure 1:</label><caption><p>Equipment/setting of virtual reality programme and traditional part-task trainer.</p></caption>
<graphic xlink:href="/dataresources/articles/contents-1714062303014-4cd5cd7d-95df-4d6f-8467-8bc3944fe0a7/assets/mxnk6952_f001.jpg"/></fig>
<fig id="F2" position="float"><label>Figure 2:</label><caption><p>Quadrant chart of training/assessment type and level.</p></caption>
<graphic xlink:href="/dataresources/articles/contents-1714062303014-4cd5cd7d-95df-4d6f-8467-8bc3944fe0a7/assets/mxnk6952_f002.jpg"/></fig>
<p>This is the first locally developed multi-purpose VR-based programme for CVC training in our lab-based simulation centre. To maximize learning effectiveness, the programme has been planned to be incorporated into existing CVC insertion training for medical and nursing staff in the Queen Elizabeth Hospital. In a sense of innovation that creates system-wide synergies, procedural knowledge can be diffused to inter-hospital service, and from simulation training to day-to-day clinical practice. The programme demonstrates its strengths on flexibility and versatility, enabling educators to assess performance of participants in variety of types (formative or summative) and levels (low or high stakes) in four quadrants (see <xref ref-type="fig" rid="F2">Figure 2</xref>).</p>
<p><list list-type="bullet">
<list-item><p>Formative: Participant receives immediate verbal feedback from instructors with qualifications in relevant specialty training and extensive experience in CVC procedure throughout the VR experiences for continuous improvement.</p></list-item>
<list-item><p>Summative: Participant generates specific score or determines a pass/fail result at the end of the session.</p></list-item>
<list-item><p>Low stakes: Participant enjoys experiential learning without pressure because of its nature for continuous learning as opposed to that for examination.</p></list-item>
<list-item><p>High stakes: Participant treats the task very seriously in order to examine whether a person has reached certain level of knowledge or skills in compliance with prevailing professional standard; no completion, no certificate.</p></list-item>
</list></p>
<p>For example, compliance rate with standardized checklists or time to complete the task can be evaluated as one of the measurable outcomes for quantification of the skills participants gain at the end of the training for low-stakes summative purpose. Prior to full implementation of the VR programme for post-graduate staff, dry-run sessions were made to elicit user feedback for final adjustment on graphic design, overall arrangement and logistics of the training, and preliminary evaluation on training satisfaction, as well as their acceptance of VR as a standalone training modality for CVC insertion procedures.</p>
</sec>
<sec id="s6"><title>Organization impact: feedback from stakeholders and public acceptance<span id="s6" nov-type="cross-ref"/></title>
<p>As well as effectiveness, the acceptability and practicability of any training programme play a major role in achieving training objectives. According to our preliminary feedback from dry-run sessions, using VR as a training modality has been widely accepted by major stakeholders for several reasons. As opposed to traditional classroom teaching and hands-on practice, participants found themselves highly motivated to learn with high technology, interactive element, as well as a simple but smart interface [<xref ref-type="bibr" rid="CIT0006">6</xref>]. Through immersive experiences with the VR programme, participants would not only be able to acquire procedural skills of CVC insertion but also enhance communication skills as well as situation awareness of near-miss between doctor and nurse pairs transferable to daily clinical operations. The VR-based training relies on fewer human resources because it is operated by a pair of participants plus or minus on-site or distanced technical supports. Beyond learning effects right after the training session, long-term benefits reflected by change in human resources in balance of monetary investment on VR programme development and patient safety could be expected (e.g. reduced length of stay, costs on additional medical expenses or even litigation due to post-CVC complications). Such potential impacts probably explain why hospital management worldwide showed higher acceptance of incorporating high technology into regular training programme for healthcare professionals amid the COVID-19 pandemic.</p>
<p>Further research could explore service effectiveness of incorporating CVC VR programme into formal simulation training curriculum at 6 dimensions bounded by the modified Kirkpatrick’s model [<xref ref-type="bibr" rid="CIT0019">19</xref>], which includes:
<list list-type="simple">
<list-item><label>-</label><p>Level 0 – Activity Accounting (Curriculum, Training Objectives, Success of Organization Change)</p></list-item>
<list-item><label>-</label><p>Level 1 – Reaction (User Satisfaction)</p></list-item>
<list-item><label>-</label><p>Level 2 – Learning (Acquisition of Knowledge and Skills)</p></list-item>
<list-item><label>-</label><p>Level 3 – Behaviour (Personal Strengths/Knowledge and Skills Transfer)</p></list-item>
<list-item><label>-</label><p>Level 4 – Results (Clinical Performance/Organizational Impacts)</p></list-item>
<list-item><label>-</label><p>Level 5 – Return on Investment or Expectation (ROI/ROE, including Monetary and Societal Impacts)</p></list-item>
</list></p>
<p>Examining these measurable outcomes may help us reinforce evidence-based practice in the way that healthcare management systems are well connected with task-specific training, assessment and innovative research [<xref ref-type="bibr" rid="CIT0019">19</xref>–<xref ref-type="bibr" rid="CIT0022">22</xref>].</p>
</sec>
</body>
<back>
<sec id="s7"><title>Declarations<span id="s7" nov-type="cross-ref"/></title>
<sec id="s8"><title>Acknowledgements</title>
<p>We would like to express our gratitude to Kowloon Central Cluster hospital management for on-going support to simulation training development and administrative and technical staff members of the Multi-Disciplinary Simulation and Skills Centre for intellectual input in converting creative ideas into actionable training program.</p>
</sec>
<sec id="s9"><title>Authors’ contributions</title>
<p>All authors contributed to the concept or design, acquisition of data, and analysis or interpretation of data. All authors critically reviewed and revised the draft from the first author for important intellectual content. All authors had full access to the data, contributed to the study, approved the final version for publication, and take responsibility for its accuracy and integrity.</p>
</sec>
<sec id="s10"><title>Funding</title>
<p>None declared.</p>
</sec>
<sec id="s11"><title>Availability of data and materials</title>
<p>None declared.</p>
</sec>
<sec id="s12"><title>Ethics approval and consent to participate</title>
<p>None declared.</p>
</sec>
<sec id="s13"><title>Competing interests</title>
<p>None declared.</p>
</sec>
</sec>
<ref-list><title>References<span id="nov000-15" nov-type="cross-ref"/></title>
<ref id="CIT0001"><label>1.</label><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Copeland</surname> <given-names>B</given-names></string-name>, <string-name><surname>Raynor</surname> <given-names>M</given-names></string-name>, <string-name><surname>Shah</surname> <given-names>S</given-names></string-name>, Top 10 health care innovations.</person-group> <publisher-loc>New York</publisher-loc>: <publisher-name>Deloitte Development LLC</publisher-name>. <year>2016</year>.</mixed-citation></ref>
<ref id="CIT0002"><label>2.</label><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>McMahon</surname> <given-names>E</given-names></string-name>, <string-name><surname>Boeldt</surname> <given-names>D</given-names></string-name></person-group>. <source>Virtual reality for anxiety: a guide for anxiety</source>. <publisher-loc>New York</publisher-loc>: <publisher-name>Routledge</publisher-name>. <year>2022</year>.</mixed-citation></ref>
<ref id="CIT0003"><label>3.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Wilson</surname> <given-names>K</given-names></string-name>, <string-name><surname>Scorsone</surname> <given-names>G.</given-names></string-name></person-group> <article-title>The use of virtual reality technologies to reduce anxiety and improve experience in chemotherapy patients during treatment.</article-title> <source>Frontier Virtual Real</source>. <year>2021</year>;<volume>2</volume>:<fpage>695449</fpage>.</mixed-citation></ref>
<ref id="CIT0004"><label>4.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Selfslagh</surname> <given-names>A</given-names></string-name>, <string-name><surname>Shokur</surname> <given-names>S</given-names></string-name>, <string-name><surname>Campos</surname> <given-names>DSF</given-names></string-name>, <string-name><surname>Donati</surname> <given-names>ARC</given-names></string-name>, <string-name><surname>Almeida</surname> <given-names>S</given-names></string-name>, <string-name><surname>Yamauti</surname> <given-names>SY</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Non-invasive, brain-controlled functional electrical stimulation for locomotion rehabilitation in individuals with paraplegia.</article-title> <source>Scientific Reports</source>. <year>2019</year>;<volume>9</volume>:<fpage>67</fpage>–<lpage>82</lpage>.</mixed-citation></ref>
<ref id="CIT0005"><label>5.</label><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Tabbaa</surname> <given-names>L</given-names></string-name>, <string-name><surname>Ang</surname> <given-names>CS</given-names></string-name>, <string-name><surname>Rose</surname> <given-names>V</given-names></string-name>, <string-name><surname>Siriaraya</surname> <given-names>P</given-names></string-name>, <string-name><surname>Stewart</surname> <given-names>I</given-names></string-name>, <string-name><surname>Jenkins</surname> <given-names>KG</given-names></string-name>, <string-name><surname>Matsangidou</surname> <given-names>M.</given-names></string-name></person-group> <article-title>Bring the outside in: Providing accessible experiences through VR for people with dementia in locked psychiatric hospitals</article-title>. <source>Proceedings of the SIGCHI Conference on Human Factors in Computing Systems</source>. <publisher-loc>Glasgow</publisher-loc>: <publisher-name>Association for Computing Machinery</publisher-name>. <year>2019</year>.</mixed-citation></ref>
<ref id="CIT0006"><label>6.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Tang</surname> <given-names>YM</given-names></string-name>, <string-name><surname>Ng</surname> <given-names>GWY</given-names></string-name>, <string-name><surname>Chia</surname> <given-names>NH</given-names></string-name>, <string-name><surname>So</surname> <given-names>EHK</given-names></string-name>, <string-name><surname>Wu</surname> <given-names>CH</given-names></string-name>, <string-name><surname>Ip</surname> <given-names>WH.</given-names></string-name></person-group> <article-title>Application of virtual reality (VR) technology for medical practitioners in type and screen (T&amp;S) Training.</article-title> <source>Journal of Computer Assisted Learning</source>. <year>2021</year>;<volume>37</volume>(<issue>2</issue>):<fpage>359</fpage>–<lpage>369</lpage>.</mixed-citation></ref>
<ref id="CIT0007"><label>7.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Angel-Urdinola</surname> <given-names>DF</given-names></string-name>, <string-name><surname>Castillo-Castro</surname> <given-names>C</given-names></string-name>, <string-name><surname>Hoyos</surname> <given-names>A.</given-names></string-name></person-group> <article-title>Meta-analysis assessing the effect of virtual reality training on student learning and skills development.</article-title> <source>World Bank Group Education Global Practice, Policy Research Working Paper</source>. <year>2021</year>:<fpage>9587</fpage>.</mixed-citation></ref>
<ref id="CIT0008"><label>8.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Blumstein</surname> <given-names>G</given-names></string-name>, <string-name><surname>Zukotynski</surname> <given-names>B</given-names></string-name>, <string-name><surname>Cevallos</surname> <given-names>N</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Randomized trial of a virtual reality tool to teach surgical technique for tibial shaft fracture intramedullary nailing.</article-title> <source>Journal of Surgical Education</source>. <year>2020</year>;<volume>77</volume>(<issue>4</issue>): <fpage>969</fpage>–<lpage>977</lpage>.</mixed-citation></ref>
<ref id="CIT0009"><label>9.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Butala</surname> <given-names>BP</given-names></string-name>, <string-name><surname>Shah</surname> <given-names>VR</given-names></string-name>, <string-name><surname>Solanki</surname> <given-names>B</given-names></string-name>, <string-name><surname>Kalo</surname> <given-names>J.</given-names></string-name></person-group> <article-title>Internal jugular vein thrombosis: a complication of temporary hemodialysis catheter.</article-title> <source>Journal of Anaesthesiology, Clinical Pharmacology</source>. <year>2015</year>;<volume>31</volume>(<issue>2</issue>):<fpage>276</fpage>–<lpage>278</lpage>.</mixed-citation></ref>
<ref id="CIT0010"><label>10.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Huang</surname> <given-names>CY</given-names></string-name>, <string-name><surname>Thomas</surname> <given-names>JB</given-names></string-name>, <string-name><surname>Alismail</surname> <given-names>A</given-names></string-name>, <string-name><surname>Cohen</surname> <given-names>A</given-names></string-name>, <string-name><surname>Almutairi</surname> <given-names>W</given-names></string-name>, <string-name><surname>Daher</surname> <given-names>NS</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>The use of augmented reality glasses in central line simulation: “See one, simulate many, do one competently, and teach everyone”.</article-title> <source>Advances in Medical Education and Practice</source>. <year>2018</year>;<volume>9</volume>:<fpage>357</fpage>–<lpage>363</lpage>.</mixed-citation></ref>
<ref id="CIT0011"><label>11.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Rochlen</surname> <given-names>LR</given-names></string-name>, <string-name><surname>Levine</surname> <given-names>R</given-names></string-name>, <string-name><surname>Tait</surname> <given-names>AR.</given-names></string-name></person-group> <article-title>First-person point-of-view-augmented reality for central line insertion training: a usability and feasibility study.</article-title> <source>Simulation in Healthcare: Journal of the Society for Simulation in Healthcare</source>. <year>2017</year>;<volume>12</volume>(<issue>1</issue>):<fpage>57</fpage>–<lpage>62</lpage>.</mixed-citation></ref>
<ref id="CIT0012"><label>12.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Mah</surname> <given-names>E</given-names></string-name>, <string-name><surname>Yu</surname> <given-names>J</given-names></string-name>, <string-name><surname>Deck</surname> <given-names>M</given-names></string-name>, <string-name><surname>Lyster</surname> <given-names>K</given-names></string-name>, <string-name><surname>Kawchuk</surname> <given-names>J</given-names></string-name>, <string-name><surname>Turnquist</surname> <given-names>A</given-names></string-name>, <string-name><surname>Thoma</surname>, <given-names>B.</given-names></string-name></person-group> <article-title>Immersive video modeling versus traditional video modeling for teaching central venous catheter insertion to medical residents.</article-title> <source>Cureus</source>. <year>2021</year>;<volume>13</volume>(<issue>3</issue>):<fpage>e13661</fpage>.</mixed-citation></ref>
<ref id="CIT0013"><label>13.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Peltan</surname> <given-names>ID</given-names></string-name>, <string-name><surname>Shiga</surname> <given-names>T</given-names></string-name>, <string-name><surname>Gordon</surname> <given-names>JA</given-names></string-name>, <string-name><surname>Currier</surname> <given-names>PF.</given-names></string-name></person-group> <article-title>Simulation improves procedural protocol adherence during central venous catheter placement: a randomized controlled trial.</article-title> <source>Simulation in Healthcare: Journal of the Society for Simulation in Healthcare</source>. <year>2015</year>;<volume>10</volume>(<issue>5</issue>):<fpage>270</fpage>–<lpage>276</lpage>.</mixed-citation></ref>
<ref id="CIT0014"><label>14.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Pepley</surname> <given-names>D</given-names></string-name>, <string-name><surname>Yovanoff</surname> <given-names>M</given-names></string-name>, <string-name><surname>Mirkin</surname> <given-names>K</given-names></string-name>, <string-name><surname>Miller</surname> <given-names>S</given-names></string-name>, <string-name><surname>Han</surname> <given-names>D</given-names></string-name>, <string-name><surname>Moore</surname> <given-names>JA.</given-names></string-name></person-group> <article-title>Virtual reality haptic robotic simulator for central venous catheterization training.</article-title> <source>Journal of Medical Devices</source>. <year>2016</year>;<volume>10</volume>(<issue>3</issue>):<fpage>0309371</fpage>–<lpage>0309372</lpage>.</mixed-citation></ref>
<ref id="CIT0015"><label>15.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Guetterman</surname> <given-names>TC</given-names></string-name>, <string-name><surname>Kron</surname> <given-names>FW</given-names></string-name>, <string-name><surname>Campbell</surname> <given-names>TC</given-names></string-name>, <string-name><surname>Scerbo</surname> <given-names>MW</given-names></string-name>, <string-name><surname>Zelenski</surname> <given-names>AB</given-names></string-name>, <string-name><surname>Cleary</surname> <given-names>JF</given-names></string-name>, <string-name><surname>Fetters</surname> <given-names>MD.</given-names></string-name></person-group> <article-title>Initial construct validity evidence of a virtual human application for competency assessment in breaking bad news to a cancer patient.</article-title> <source>Advances in Medical Education Practice</source>. <year>2017</year>;<volume>8</volume>:<fpage>505</fpage>–<lpage>512</lpage>.</mixed-citation></ref>
<ref id="CIT0016"><label>16.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Dyer</surname> <given-names>E</given-names></string-name>, <string-name><surname>Swartzlander</surname> <given-names>BJ</given-names></string-name>, <string-name><surname>Gugliucci</surname> <given-names>MR.</given-names></string-name></person-group> <article-title>Using virtual reality in medical education to teach empathy.</article-title> <source>Journal of the Medical Library Association</source>. <year>2018</year>;<volume>106</volume>(<issue>4</issue>):<fpage>498</fpage>–<lpage>500</lpage>.</mixed-citation></ref>
<ref id="CIT0017"><label>17.</label><mixed-citation publication-type="book"><collab>Hospital Authority.</collab> <source>Annual Report on Sentinel and Serious Untoward Events: October 2015 to September 2016</source>. <publisher-loc>Hong Kong SAR</publisher-loc>: <publisher-name>Patient Safety and Risk Management Department, Hospital Authority</publisher-name>. <year>2017</year>.</mixed-citation></ref>
<ref id="CIT0018"><label>18.</label><mixed-citation publication-type="other"><collab>Hospital Authority Head Office.</collab> <article-title>Risk alert: a risk management newsletter for Hospital Authority Healthcare professionals</article-title> <year>2021</year>;<volume>61</volume>(<issue>2</issue>):<fpage>1</fpage>–<lpage>8</lpage>.</mixed-citation></ref>
<ref id="CIT0019"><label>19.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Cheung</surname> <given-names>VKL</given-names></string-name>, <string-name><surname>Chia</surname> <given-names>NH</given-names></string-name>, <string-name><surname>So</surname> <given-names>SS</given-names></string-name>, <string-name><surname>Ng</surname> <given-names>GWY</given-names></string-name>, <string-name><surname>So</surname> <given-names>EHK.</given-names></string-name></person-group> <article-title>Expanding scope of Kirkpatrick model from training effectiveness review to evidence-informed prioritization management for cricothyroidotomy simulation.</article-title> <source>Heliyon</source>. <year>2023</year>;<volume>9</volume>(<issue>8</issue>):<fpage>e18268</fpage>.</mixed-citation></ref>
<ref id="CIT0020"><label>20.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Cheung</surname> <given-names>VKL</given-names></string-name>, <string-name><surname>So</surname> <given-names>EHK</given-names></string-name>, <string-name><surname>Ng</surname> <given-names>GWY</given-names></string-name>, <string-name><surname>So</surname> <given-names>SS</given-names></string-name>, <string-name><surname>Hung</surname> <given-names>HLK</given-names></string-name>, <string-name><surname>Chia</surname> <given-names>NH.</given-names></string-name></person-group> <article-title>Investigating effects of healthcare simulation on personal strengths and organizational impacts for healthcare workers during COVID-19 pandemic: a cross-sectional study.</article-title> <source>Integrative Medicine Research</source>. <year>2020</year>;<volume>9</volume>(<issue>3</issue>):<fpage>100476</fpage>.</mixed-citation></ref>
<ref id="CIT0021"><label>21.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Chia</surname> <given-names>NH</given-names></string-name>, <string-name><surname>Cheung</surname> <given-names>VKL</given-names></string-name>, <string-name><surname>Lam</surname> <given-names>MLY</given-names></string-name>, <string-name><surname>Cheung</surname> <given-names>IWK</given-names></string-name>, <string-name><surname>Wong</surname> <given-names>TKY</given-names></string-name>, <string-name><surname>So</surname> <given-names>SS</given-names></string-name>, <string-name><surname>So</surname> <given-names>EHK</given-names></string-name>, <string-name><surname>Ng</surname> <given-names>GWY.</given-names></string-name></person-group> <article-title>Harnessing power of simulation training effectiveness with Kirkpatrick model in emergency surgical airway procedures.</article-title> <source>Heliyon</source>. <year>2022</year>;<volume>8</volume>(<issue>10</issue>):<fpage>e10886</fpage>.</mixed-citation></ref>
<ref id="CIT0022"><label>22.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Chia</surname> <given-names>NH</given-names></string-name>, <string-name><surname>Cheung</surname> <given-names>VKL</given-names></string-name>, <string-name><surname>Hung</surname> <given-names>JLK</given-names></string-name>, <string-name><surname>So</surname> <given-names>SS</given-names></string-name>, <string-name><surname>So</surname> <given-names>EHK</given-names></string-name>, <string-name><surname>Ng</surname> <given-names>GWY.</given-names></string-name></person-group> <article-title>Perspective on test accuracy measures for surgical trainee under evidence-based medical education management.</article-title> <source>Surgeon</source>. <year>2023</year>;<volume>21</volume>(<issue>4</issue>):<fpage>e224</fpage>–<lpage>e228</lpage>.</mixed-citation></ref>
</ref-list>
</back>
</article>