<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.3d1 20170631//EN" "JATS-journalpublishing1.dtd">
<article article-type="Short Reports on Simulation Innovations Supplement (SRSIS)" dtd-version="1.3d1" xml:lang="en" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">ijohs</journal-id>
<journal-title-group>
<journal-title>International Journal of Healthcare Simulation</journal-title>
<abbrev-journal-title>International Journal of Healthcare Simulation</abbrev-journal-title>
</journal-title-group>
<issn publication-format="electronic">2754-4524</issn>
<publisher>
<publisher-name>Adi Health + Wellness</publisher-name>
<publisher-loc>London, UK</publisher-loc>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">ijaa035</article-id>
<article-id pub-id-type="doi">10.54531/DNZC8446</article-id>
<article-categories>
<subj-group subj-group-type="toc-heading"><subject>Short Reports on Simulation Innovations Supplement (SRSIS)</subject></subj-group>
</article-categories>
<title-group>
<article-title>Designing virtual reality experiences to supplement clinician Code Black education</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0003-2056-7955</contrib-id><name><surname>Moore</surname><given-names>Nathan</given-names></name><xref ref-type="aff" rid="AF0001"><sup>1</sup></xref><xref ref-type="corresp" rid="c1"/></contrib>
<contrib contrib-type="author"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0003-1818-1930</contrib-id><name><surname>Ahmadpour</surname><given-names>Naseem</given-names></name><xref ref-type="aff" rid="AF0002"><sup>2</sup></xref></contrib>
<contrib contrib-type="author"><name><surname>Brown</surname><given-names>Martin</given-names></name><xref ref-type="aff" rid="AF0003"><sup>3</sup></xref></contrib>
<contrib contrib-type="author"><name><surname>Poronnik</surname><given-names>Philip</given-names></name><xref ref-type="aff" rid="AF0003"><sup>3</sup></xref></contrib>
<contrib contrib-type="author"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0003-0861-9994</contrib-id><name><surname>Davids</surname><given-names>Jennifer</given-names></name><xref ref-type="aff" rid="AF0004"><sup>4</sup></xref></contrib>
</contrib-group>
<aff id="AF0001"><label>1</label>Digital Health Solutions, <institution>Western Sydney Local Health District</institution>, North Parramatta, <country>Australia</country></aff>
<aff id="AF0002"><label>2</label>Affective Interactions Lab, <institution>School of Architecture, Design and Planning, University of Sydney, Sydney</institution>, <country>Australia</country></aff>
<aff id="AF0003"><label>3</label>FMH Media Lab, Education Innovation, <institution>School of Medical Sciences, Faculty of Medicine and Health, University of Sydney</institution>, Sydney, <country>Australia</country></aff>
<aff id="AF0004"><label>4</label><institution>Research and Education Network, Western Sydney Local Health District</institution>, Westmead, <country>Australia</country></aff>
<author-notes>
<corresp id="c1"><bold>Corresponding author:</bold> Nathan Moore, <email>nathan.moore@health.nsw.gov.au</email></corresp>
</author-notes>
<pub-date pub-type="epub" iso-8601-date="2022-10-13"><day>13</day><month>10</month><year>2022</year></pub-date>
<volume>1</volume>
<supplement>SRSIS 1</supplement>
<fpage>S12</fpage>
<lpage>S14</lpage>
<permissions>
<copyright-statement>&#x00A9; The Author(s). 2022</copyright-statement>
<copyright-year>2022</copyright-year>
</permissions>
<self-uri xlink:title="pdf" xlink:href="ijaa035.pdf"/>
<custom-meta-group><custom-meta><meta-name>version</meta-name><meta-value>fulltext</meta-value></custom-meta></custom-meta-group>
</article-meta>
</front>
<body>
<sec id="s1"><title>Introduction</title>
<p>A fifth of healthcare professionals experience violence perpetrated against them every year by patients or their family members [<xref ref-type="bibr" rid="CIT0001">1</xref>]. In response to the violence and aggression challenges faced in the Western Sydney Local Health District (WSLHD), we conducted a study to identify clinician experiences to guide the restructuring of the Code Black response framework [<xref ref-type="bibr" rid="CIT0002">2</xref>]. This study revealed several challenges and limitations to the existing training processes which would require a complete restructuring, one of which was training delivery. Current training is resource intensive with clinicians facing long wait times to attend. Hence, 25% of those interviewed had not attended any training in violence management and prevention. Importantly, we identified key aspects of the training package that could be enhanced using virtual reality (VR)-based simulation.</p>
<p>We have been exploring the use of VR to supplement clinical educational processes in areas including Advanced Life Support [<xref ref-type="bibr" rid="CIT0003">3</xref>], Dignity in the Workplace and Clinical Communication. This body of research has resulted in a framework to guide the development of VR-based modules for clinical education based on key design factors [<xref ref-type="bibr" rid="CIT0004">4</xref>]. We identified key findings from our study [<xref ref-type="bibr" rid="CIT0004">4</xref>] to support Code Black training using VR-based simulations.</p></sec>
<sec id="s2"><title>Innovation</title>
<p>The Code Black VR course was developed to supplement the redesigned Code Black training programme delivered across WSLHD, deployed on the Meta Quest 2 headset (available from <ext-link ext-link-type="uri" xlink:href="https://store.facebook.com/au/quest/products/quest-2/">https://store.facebook.com/au/quest/products/quest-2/</ext-link>; Meta, California, USA) to be used both in the clinical setting and loaned out to clinicians. The Code Black VR course consists of four distinct approaches to VR-based education.</p>
<sec id="s3"><title>Flat-screen exemplar videos</title>
<p>Expert clinicians were filmed modelling gold standard de-escalation techniques with an actor demonstrating varying stages of violence and aggression. While these videos do not require VR, they provide compelling resources as the user is engaged with the application.</p>
<fig id="F1" position="float"><label>Figure 1:</label><caption><p>Interactive randomized 360-degree video with BOC chart.</p></caption><graphic mimetype="image" position="float" xlink:href="ijaa035_f0001.jpg"/></fig>
</sec>
<sec id="s4"><title>Passive 360-degree videos</title>
<p>Feedback from clinicians highlighted that some were unprepared for the first time they witnessed the co-ordinated physical and chemical restraint of a patient [<xref ref-type="bibr" rid="CIT0002">2</xref>]; 360-degree video allows the user to be at the centre of the scenario and were filmed from the perspective of a team member. This enabled the user to explore the planning of a Code Black response, physical and chemical restraint and post event debriefing with spatial fidelity.</p></sec>
<sec id="s5"><title>Interactive randomized 360-degree videos</title>
<p>Some staff interviewed felt that violent incidents &#x2018;came out of nowhere&#x2019; [<xref ref-type="bibr" rid="CIT0002">2</xref>]. As part of the Code Black rollout, a Behaviours of Concern (BOC) chart was deployed into practice to support the rapid standardized observation of patients to identify the risk of violence or aggression [<xref ref-type="bibr" rid="CIT0005">5</xref>]. We developed an innovative approach to train situational awareness and documentation using the BOC chart. Actors were hired to occupy beds in the Emergency Department at Westmead Hospital. These actors portrayed varying levels of aggression over an 8&#x2013;10 minute scene. Each two-bedded location was aligned with one of the lenses on the 360-degree camera. Those individual lenses were then isolated in post-production and spliced into two-minute segments. These two-minute segments were then set to &#x2018;auto splice&#x2019; together producing a randomized two-minute 360-degree video. An interactive BOC chart was embedded in the videos so real-time observations could be performed on the patient. Automated results report user performance post scenario completion (i.e. identified and missed behaviours of concern).</p></sec>
<sec id="s6"><title>Verbal de-escalation trainer</title>
<p>To allow clinicians to practice verbal de-escalation skills, a VR-based, artificial intelligence (AI)-driven conversational agent was created. The AI was developed with a back story of being a concerned family member whose father has chest pain but is yet to be seen by the doctor. The user can talk to the avatar, and the avatar becomes more or less agitated depending on what verbal input the user provides. User performance is recorded to provide immediate feedback after the simulation is completed.</p>
<fig id="F2" position="float"><label>Figure 2:</label><caption><p>VR-based, AI-driven verbal de-escalation trainer.</p></caption><graphic mimetype="image" position="float" xlink:href="ijaa035_f0002.jpg"/></fig></sec></sec>
<sec id="s7"><title>Evaluation</title>
<p>Formal evaluation of the project will be conducted as part of the broader research project in the coming months. User satisfaction will be determined using in-app and post-use surveys and interviews. Violence and aggression key performance indicators such as number of incidents, time in restraint and overall restraint use will also be reviewed post intervention.</p></sec>
<sec id="s8"><title>Outcomes</title>
<p>The 360-video components of the VR application have been piloted as part of the broader Code Black training programme. It has been well received by users with high levels of satisfaction verbally collected to date. The verbal de-escalation trainer is in the early stages of development, and we have conducted initial trials which were well received. The findings from these trials have provided guidance for further improvement and development before a broader release.</p></sec>
<sec id="s9"><title>What&#x2019;s next</title>
<p>Future steps of our VR-based Code Black solutions include:
<list list-type="bullet">
<list-item><p>Educational outcomes evaluation</p></list-item>
<list-item><p>Further development of user interface and user experience</p></list-item>
<list-item><p>Implementation of training modules within the simulation modules</p></list-item>
<list-item><p>Ongoing development of verbal de-escalation trainer</p></list-item>
<list-item><p>Digitization of situational awareness/BOC trainer to increase scenario scalability</p></list-item></list></p></sec>
</body>
<back>
<sec id="s10"><title>Declarations</title>
<sec id="s11"><title>Authors&#x2019; contributions</title>
<p>NM: Lead author, VR application design, testing and evaluation. NA: Manuscript revision, VR application supervision. MB: Manuscript revision, application design, testing and evaluation. PP: Manuscript revision, VR application supervision. JD: Manuscript revision, application design, testing and evaluation.</p></sec>
<sec id="s12"><title>Funding</title>
<p>None.</p></sec>
<sec id="s13"><title>Availability of data and materials</title>
<p>None.</p></sec>
<sec id="s14"><title>Ethics approval and consent to participate</title>
<p>None declared.</p></sec>
<sec id="s15"><title>Competing interests</title>
<p>None declared.</p></sec></sec>
<ref-list><title>References</title>
<ref id="CIT0001"><label>1.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Li</surname> <given-names>Y-L</given-names></string-name>, <etal>Li R-Q, Qiu D, Xiao S-Y.</etal></person-group> <article-title>Prevalence of workplace physical violence against health care professionals by patients and visitors: a systematic review and meta-analysis</article-title>. <source>International Journal of Environmental Research and Public Health</source>. <year>2020 Jan 1</year>;<volume>17</volume>(<issue>1</issue>):<fpage>299</fpage>.</mixed-citation></ref>
<ref id="CIT0002"><label>2.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Davids</surname> <given-names>J</given-names></string-name>, <etal>Murphy M, Moore N, Wand T, Brown M.</etal></person-group> <article-title>Exploring staff experiences: a case for redesigning the response to aggression and violence in the emergency department</article-title>. <source>International Emergency Nursing</source>. <year>2021 Jul</year>;<volume>57</volume>:<fpage>101017</fpage>.</mixed-citation></ref>
<ref id="CIT0003"><label>3.</label><mixed-citation publication-type="conf"><person-group person-group-type="author"><string-name><surname>Moore</surname> <given-names>N</given-names></string-name>, <etal>Yoo S, Ahmadpour N, Tommy R, Brown M, Poronnik P</etal></person-group> <article-title>ALS-SimVR: advanced life support Virtual Reality training application.</article-title> In: <conf-name>25th ACM Symposium on Virtual Reality Software and Technology</conf-name>. <year>2019 Nov 12</year>. <publisher-name>ACM Digital Library</publisher-name>.</mixed-citation></ref>
<ref id="CIT0004"><label>4.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Moore</surname> <given-names>N</given-names></string-name>, <etal>Yoo S, Poronnik P, Brown M, Ahmadpour N.</etal></person-group> <article-title>Exploring user needs in the development of a virtual reality-based advanced life support training platform: exploratory usability study</article-title>. <source>JMIR Serious Games</source>. <year>2020 May 29</year>;<volume>8</volume>(<issue>3</issue>):<fpage>e20797</fpage>.</mixed-citation></ref>
<ref id="CIT0005"><label>5.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Woods</surname> <given-names>P</given-names></string-name>, <string-name><surname>Almvik</surname> <given-names>R</given-names></string-name></person-group>. <article-title>The Br&#x00F8;set violence checklist (BVC)</article-title>. <source>Acta Psychiatrica Scandinavica</source>. <year>2002 Jun 18</year>;<volume>106</volume>(s412):<fpage>103</fpage>&#x2013;<lpage>105</lpage>.</mixed-citation></ref>
</ref-list>
</back>
</article>