Contributions
Environment Design & Spatial Planning
Co-led the digital vortex room concept to emphasise the potential of the experience (This course was a small part of larger module expansion to aid in funding from investors)
Visual Communication & Direction
Produced concept art and mood boards to communicate visual direction and assist in client buy in
Supported stakeholder presentations by creating compelling visual material
User flow & Storyboarding
Created storyboards outlined entire cardiac exam flow
mapped interaction flow and sequences for team alignment
UI/UX Systems
Collaborated with designer on UX planning, especially regarding interface flow and interaction accessibility
Developed visual design and implemented in Unity
Problem
Medical students have limited access to in-person training material
VR enabled students to familiarise themselves with physical exams that can be repeated and changed using a number of different patient use cases
Challenges
highly accurate hand placement for palpation and auscultation, tactile haptic feedback for nuanced heart rhythms and intuitive exam flow (e.g. talking to the patient and capturing results)
Solution
Delivered an application with all requested features such as:
Scoring logic
learn, practice and assessment modes
Multiplayer logic
Key Features
Gesture based examination flow for increased realism
Responsive stethoscope placement logic using sound and haptics
Augmentation of symptom checking using subtle visual effects and UI markers
VO narrative and tooltip guidance
outcome
VR training simulation with increased clinical realism
Students reported improved confidence in cardiac exam flow and increased recall of heart sound locations