Cognitive Test VR

1.  Overview

 

This VR application tests and trains the user’s cognitive ability, providing three unique challenges which target different mental areas. Each challenge immerses the user in a unique environment and guides them through a fun and engaging task which seamlessly assesses performance.

 

2.  Description of the application

Application Overview 

 

This application is a VR based psychometric assessment tool. Tasks for this software were designed in coherence with the categories utilised by the British Army Cognitive Test: Orientation, Error Detection, and Word Rules. Upon completion of a task, feedback is provided, and the following challenge is loaded. The game like nature and visual appeal of the software makes it enticing to play and replay, encouraging better performance and strengthening the mental capacity of the user.

 

The significance of the application in the context of cognitive tests

 

The British Army Recruit Battery Test (BARB) is a benchmark cognitive test used to determine the suitability of an individual for different roles within the army. It tests mental areas including: Orientation, error detection, word rules, numeracy fluency, deductive reasoning. Real world cognitive tests such as this utilising traditional interfaces are limited in the experience they can provide and are often arduous, time consuming and provide little incentive to train, replay or hone ability.

 

The challenges in this application are variation or reimagining’s of those seen in the BARB test. In the design process, focus was placed on overcoming the limitations of conventional cognitive tests by adapting them into entertaining, intuitive, repayable yet still challenging games. This shifts the focus from blatant word-based test to visual appealing and entertaining games. The gamification of these challenges makes the process of assessment more seamless. The user is immersed in the play experience, which for some may help ease the nerves surrounding assessment and the negative impacts that may have on their performance. For most people, this makes for an overall more enjoyable and approachable experience. 

The significance of VR interface technology in this context

 

This software seeks to provide a more entertaining, engaging, seamless experience for those undergoing cognitive assessment. This is not the case for tests utilising conventional interfaces. Using VR as a platform for this software helps realise these goals and expands the possibilities for challenge creation and level design.

 

• VR is still largely considered a new technology and in this field is yet to meet the mainstream. For many, VR is an exciting and unique experience, this would add to the engaging and entertaining aspects of this software.
• Users are used to the affordance of operating and physically interacting with objects in a 3D space, thus, the tasks are more naturally intuitive, and the goal/controls can be made apparent with few prompts.

Research conducted by a team at the Institute of Psychiatry, Psychology & Neuroscience at King’s College London, suggests that operating test in a virtual environment stimulates a greater range of the cognitive domain and may therefore outperform conventional assessments (Health Europa, 2022). This suggests that placing these test in a VR environment may result in a more accurate representation of a user’s full cognitive ability.

 

3.  Interaction Design 

Orientation Challenge

• Hold hand triggers on VR controller and point to interact with buttons on doorways.
• If correct path, doorways will open leading to next room. If incorrect, player is sent to game over screen.

Error Detection Challenge

• Player is given 6sec to memorise shapes, colour, and order.
• New shapes are displayed, and player is prompted to assess how many of these have changed from the previous.
• Use Left/Right index triggers to Decrement/Increment guess.
• Press both hand triggers simultaneously to submit answer.

Word Rule Challenge

• Player must memorise word rule.
• When objects relating to these categories are displayed again press any trigger. Reaction time will be assessed.
• If correct answer is missed, player fails challenge.

Storyboard

 

4.  Technical Development

Specific interface and technologies utilised

Virtual Reality Oculus headset is used for the primary output device and input interface for this software. The three challenges take advantage of this software in differing ways.

• Orientation utilises the 3D space of VR, the player can move through this space engaging with the objects in an intuitive way in the environment.
• Error detection and Word Rule take advantage of 3D audio and immersive visuals creating a soothing ambience in which the player undergoes their test.

This app runs on VR for increased accessibility and transportability. This test can be undergone in any location.  

Using VR allows for “human-like” input lowering the need for tutorial text and potentially reducing input latency due to human-machine interface disconnect (Furness III, 2001).

 

How to engage with available interaction

Primary Input: Index triggers

• Next challenge, when prompted
• Submit answer (word rule)

Secondary Input: Hand triggers

• Finger press buttons (orientation)
• Submit answer (error detection)

5.  Descriptions of 3D Models

3D models utilised

Deer - https://poly.pizza/m/T6Cs7tmMHJ

Alpaca - https://poly.pizza/m/bCVFD48i2l

Bull - https://poly.pizza/m/a8PIIYwF7r

Boombox - https://poly.pizza/m/720CVmivNcu

Prism - https://poly.pizza/m/CR3jvgbeXi

Arrow - https://poly.pizza/m/1TUCDmHZKQY

Door - https://poly.pizza/m/8it1hH1oRu

Trees - https://assetstore.unity.com/packages/3d/vegetation/trees/free-trees-103208?aid=1100liZev&utm_campaign=unity_affiliate&utm_medium=affiliate&utm_source=partnerize-linkmaker

6.  References

No AI was used for this project.

Orientation – Dark ambient Sound Effect

Error Detection – Macintosh Plus

Word Rule – Forest sound effect for editing for free

Bibliography

Anon., 2020. Dark Ambient Sound Effect - Eerie Background. [Sound Recording] (Free Audio Zone). https://www.youtube.com/watch?v=g0yQmVGla5U&t=1s&ab_channel=FreeAudioZone

Anon., 2021. Forest sound effect for editing for free. [Sound Recording] (Nature sounds for relaxation). https://www.youtube.com/watch?v=VxrH8mUWyGc&ab_channel=Naturesoundsforrelaxation

Furness III, T. A., 2001. Toward tightly-coupled human interfaces. Seattle: University of Washington.

Health Europa, 2022. [Online] Available at: https://www.healtheuropa.com/vr-test-may-transform-the-future-of-cognitive-asses... [Accessed 18 September 2023].

Vektroid, 2011. MACINTOSH PLUS - リサフランク420 / 現代のコンピュー. [Sound Recording]. https://www.youtube.com/watch?v=aQkPcPqTq4M&ab_channel=ChocolateGinger