Agora VR


VR Therapy of Agoraphobia

and Social Anxiety Disorders

[ utgers Capstone Group S20-61 ]
Aryeh Ness - Daniel Nguyen - Ted Moseley - Michael Truong
Dr. Grigore Burdea

Review

Utilizing the Oculus Quest, our solution will immerse the patient within a virtual environment that dynamically adapts to the stage of treatment, severity of the disorder, realtime integrated biosensor readings, and external inputs from a clinician and caregiver. With our product, we plan to provide an alternative, more effective treatment option for those who suffer from Agoraphobia and social anxiety disorders.

Our Previous Goals


  • Virtual Scenarios in Immersive Environments
  • Multiplayer Support
  • Crowd Artificial Intelligence
  • Stress Monitoring & Tracking
  • Simulation Footage Streaming & Playback
  • Patient & Therapist Portal
  • Clinical Research Study & Research Paper

Our Updated Goals


  • Public Speaking Scenarios (Auditorium & Meeting Room)
  • Animated Reactive People & Dynamic Sessions
  • Bluetooth Low Energy Heartrate Monitor
  • Tracking & Storing Data From Session
  • Patient & Therapist Portal

    Aryeh Ness


      Clinical Research Study & Protocol
      General Research
      3D Modeling (Meeting Room)

    Daniel Nguyen


      Art, Design & Presentation
      Unity Development & Oculus Quest Integration
      3D Modeling (Auditorium)
      Hardware Integration (Android Plugin & Unity)

    Ted Moseley


      Database, Server & Backend
      Website & Access Portal
      Data Collection
      Hardware Communications (Arduino Code & Algorithms)

    Michael Truong


      Data Tracking & Collection
      Audio Recording & Speech Recognition
      Unity Development

Design & Status

Two virtual scenarios involving public speaking:

[1] Auditorium Presentation
[2] Meeting Room Presentation

*Blender Rendering
These scenarios will include distractions caused by AI characters.


Yawning Animation Example
Heart Rate Monitoring and SpO2 levels


Hardware Showcase Images
Tracking Session Data:

  • Eye Contact with audience members
  • Volume level, pause in speech
  • Distracted by an audience
  • Hand movement and shakey hands (common symptom)
  • Need to meet a certain performance requirement before increasing difficulty
Audio Recording:
Agora VR Web Portal

Web Portal Graphs

Demo

Project Implementation

Project Challenges


  • Hardware Issues
  • Time constraint (limited to two scenarios)
  • Approval of clinical research study and paper
  • COVID-19