IVE 2024 Short Course - Lecture16- Cognixion Axon-R

IVE 2024 Short Course Lecture16 on the Cognixion Axon-R head mounted display.

This lecture was given as part of the IVE 2024 Short Course on the Psychology of XR held at the University of South Australia.

It ws given on Friday July 19th 2024 by Chris Ullrich from Cognixion.

1. Cognixion Axon-R
Realtime Biosignals for Augmented Reality

2. Integrating Neural Data into
VR/AR is expensive, difficult
and unreliable. Until now.
1.Prototype Limitations: Custom-
built solutions increase costs,
time and complexity, hindering
study speed and validity.
2.Isolated Systems: Solutions
limited to isolating displays with
monitors and an emphasis on
VR.
3.Complex Systems:  Existing
systems with difficult
integrations, long set-up times
and steep learning curves.
4.Clinical Compatible Equipment:
Difficulty in obtaining patient
safe, medical-grade hardware. 
5.Space Constraints: Conducting
study outside a lab setting is
extremely difficult and limited.
©2024 Proprietary and Confidential. International Patents Issued & Pending. All Rights Reserved. 2

3. Cognixion is making it EASIER
To setup, develop, test, and deploy neural data acquisition for XR applications
Conceptualization and Initial
Research                                  
Experiment Definition                        
Device Evaluation & Procurement
Development & Prototyping         
Experimentation and Data Collection
  Data Analysis & Troubleshooting 
Summation of Findings  
Publication and Dissemination 
©2024 Proprietary and Confidential. International Patents Issued & Pending. All Rights Reserved. 3
We solved the problem for ourselves. And
are now making our internal innovation
available to you.

4. Our Solution for Integrating BCI + Generative AI + Spatial Computing
Axon-R the complete platform for Multimodal Healthcare & Advanced HMI Research
BCI STUDIO™
DENDRITE™ BIPOLAR CABLE FOR
EXTENDED EMG, ECG/EKG, EOG, EEGNUCLEUS™ NEURAL HUB™AXON-R™ BCI + AR HEADSET
©2024 Proprietary and Confidential. International Patents Issued & Pending. All Rights Reserved. 4

6. Method of Operation
Axon-R enables precise measurement and modulation of brain activity through
visual stimuli, biofeedback, and neurofeedback
AR Display
Visual stimuli is presented to the subject eliciting response
Biosignal Input
Primary: EEG signals are collected on the occipital area of the subject
using the electrode headband. 
Secondary: Expanded optional data collection such as Headpose
and  ExG* with the optional  DENDRITE™ CABLE 
Biosignal Processing
Collected data is ingested in the off body NUCLEUS™ NEURAL HUB™
and sent as raw data for computation
On-Device Compute
Biosignal data is processed and classified on-device with the
Cognixion BCI classifier
Wireless Data Stream
Data streamed wirelessly though LSL channels and saved on a
laboratory computer for application integration and/or further
analysis 
1
2
3
4
5
©2024 Proprietary and Confidential. International Patents Issued & Pending. All Rights Reserved. 7

7. BCI Studio™
API Based Configurator: JSON/REST API based
configuration using Postman or Python.
LSL Stream: LSL streams with raw, filtered and
classified data for easy integration.
Impedance Check: Integrated Impedance check
to ensure data integrity across all experiments.
Expanded Support: Supportfor integration and
dataflows with: Python, AcqKnowledge, Intheon
Neuropype, Openvibe and Unity
©2024 Proprietary and Confidential. International Patents Issued & Pending. All Rights Reserved.8
API BASED CONFIG
LSL STREAM
IMPEDENCE CHECK

8. Off-Device
Python 
Support for off-device
Python integration
and dataflows.
Out of the box compatibility with your current workflows and data pipelines
Software Integrations & Architecture
Unity 3D Game
Engine
The Axon-R OS (Android)
presents as a Unity
development target. Port or
build your Unity apps to
Axon-R for immersive
neural integration.
OpenVibe
Create and run custom
applications, along with pre-
configured and demo
programs. Sample scenes
included.
©2024 Proprietary and Confidential. International Patents Issued & Pending. All Rights Reserved. 9
BIOPAC
AcqKnowledge
Direct device
integration into
AcqKnowledge -
compatible with other
BIOPAC lab systems.
Lab Streaming
Layer (LSL)
All sensor data presents as
LSL channels over WiFi
2kHz/channel.
Intheon
Creators of the popular
NeuroPype and NeuroScale
that simplify the process of
multi-modal analysis and
make data science
accessible to more people. 

10. Sources of Value
ImmersiveNeurophysiology-focused System: Onlypurpose-built fully AR device with
uniqueon-device ssVEP classifier system. 
Untethered Research Versatility: Wearable and fully portable form factor allows for in-
field and diverse environment studies.
Multimodal System: 6+2 EEG Cable and Din 8 ExG accessory for diverse placement and
use.
Medical-Grade Components: research-backed medical-grade components
Patient-Centric Design: Focus on safety and comfort, suitable for various medical
conditions and positions (laying down etc.)
Lab Grade Signal Quality: ensuringquality and consistency that includes a built in
impedance check across all channels. 
LSL Integration: Offers comprehensive data streams over WiFi for seamless analysis and
across 16channels of sensor data at 2kHz samples per second.
No-Code SDK: BCI Studio™ enables easy, rapid development without deep programming
knowledge.
Robust SW Support: Python, Intheon, and AcqKnowledge, as well as Unity support for
developing custom XR applications.
1
2
3
4
5
6
7
8
9
©2024 Proprietary and Confidential. International Patents Issued & Pending. All Rights Reserved. 12

11. Where can this platform be used?
Translational Research & Innovative Applications
Education &Training
Entertainment and
Immersive Experiences
Emotional States &
Measuring Affect
Clinical Diagnostics
& Rehabilitation
Wellness &
Mental Health
Assistive Tech
for Daily Living
Accessibility
Visual, Auditory
Attention
©2024 Proprietary and Confidential. International Patents Issued & Pending. All Rights Reserved. 13

12. Leading The Way
Unmatched Relationships & Influence
Over 50 international patents
FDA Breakthrough Designation for medical version
Leading Healthcare & Research Organizations
Leading Big Tech companies
US Delegate for International Standards
Customers
Research
Strategics
Standards
&
Advocates
Integrations
©2024 Proprietary and Confidential. International Patents Issued & Pending. All Rights Reserved. 14

13. Sensor Fusion: Merge Other Data into Axon-R
Blurring the lines between invasive and non-invasive, unlocking the future of healthcare
©2024 Proprietary and Confidential. International Patents Issued & Pending. All Rights Reserved. 15

14. Use Cases Examples
Passive, Adaptive and Active BCI
1.
2.
 Overlay device controls using AR and enable BCIbased selection.      
Exploratory Areas: Hands-free controls, Accessibility device control for
(ALS, CP, Stroke, etc), Prosthetic limb control, machinery control.  
Use Case Examples: 
In manufacturing settings, users can controlmachinery or access information
through ARusing only their thoughts.
Allow individuals to adjust room lighting, call forassistance, or even control
TV/entertainment systems through thoughts.        
Human-Computer Interaction 
©2024 Proprietary and Confidential. International Patents Issued & Pending. All Rights Reserved. 16

15. Use Cases Examples
Passive, Adaptive and Active BCI
1.
2.
Use in clinical diagnostics, rehabilitation, andmonitoring of
neurological conditions.
 Exploratory Areas: Stroke rehab, epilepsy diagnostic and monitoring,
cognitive rehabilitation, degenerative retinal diseases. 
Use Case Examples
For stroke patients, combine EEG readings with AR-guided physical tasks,
allowing the patient to interact with and move virtual objects, aiding in
motor recovery.
Continuous monitoring of brain activity inpatients with conditions like
epilepsy, autism, providing valuable data tohealthcare providers.
Medical and Clinical Research
©2024 Proprietary and Confidential. International Patents Issued & Pending. All Rights Reserved. 16

16. Use Cases Examples
Passive, Adaptive and Active BCI
1.
2.
3.
Enhancing learning experiences and operationaltraining.
 Exploratory Areas: Adaptive learning materials, skill acquisition, and
language learning.  
Use Case Examples
AR study material that dynamically adjustscomplexity or provides
additional details when the EEG detects a user isconfused or has lost
concentration.        
For professionals learning a new language orskill, an AR interface
provides hints or translations when confusion isdetected.
In technical settings, provide context-awareinformation and (optionally)
translate technical jargon.        
Educational and Training Tools
©2024 Proprietary and Confidential. International Patents Issued & Pending. All Rights Reserved. 16

17. Use Cases Examples
Passive, Adaptive and Active BCI
1.
2.
Addressing mental health through brain wellnessexercises and mood
tracking.
Exploratory  Areas: Stress management, meditation, mood
assessment, and brain training games.
Use Case Examples: 
AR tasks/games that help users train theirability to focus or shift attention.
(Lumosity)
Users can get real-time feedback on their brainstates during meditation and
visualize their progress using augmented reality(AR) visual cues.        
Wellness and Mental Health
©2024 Proprietary and Confidential. International Patents Issued & Pending. All Rights Reserved. 16

18. Use Cases Examples
Passive, Adaptive and Active BCI
1.
2.
Enhancing safety in high-risk areas & jobs through monitoring and
adaptive controls.
Exploratory Areas: Fatigue detection, focus detection automated
safetyresponses, and smart device integrations.
Use Case Examples: 
AR warnings or signals for workers in hazardousenvironments, adapting
based on fatigue or distractibility detected by theEEG.
 If an individual is detected to be incapacitatedor under extreme stress,
automated systems could be activated for safety.        
Safety and Prevention
©2024 Proprietary and Confidential. International Patents Issued & Pending. All Rights Reserved. 16

19. Use Cases Examples
Passive, Adaptive and Active BCI
1.
2.
Creating immersive and personalized entertainmentexperiences.
 Exploratory Areas: Adaptive gaming, mood-based mediacontrol, and
interactive virtual environments.
Use Case Examples
AR games that change and adapt based on theuser's emotional state or
level of concentration, providing an immersiveexperience.
Play music, video or soundscapes by just thinkingabout a specific mood
or genre. 
Entertainment and Personalization
©2024 Proprietary and Confidential. International Patents Issued & Pending. All Rights Reserved. 16

20. Use Cases Examples
Passive, Adaptive and Active BCI
1.
Investigating brain functions, cognitive processes,and neural
responses.
Exploratory Areas: Memory, attention, perception, and cognitive load. 
Use Case Examples
Axon-R serving as a mobile lab reducing the need for dedicated spaces
and rooms to conduct research.  
Neuroscience and Cognitive Research
©2024 Proprietary and Confidential. International Patents Issued & Pending. All Rights Reserved. 16

21. AR +Brain-ComputerInterface Research continues to rapidly grow 
Human-Computer
Interaction 
Medical and Clinical
Applications
Safety and Prevention
Educational and
Training Tools
Wellness and Mental
Health
Entertainment and
Personalization
©2024 Proprietary and Confidential. International Patents Issued & Pending. All Rights Reserved. 17
Angrisani, Leopoldo & Arpaia, Pasquale & De Benedetto, Egidio & Duraccio, Luigi & Regio, Fabrizio & Tedesco, Annarita. (2023). Wearable Brain–Computer Interfaces
Based on Steady-State Visually Evoked Potentials and Augmented Reality: A Review. IEEE Sensors Journal. PP. 1-1. 10.1109/JSEN.2023.3287983. 

22. Axon-R makes impossible things possible: 
Neural AR interface for Mobility Controls for people with SCI, TBI,
Quadriplegia, Stroke, ALS/MND, amputated limbs,
speech paralysis or dysarthria.

23. Device ControlVisual Stimuli Classification

24. Axon-R makes impossible things possible:
Personalized AI+Neural Speech Prosthesis for
Stroke, TBI, ALS, Parkinsons & Other Disabilities

25. Order Axon-R
Unlock the Power
of Neural Data in
your AI and AR
initiatives.
Standard
Advanced
Elite
Cognixion One Axon-R with
WiFi & Bluetooth; Indoor Lens
Bipolar Cable with 8 Additional
Channels for ExG Sensing
(ECG, EMG, EOG)
Extended Warranty, Platinum
Support
BCI Studio™
AR Templates, Online
Resources, Customer Support
Tinted Outdoor Lens
©2024 Proprietary and Confidential. International Patents Issued & Pending. All Rights Reserved. 21

26. Shipping Now 
Worldwide
North America
Shipping Late 2024

27. Hardware:
1. Axon-R™ BCI headset
2. Nucleus™ Neural Hub™
3. Dendrite™ Cable 
©2024 Proprietary and Confidential. International Patents Issued & Pending. All Rights Reserved. 24