Immersive Learning Environments and Co-intelligence

Slides for keynote at Web3D 2024, organized by ACM SIGGRAPH, Web3D Consortium, and CCG/ZGDV.
This talk will address how immersive learning environments are being used and their relationship to cointelligence, using generative artificial intelligences as intellectual partners. Immersion is approach as a phenomenon arising from spatial, narrative, and agency conceptual dimensions, showcasing how this framework supports the interpretation and design of educational experiences. Using recent research findings on educational strategies and practices with immersive environments, the talk will illustrate how to plan and implement immersive learning cases grounded in the literature. The discussion will highlight current research challenges, aiming to inspire innovative educational practices and future research directions.

1. September
25-27, 2024

2. September
25-27, 2024
Immersive Learning
Environments
and
Co-intelligence
Leonel Morgado
Full Professor
Universidade Aberta & INESC TEC

3. September
25-27, 2024
September
25-27, 2024
Big problems in
immersive learning research
How can we evaluate outcomes,
without the means to determine if
the instructional approaches and
contexts are comparable? How can we make
informed decisions,
without awareness of
what works and doesn’t?

4. September
25-27, 2024
September
25-27, 2024
Lousy technocentric research cycle
Outcomes
without
context
= pretext
RESULTS!
Positive effect!
Neutral effect!
Negative effect!
I’ll show
it is
harmful!
I’ll
show it
works!
Just comparing with tech vs. without tech…
Research the
combination:
Tech+
Pedagogy+
Setting
Tech
innovation!

5. September
25-27, 2024
September
25-27, 2024
The research approach error rollercoaster
Teaching
machines
ComputersProgramming
Edutainment
software
Serious
games
Immersive
Environments
…Artificial
Intelligence?

6. September
25-27, 2024
September
25-27, 2024
When subjects of an experimental
study improve or change their
behavior because it is being
evaluated or studied.
When subjects of an experimental
study improve or change their
behavior because it is being
evaluated or studied.
Novelty effects Hawthorne effect
“… if learning gains are due to novelty
effects, they tend to decrease over time as
student interest in the technology wanes.”
(Beck et al., 2024)
“… if learning gains are due to novelty
effects, they tend to decrease over time as
student interest in the technology wanes.”
(Beck et al., 2024)

7. September
25-27, 2024
September
25-27, 2024
The generative AIs of today are intellectual partners:
co-intelligences
Schlemmer & Morgado, 2024
https://doi.org/10.34627/redvol7iss1e202403
Schlemmer & Morgado, 2024
https://doi.org/10.34627/redvol7iss1e202403

8. September
25-27, 2024
September
25-27, 2024
Thus… Cognitive Ecosystems & Ecological Platforms
“The logic of education as being solely about humans gives
way to a logic of interconnection, interaction, and
interdependence among different entities, among different
intelligences.”
“The logic of education as being solely about humans gives
way to a logic of interconnection, interaction, and
interdependence among different entities, among different
intelligences.”
“Ecological Interaction Platforms will have to favor the
active participation of entities in a context where the human
being, connected to intelligences and various entities, is a
co-producer, a co-interpreter. A context where all entities
inhabit the cognitive ecosystem, where knowledge emerges
from the whole, in an atopic way, not from specific parts.”
“Ecological Interaction Platforms will have to favor the
active participation of entities in a context where the human
being, connected to intelligences and various entities, is a
co-producer, a co-interpreter. A context where all entities
inhabit the cognitive ecosystem, where knowledge emerges
from the whole, in an atopic way, not from specific parts.”
Schlemmer & Morgado, 2024
https://doi.org/10.34627/redvol7iss1e202403
Schlemmer & Morgado, 2024
https://doi.org/10.34627/redvol7iss1e202403

9. September
25-27, 2024
September
25-27, 2024
Which require novel software architectures
Inven!RA – an Architecture for
Sustainable Deployment of Immersive Learning Environments
and Ecological Platforms
Inven!RA – an Architecture for
Sustainable Deployment of Immersive Learning Environments
and Ecological Platforms
Schlemmer & Morgado, 2024
https://doi.org/10.34627/redvol7iss1e202403
Schlemmer & Morgado, 2024
https://doi.org/10.34627/redvol7iss1e202403
Morgado et al., 2023
http://hdl.handle.net/10400.2/13124
Morgado et al., 2023
http://hdl.handle.net/10400.2/13124

10. September
25-27, 2024

11. September
25-27, 2024
Wicked
problems
“elusive, complex, and
transforming in response to
the very intervention that
mistakenly aims to resolve
them directly”
Schlemmer & Morgado, 2024
https://doi.org/10.34627/redvol7iss1e202403
Schlemmer & Morgado, 2024
https://doi.org/10.34627/redvol7iss1e202403

12. September
25-27, 2024
September
25-27, 2024
STRUCTURED OBSERVATION
To the rescue…

13. September
25-27, 2024
September
25-27, 2024
STRUCTURED OBSERVATION
To the rescue…
Consideration of what WORKS
●In which specific contexts
●Under what conditions
●Through which processes
Consideration of what WORKS
●In which specific contexts
●Under what conditions
●Through which processes

14. September
25-27, 2024
For instance,
using instruments such as
the Immersive Learning Case Sheet
method
…bringing
theory into practice
Beck & Morgado (in press)
Describing and Interpreting an Immersive Learning Case
with the Immersion Cube and the Immersive Learning
Brain, iLRN 2024 Proceedings, Springer volume.
Beck & Morgado (in press)
Describing and Interpreting an Immersive Learning Case
with the Immersion Cube and the Immersive Learning
Brain, iLRN 2024 Proceedings, Springer volume.

15. September
25-27, 2024
Or such as…
our custom GPT
QUAL-E Immersive Learning
Thematic Analysis Helper
…to jointly generate knowledge
with AIs across communities.
https://chatgpt.com/g/g-LcesDN88c-qual-e-immersive-learning-thematic-analysis-helper
Morgado & Beck, 2024
http://hdl.handle.net/10400.2/16096
Morgado & Beck, 2024
http://hdl.handle.net/10400.2/16096

16. September
25-27, 2024
But where to begin?But where to begin?
https://www.immersivelrn.org/initiatives/knowledge-tree/ The Knowledge Tree board:The Knowledge Tree board:
Dennis
Beck
USA
Dennis
Beck
USA
Leonel
Morgado
Portugal
Leonel
Morgado
Portugal
Anasol
Peña-Rios
UK
Anasol
Peña-Rios
UK
Scott
Warren
USA
Scott
Warren
USA
Jonathan
Richter
USA
Jonathan
Richter
USA
Christian
Gütl
Austria
Christian
Gütl
Austria
Ken
Bigger
USA
Ken
Bigger
USA
Daphne
Economou
UK
Daphne
Economou
UK
Andreas
Dengel
Germany
Andreas
Dengel
Germany
Minjuan
Wang
China
Minjuan
Wang
China

17. September
25-27, 2024
September
25-27, 2024
BirdsBirds
LeavesLeaves
The Immersive Learning
Knowledge Tree
The Immersive Learning
Knowledge Tree
RootsRoots
TrunkTrunk
SoilSoil
BranchesBranches
How can we evaluate
outcomes, without the means
to determine if the
instructional approaches and
contexts are comparable?
How can we evaluate
outcomes, without the means
to determine if the
instructional approaches and
contexts are comparable?
How can we make informed
decisions, without confidence
on what works and doesn’t?
How can we make informed
decisions, without confidence
on what works and doesn’t?
Beck et al., 2021
http://hdl.handle.net/10400.2/10867
Beck et al., 2021
http://hdl.handle.net/10400.2/10867

18. September
25-27, 2024
ImmersionImmersion
Immersive LearningImmersive Learning
Immersive EnvironmentsImmersive Environments
RootsRoots
Morgado & Beck, 2020
http://hdl.handle.net/10400.2/9799
Beck, Morgado & O’Shea, 2020
http://hdl.handle.net/10400.2/10070
Morgado & Beck, 2020
http://hdl.handle.net/10400.2/9799
Beck, Morgado & O’Shea, 2020
http://hdl.handle.net/10400.2/10070
DefinitionsDefinitions

19. September
25-27, 2024
RootsRoots
Morgado & Beck, 2020
http://hdl.handle.net/10400.2/9799
Morgado & Beck, 2020
http://hdl.handle.net/10400.2/9799
DefinitionsDefinitions

20. September
25-27, 2024
September
25-27, 2024
Narrative
Agency
System
RootsRoots
Nilsson etal., 2016
Agrawal etal., 2019
Morgado & Beck, 2024
http://hdl.handle.net/10400.2/15670
Nilsson etal., 2016
Agrawal etal., 2019
Morgado & Beck, 2024
http://hdl.handle.net/10400.2/15670
DefinitionsDefinitions

21. September
25-27, 2024
September
25-27, 2024
Why is this important?Why is this important?
2009Plausibility illusion is determined by
the extent to which the system can
produce events that directly relate
to the participant, the overall
credibility of the scenario being
depicted in comparison with
expectations.
Plausibility illusion is determined by
the extent to which the system can
produce events that directly relate
to the participant, the overall
credibility of the scenario being
depicted in comparison with
expectations.
What about Social immersion?
What about Emotional immersion?
What about Flow?
What about Social immersion?
What about Emotional immersion?
What about Flow?
“What matters is
feeling there!”
“What matters is
feeling there!”
“But I know more
immersion
dimensions that are
not there!”
“But I know more
immersion
dimensions that are
not there!”
Nilsson etal., 2016Nilsson etal., 2016

22. September
25-27, 2024
September
25-27, 2024
Mapping uses to the three
dimensions of immersion01
Mapping practices to
strategies by using specific
criteria
02
●Theoretical affinity
●Co-occurrence
●Co-citation
●Etc.
RootsRoots
MethodsMethods
Beck, Morgado & O’Shea, 2024
https://bit.ly/ImmersiveEduStrat
Beck, Morgado & O’Shea, 2024
https://bit.ly/ImmersiveEduStrat
Beck, Morgado & O’Shea, 2020
http://hdl.handle.net/10400.2/10070
Beck, Morgado & O’Shea, 2020
http://hdl.handle.net/10400.2/10070

23. September
25-27, 2024
September
25-27, 2024
Narrative
Agency
System
RootsRoots
InstrumentsInstruments
Gaspar etal., 2020
http://hdl.handle.net/10400.2/8444
Gaspar etal., 2020
http://hdl.handle.net/10400.2/8444
Morgado etal., 2023
http://hdl.handle.net/10400.2/15129
Morgado etal., 2023
http://hdl.handle.net/10400.2/15129

24. September
25-27, 2024
September
25-27, 2024
Soil
A working group of scholars
have been meeting regularly for
authoring the ontological and
epistemological structure.
The
Immersive
Learning
Brain
SoilSoil
Beck, Morgado & O’Shea, 2024
https://bit.ly/ImmersiveEduStrat
Beck, Morgado & O’Shea, 2024
https://bit.ly/ImmersiveEduStrat

25. September
25-27, 2024
September
25-27, 2024
Mapping of the research:
●educational strategies and
practices with immersive learning
●uses of immersive environments
"State of XR and Immersive Learning”
Delphi report
●2021 https://bit.ly/3Ku3Gqg
●2024
Scientometric awareness
●Who is the community?
TrunkTrunk
Gaspar etal., 2020
http://hdl.handle.net/10400.2/8444
Gaspar etal., 2020
http://hdl.handle.net/10400.2/8444
Beck, Morgado & O’Shea, 2024
https://bit.ly/ImmersiveEduStrat
Beck, Morgado & O’Shea, 2024
https://bit.ly/ImmersiveEduStrat
Beck, Morgado & O’Shea, 2020
http://hdl.handle.net/10400.2/10070
Beck, Morgado & O’Shea, 2020
http://hdl.handle.net/10400.2/10070

26. September
25-27, 2024
September
25-27, 2024
1) The fields of inquiry

2) the research priorities and agendas
Research Agenda for
Immersive Learning 2030
(RAIL.2030)
20
23
Research priorities in immersive
learning technology
BranchesBranches
Gaspar etal., 2020
http://hdl.handle.net/10400.2/8444
Gaspar etal., 2020
http://hdl.handle.net/10400.2/8444
Dengel etal., 2023
http://hdl.handle.net/10400.2/15128
Dengel etal., 2023
http://hdl.handle.net/10400.2/15128

27. September
25-27, 2024
September
25-27, 2024
iLRN Houses of Application
https://elegant-centaur-92b59c.netlify.app/
https://bit.ly/3yKYEmT
ILB visualization
Recommendation
tool for immersive
learning
LeavesLeaves

28. September
25-27, 2024
September
25-27, 2024
WE ALL are
the BIRDS!
●Researchers
●Practitioners
●Communicators
●Learners
BirdsBirds

29. September
25-27, 2024
You can
participate!
- there are already several
volunteers involved
https://qrs.ly/1leymkg