ppt_seminar_c hristy.pdf

jfc,vh,jhvv,hv

1. Augmented Reality Enriching Educational
Exploration in Virtual Laboratories
CHRISTYLAZAR ANTONY
(LCEC20CS084)
Guided By:
Mrs Rohitha R
DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING
COLLEGE OF ENGINEERING CHERTHALA
July 8, 2024

2. Overview
1INTRODUCTION
2OBJECTIVES
3AUGMENTED REALITY
4GOAL OF AR
5REALITY TYPES
6CONCEPT
7COMPONENT FOR AR TO WORK
VUFORIA ENGINE
UNITY 3D
8IMPLEMENTATION
9APPLICATION OF AR
10FUTURE SCOPE
11CONCLUSION
12REFERENCES

3. INTRODUCTION
Augmented Reality (AR) is a technology that overlays
graphics on the real world, creating a direct link between the
physical world and electronic information.
It is often mistaken for Virtual Reality (VR), but AR
incorporates the real world with physical information overlay.
AR is responsible for successful user experiences in popular
applications like online shopping catalogues and has main uses
like facial recognition, geolocation, object recognition, and
phone tracking.
AR continues to grow and is being developed for various
industries, including entertainment, education, and
entertainment.

4. OBJECTIVES
The main objectives are
Enhancing STEM Education with AR: The primary objective
is to enhance STEM (Science, Technology, Engineering, and
Mathematics) education by integrating Augmented Reality
(AR) technology into virtual labs.
AR facilitates collaborative learning by enabling students to
participate in shared virtual labs, irrespective of geographical
limitations, fostering idea exchange and understanding among
instructors.

5. OBJECTIVES(CONTD..)
The paper delves into the practical applications of Augmented
Reality (AR) in virtual labs, focusing on its use in various
fields such as medicine, physics, and engineering design.
Concluding the Potential Impact: The final objective is to
conclude that the integration of AR and virtual labs has the
potential to revolutionize STEM education, offering students
a more engaging and interactive learning experience.
Safety: Virtual labs with AR reduce the risks associated with
traditional physical labs. There are no dangerous chemicals or
equipment mishaps, making it a safer learning environment.

6. AUGMENTED REALITY
What is Augmented reality?
A combination of a real scene
viewed by a user and a virtual
scene generated by a computer
that augments the scene with
additional information.

7. GOAL OF AR
Enhancing User Experience: AR seeks to improve the user’s
interaction with their surroundings by providing additional context,
information, or interactivity. It enhances how people perceive and
engage with the real world.
Improving Learning and Training: AR is used in education and
training to provide immersive and interactive learning experiences.
It helps learners understand complex concepts and practice skills in
a safe environment.
Overall, the goal of augmented reality is to create a seamless and
immersive interaction between the physical and digital worlds,
enriching human experiences, solving real-world problems, and
driving innovation across various sectors.

8. REALITY TYPES
Augmented Reality
Mixed Reality
Virtual Reality
Extended Reality

9. AR VS VR VS MR
Types of Reality can be represented as shown in the figure

10. AR VS VR VS MR
Augmented reality (AR)— designed to add digital elements over
real-world views with limited interaction.
Virtual reality (VR)— immersive experiences helping to isolate
users from the real world, usually via a headset device and
headphones designed for such activities.
Mixed reality (MR)— combining AR and VR elements so that
digital objects can interact with the real world, means businesses
can design elements anchored within a real environment.
Extended reality (XR)— covering all types of technologies that
enhance our senses, including the three types previously mentioned.

11. AR IN VIRTUAL LABS
Augmented Reality (AR) technology into Virtual Labs

12. CONCEPT
The project aims to use Augmented Reality to create an
application that simplifies understanding of the Cathode Ray
Oscilloscope’s workings.
Developed using Unity 3-D and Vuforia Augmented Reality
Software Development Kit, the application overlays the workings of
various knobs and switches, such as Amplitude, Time Knob,
Channel Select, Invert, and X-Y position buttons, on the user’s
device’s screen when viewed through the AR application’s camera.

13. COMPONENTS FOR AR TO WORK
Sensors:
AR relies on sensors to understand the environment around it.
Using a combination of GPS, accelerometers, and gyroscopes, AR
apps can figure out exactly where you are and what direction
you’re facing.
From there, they can superimpose digital content on top of the
real world. In any case, without sensors, AR wouldn’t be possible.

14. COMPONENTS FOR AR TO WORK(CONTD..)
Algorithms:Augmented Reality (AR) in virtual labs uses
computer vision and tracking algorithms to enhance user
interaction with virtual objects and the real-world environment.
Marker Tracking:Marker-based AR systems use algorithms to
detect and track predefined markers or fiducial markers in the
user’s environment. These markers help anchor virtual objects in
the real world and are often recognized using computer vision
techniques like image recognition and pose estimation.

15. COMPONENTS FOR AR TO WORK(CONTD..)
SLAM (Simultaneous Localization and Mapping):
SLAM is essential for mobile AR applications.
It involves algorithms that enable a device to simultaneously create
a map of its environment and determine its position within that
map.
This allows virtual objects to be placed accurately in real-world
space.

16. COMPONENTS FOR AR TO WORK(CONTD..)
Hardware:
The core components of any AR-based tool are the processor,
sensors, input devices, and mainly the display.
The display could be a smartphone, handheld device, smart
glasses, or the head-mounted displays(HMD).
The input devices are either cameras or webcams. Sensors included
gyroscope and accelerometer.
Mobile devices have all the required specification to run an AR
application.

17. COMPONENTS FOR AR TO WORK(CONTD..)
Software:
Special pieces of software like D’Fusion are integrated into the
AR-based applications.
The overlapping of digital projection over a real-life object is
possible by leveraging using 3D software.
These array of software are available for computers, and the
smartphone app already comes with all the default package.

18. COMPONENTS FOR AR TO WORK(CONTD..)
Output devices:
They provide the user with information about the virtual world
created.
The most common output device is a head-mounted display
(HMD).
AR technology requires lightweight output devices that deliver
high-resolution images and video without causing undue strain on
the user’s neck or eyes.

19. VUFORIA ENGINE
Vuforia Engine
Vuforia Engine is a popular augmented reality (AR) development
platform that enables developers to create AR applications for a
wide range of industries and use cases.
Vuforia Engine is developed and maintained by PTC (formerly
Qualcomm’s Vuforia division) and is known for its robust and
reliable AR tracking and recognition capabilities.
Vuforia Engine is an AR platform that enables real-time recognition
and tracking of 2D images, 3D objects, and smart terrain.

20. VUFORIA ENGINE(CONTD..)
It is particularly useful in industries like manufacturing and
maintenance, where AR applications can interact with physical
objects or products.
Vuforia also supports multi-target detection, allowing developers to
create complex AR interactions.
Vuforia offers cloud-based recognition services, allowing developers
to manage and update target databases remotely.

21. VUFORIA ENGINE(CONTD..)
It is often integrated with Unity’s game development engine,
making it accessible to a wide range of developers.
Vuforia Engine supports multiple platforms, including iOS,
Android, and UWP, making it versatile for mobile and mixed
reality applications.
Vuforia also provides analytics tools for monitoring user
interactions and engagement with AR content.

22. UNITY 3D
Unity 3D
Unity3D, commonly referred to as Unity, is a widely-used and
highly versatile cross-platform game engine and development
environment.
While it is known primarily for game development, Unity is also
utilized for creating various other interactive 2D and 3D
applications, simulations, and experiences across multiple industries
Unity is a powerful platform for developers, offering cross-platform
development, an intuitive visual editor, and a Scripting language
that supports C, JavaScript, and Boo.

23. UNITY 3D(CONTD..)
Unity’s built-in physics engine allows for realistic simulations,
collision detection, and character controllers, making it suitable for
both 2D and 3D games.
It supports advanced graphics features like real-time rendering,
shaders, lighting, and particle systems, making it a popular choice
for VR and AR development.
Unity also offers networking solutions for multiplayer and online
games, allowing developers to create real-time, networked
experiences.

24. UNITY 3D(CONTD..)
It supports both 2D and 3D animations, including skeletal
animations, blend trees, and state machines.
It also provides collaboration tools and version control integration,
allowing multiple developers to work on the same project
simultaneously.

25. HOW DOES AR WORK??

26. IMPLEMENTATION
A. IMPORT THE AR CAMERA
The first and foremost task is to import the AR camera from the
Vuforia engine to your scene in Unity 3-D.This is a special camera
which supports AR application for both handheld and eye-ware
devices.
The task of the AR camera is to detect the image target and its
features, and can be imported from Game Object
≫VuforiaEngine≫ARcamera.

27. IMPLEMENTATION(CONTD..
Image of CRO

28. IMPLEMENTATION(CONTD..
Image target CRO uploaded to the database

29. IMPLEMENTATION(CONTD..)
B. SELECTING THE IMAGE TARGET AND UPLOADING
IT TO THE DATABASE:
The image target, which in this case will be the Cathode Ray
Oscilloscope, has to be uploaded to Vuforia Target manager.
The engine will detect and track the image and compare some
extracted features to the image in the database.
Therefore, one has to make sure that the image is crystal clear and
can ensure this by looking at the rating given by the Target
manager when an image is uploaded.

30. IMPLEMENTATION(CONTD..
Extracted features of the CRO displayed in yellow

31. IMPLEMENTATION(CONTD..
C. OVERLAYING OBJECTS ON IMAGE TARGETS:
Different objects can such as images, videos, text, 2-D and 3D
figures can be over layed on the image targets.
In our application, we will use images which will have the working
of the specific button or knob written on it and will overlay it
beside that button.
These images are uploaded to the resources folder which resides
inside the assets folder and are dragged and placed in the scene at
the position beside the targeted button

32. IMPLEMENTATION(CONTD..
Description of certain knobs of CRO in the application

33. APPLICATION OF AR
AR has great application in many of the fields, for example:
1) AR shopping apps have become increasingly popular, allowing
users to virtually try on clothing, shoes, accessories, and even
makeup products.
2) AR is being massively used in the gaming industry so as to
provide the consumer with better and more immersive gaming
experience.
3) It also finds important application in military as it can be used
in detecting malicious things and for practice purpose too.

34. APPLICATION OF AR
EDUCATION
Education: AR can be used in education to create interactive
learning experiences. For example, AR apps can display 3D models
of historical artifacts, anatomical structures, or celestial bodies,
making learning more engaging and informative.
MEDICAL FIELD
AR is now used in the field of medical and it’s application is not
limited to MRI but it also has application during operation where it
can help reduce the need for more traditional invasive cameras and
probes.

35. FUTURE SCOPE
This is a simple implementation of Augmented Reality to solve the
problems of Virtual Labs of a specific device. This can further be
extended to all the devices of any laboratory.
Advanced Simulations:
Future developments in AR technology will lead to more advanced
simulations that closely mimic real-world laboratory environments,
allowing for increasingly complex experiments.
Personalized Learning:
AR will enable personalized learning experiences, adapting content
and experiments to individual student needs, learning styles, and
progress.

36. FUTURE SCOPE
Professional Training:
Beyond traditional education, AR in virtual labs will find
applications in professional training, particularly in fields such as
healthcare, engineering, and manufacturing, where hands-on
experience is crucial.
Interdisciplinary Research:
AR virtual labs will encourage interdisciplinary research by allowing
students and researchers from diverse fields to collaborate on
experiments and projects.

37. CONCLUSION
A new AR application, developed using Unity 3D and Vuforia,
allows students to learn the workings of a Cathode Ray
Oscilloscope in virtual labs.
The app, accessible on various mobile devices, simplifies the
process of organizing virtual labs, making it easier for teachers and
students to understand and apply practical concepts.
Augmented Reality (AR) in virtual labs offers immersive,
interactive, and accessible learning experiences across various
subjects and industries.

38. CONCLUSION
Its future holds promise for enhancing learning outcomes, fostering
global collaboration, integrating artificial intelligence, expanding
subject areas, and facilitating professional training.
It aligns with sustainability efforts, promotes inclusivity, and drives
technological innovation.

39. REFERENCES
1
based on augmented reality with android platform and its
applicability,” 2018 3rd International Conference On
Internet of Things: Smart Innovation and Usages
(IoT-SIU), Bhimtal, India, 2018, pp. 1-5, doi:
10.1109/IoT-SIU.2018.8519853.
2
based on augmented reality with android platform and its
applicability,” 2018 3rd International Conference On
Internet of Things: Smart Innovation and Usages
(IoT-SIU), Bhimtal, 2018, pp. 1-5, doi:
10.1109/IoT-SIU.2018.8519853.
3
Augmented Reality in Real TimeApplications.8.
537-542.10.35940/ijrte.B10100.0782S719

40. REFERENCES
4
Reality 3D Discrepancy Check in Industrial Applications,”
2016 IEEE International Symposium on Mixed and
Augmented Reality (ISMAR), Merida,2016, pp. 125-134,
doi: 10.1109/ISMAR.2016.15.
5
learning tool for elementary school using augmented
reality,” 2014 International Conference on Industrial
Automation, Information and Communications
Technology, Bali, 2014, pp. 145- 148, doi:
10.1109/IAICT.2014.6922112
6
TRENDS, AND FORECASTS (2020 - 2025), Industry
report, Mordor Intelligence, Hyderabad, India

41. THANK YOU