Bettina_K_Peter_Seminar_NeuromorphicComputing.pdf

Neuromorphic Computing for Interactive Robotics: A Systematic Review is an in-depth analysis conducted by Bettina K Peter, guided by Professor Anchal J Vattakunnel at the College of Engineering Poonjar. This review covers the emerging field of neuromorphic computing, which aims to mimic the human brain's efficiency and complexity using spiking neural networks (SNNs). The document delves into various aspects of SNNs, including their learning mechanisms, architectures, and models such as Hodgkin-Huxley, Leaky Integrate-and-Fire, and Izhikevich. It also explores the applications of SNNs in robotics, highlighting their roles in signal acquisition, pattern recognition, speech recognition, motor control, and cognition. The review emphasizes the potential of neuromorphic hardware like TrueNorth and Braindrop chips, and simulators like Genesis and SpikeFun, in advancing robotics. Future directions include the development of more integrated systems, ethical considerations, and the need for interdisciplinary collaboration.

1. College of Engineering Poonjar
Neuromorphic Computing for Interactive
Robotics:
A Systematic Review
Bettina K Peter (PJR20CS005)
October 8, 2023
Guided by : Anchal J Vattakunnel(Professor in CSE)
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 1

2. College of Engineering Poonjar
Index
1Introduction
2Spiking Neural Network
Learning in SNN
SNN Architectures
SNN Models
SP Models
3Neuromorphic Chips/WWWWW/simulators and Frameworks
4SNNs In Robotics Applications
Signal Acquisition and Processing
Pattern Recognition
Speech Recognition
Motor Control
Cognition and Learning
5Future Direction
6Conclusion
7References
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 2

3. Introduction College of Engineering Poonjar
Introduction
The adulthuman brainruns continuously, whether awake or sleeping, on
only about12 wattsof power whereas a hypothetical clock-based
computer running a “human-scale”brain simulationrequires
approximately12 Gigawattof power.
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 3

4. Introduction College of Engineering Poonjar
Human Brain
”A single neuron in the brain is an incredibly complex machine that even
today we don’t understand.
A single ’neuron’ in a neural network is an incredibly simple mathematical
function that captures a minuscule fraction of the complexity of a
biological neuron.”
-AndrewNg
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 4

5. Introduction College of Engineering Poonjar
Neuromorphic Computing
To acquire more autonomy and operate in the real world, robots should:
1)perceivetheir environments in real-time
2)processsparse information with efficiency
3)behaveunder changing conditions
4)acquireself-learning ability
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 5

6. Introduction College of Engineering Poonjar
Definition
Neuromorphic computing(also known as brain-inspired computing) is a
multidisciplinary research paradigm that investigates large-scale processing
systems that support natural neuronal computations throughspike-driven
communication. Advantages of neuromorphic computing over traditional
approaches are:
energy
efficiency
execution speed
robustness
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 6

7. Introduction College of Engineering Poonjar
Neural Spike
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 7

8. Spiking Neural Network College of Engineering Poonjar
Generations Of NNs
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 8

9. Spiking Neural Network College of Engineering Poonjar
Application Of NNs
1st Gen NNs:
Basic Computations
Early AI Research
2nd Gen NNs:
Detection and Identification
Pattern Recognition
Function Approximation
Natural Language Processing
Image and Speech Processing
3rd Gen NNs:
Image Classification and
Object Recognition
Computer Vision and Robotics
Sensor Data Processing
Intelligent Systems with
Manipulators
Robotic Applications
Detection and Recognition
Tasks
Numerical Data Processing
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 9

10. Spiking Neural Network College of Engineering Poonjar
Working Of SNN
It aims tomimic the behavior of natural neuronsfound in the
brain.
Spikesare the fundamental currency of neural computation and
communication.
Neurons releaseneurotransmittersduring a spike, allowing them to
communicate with other neurons.
These networks takespike trainsas input and produce spike trains as
output.
When a neuron’sstate variable, surpasses a predefined threshold, it
sends a spike to each post-synaptic neuron.
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 10

11. Spiking Neural Network Learning in SNN College of Engineering Poonjar
History Of Learning
Synaptic plasticitywas first proposed as a mechanism for learning and
memory byD.O Hebbin 1949.
It is the change that occurs at synapses, the junctions between neurons
that allow them to communicate.
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 11

12. Spiking Neural Network Learning in SNN College of Engineering Poonjar
Types Of Learning
Unsupervised Learning
Spike-timing-dependent
plasticity (STDP)
Long Term Potentiation
(LTP) - Strengthening
synapses
Long-term Depression
(LTD) - Weakening synapses
Supervised Learning
Back-propagation
SpikeProp, FreqProp and
ReSuMe
Reinforced Learning
Actor-Critic Model
STDP Modulation
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 12

13. Spiking Neural Network SNN Architectures College of Engineering Poonjar
SNN Architectures
Figure:Feed Forward Neural
Network(FFNN)
Figure:Hybrid Neural Network
Structures
Figure:Recurrent Neural
Network(RNN)
Figure:Hybrid Neural Network
Architectures
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 13

14. Spiking Neural Network SNN Models College of Engineering Poonjar
SNN Models
1)HODGKIN-HUXLEY NEURON MODEL
First bio-inspired neural model.
Developed by Sir Alan Hodgkin and Sir Andrew Huxley in 1952.
This model describes how neurons initiate and propagate action
potentials.
The key equation relates membrane potential (Vm) to the current
(Iext) and membrane capacitance (Cm).
The iconic current (Iion) is composed of three main components:
sodium current, potassium current, and small leakage current.
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 14

15. Spiking Neural Network SNN Models College of Engineering Poonjar
SNN Models
2)LEAKY INTEGRATED-AND-FIRE (LIF) NEURON MODEL
Commonly used due to its simplicity.
Neurons have a membrane potential (Vm), and a threshold (Vth) for
generating spikes.
When Vm exceeds the threshold, an action potential (spike) is
generated.
Voltage is reset after a spike.
Described by a simple differential equation:
Intrinsic properties: Ve, Rm,τm; External current: Im; Vm.
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 15

16. Spiking Neural Network SNN Models College of Engineering Poonjar
SNN Models
3)IZHIKEVICH NEURON MODEL
Combines biological plausibility of Hodgkin-Huxley with
computational efficiency of integrate-and-fire (LIF) models.
Described by a 2-D system of differential equations:
Key variables:Vm, U (membrane recovery variable), Im.
Dimensionless variables a and b adjust the neuron behavior.
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 16

17. Spiking Neural Network SP Models College of Engineering Poonjar
Synaptic Plasticity Models
Rate-Based Models:
Common and use average
spike count over time.
Magnitude of synaptic
plasticity is determined by the
rate of pre- and post-synaptic
firing.
Backpropagation.
Experiments involving
robot-based sensory and
motor systems.
Spike-Based Models:
Consider the precise timing of
individual spikes.
Synaptic weight changes
based on the relative timing of
pre- and post-synaptic spikes.
STDP
Neural learning mechanisms in
robotics, both in simulations
and real environments.
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 17

18. Neuromorphic Chips/WWWWW/simulators and Frameworks College of Engineering Poonjar
Neuromorphic Hardware
Neuromorphic hardwareplays a critical role in enabling robots to
performcognitive tasks.
Recent advancements in bothneuroscienceand thechip industry
have led to the development of new neuromorphic hardware for
simulating SNNs.
The followingtablesprovide a brief overview of the key elements in
this field:
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 18

19. Neuromorphic Chips/WWWWW/simulators and Frameworks College of Engineering Poonjar
Table 1
Neuromorphic Chips:Specialized hardware designed for simulating
SNNs.
E.g: TrueNorth, Braindrop, SyNAPSE, FACETS, NeuroMem, NM500, and
SynSense.
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 19

20. Neuromorphic Chips/WWWWW/simulators and Frameworks College of Engineering Poonjar
Table 2
Simulators:Software tools used to simulate SNN behavior.
E.g: Genesis, SpikeFun, Mayavi and CSIM.
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 20

21. Neuromorphic Chips/WWWWW/simulators and Frameworks College of Engineering Poonjar
Table 3
Frameworks:Software platforms that provide tools and libraries for
developing and running SNN models.
Specific frameworks are not mentioned in the provided text.
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 21

22. Neuromorphic Chips/WWWWW/simulators and Frameworks College of Engineering Poonjar
Table 4
Robots:Robots used in socially interactive neurorobotics are discussed.
E.g: Pepper and Nao
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 22

23. Neuromorphic Chips/WWWWW/simulators and Frameworks College of Engineering Poonjar
Table 4
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 23

24. SNNs In Robotics Applications Signal Acquisition and Processing College of Engineering Poonjar
SNN Applications
A.Signal Acquisition and Processing in Robot Applications:
Intelligent sensors for autonomous planning and adaptation.
Combining vision and non-vision sensors for faster recognition.
Rast et al.: iCub robot and SpiNNaker system for object
identification.
Enhanced networks with behaviorally relevant STDP.
Multi-sensory processing for environment perception.
Convergence-zone model applied to multi-modal systems.
Al-Qaderi and Rad’s multi-modal system outperforms uni-modal on
Pioneer 3DX.
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 24

25. SNNs In Robotics Applications Pattern Recognition College of Engineering Poonjar
SNN Applications
B.Pattern Recognition Applications in Robotics:
Crucial for real-world robots and human-robot interactions.
Previous approaches needed strict supervision during training.
Fanello et al.: Improved robot vision with limited constraints.
Mansouri-Benssassi and Ye: Bio-inspired SNNs with unsupervised
STDP for facial expression recognition, outperforming other methods.
Al-Qaderi and Rad: Multi-modal system for efficient facial recognition
in real-world scenarios.
Cyr and Theriault: Robots learn and adapt behavior with different
rewarding rules.
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 25

26. SNNs In Robotics Applications Pattern Recognition College of Engineering Poonjar
SNN Applications
Real-time human motion recognition with SNNs and instructive
learning in three phases.
a)Teaching phase: learner visualize the target action.
b)Turn-taking phase: learner extract the nonverbal information.
c)Trial phase: learner confirms the target action
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 26

27. SNNs In Robotics Applications Speech Recognition College of Engineering Poonjar
SNN Applications
C.Speech Recognition Applications:
Vital for robots to understand spoken commands, especially in noisy
environments.
Embodied embedded cognition approach by Davila-Chacon, Liu, and
Wermter improves ASR systems in noisy settings.
Speech recognition can be used for neural layer training through
auditory grouping.
Spiking cerebellar model used for vestibulo-ocular reflex (VOR) tasks
with iCub robot.
Model employs adaptive real-time control loops and STDP for
generating eye motor commands during VOR tasks.
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 27

28. SNNs In Robotics Applications Speech Recognition College of Engineering Poonjar
SNN Applications
Sound Source Localization (SSL) used for accurate sound direction
detection and robot orientation.
SNN calculates sound signal angle, tested on iCub robot and
Soundman.
ASR with SSL significantly boosts speech recognition accuracy in
humanoid robots.
Figure:SSL Architecture
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 28

29. SNNs In Robotics Applications Motor Control College of Engineering Poonjar
SNN Applications
D.Motor Control Applications:
SNNs for pointing motions adaptable to various robots.
CPG and SNNs efficiently control robot gaits.
DMSNN guides robot arm motion by monitoring neuron firing.
SNNs enable soft-grasping and sEMG-based reflexes in robotic hands.
Multi-modal interface for remote robot control, aiding disabled and
elderly users.
Cognitive platforms based on SNNs model user-environment
interactions.
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 29

30. SNNs In Robotics Applications Motor Control College of Engineering Poonjar
SNN Applications
iQSA method integrates BCIs and SNNs for Hexapod robot
locomotion.
BCIs and evolving SNNs enable prosthetic hand control.
Applications extend to medical science, disability assistance, and
teleoperation systems.
Figure:Block diagram of prosthetic control through BCI
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 30

31. SNNs In Robotics Applications Cognition and Learning College of Engineering Poonjar
SNN Applications
E.Cognition and Learning Applications:
SNNs used forspatial memory, enhancing navigation and exploration.
It improves SLAM in social robots, creating accurate environmental
maps.
SNNs implementassociative and working memory, enhancing
cognitive abilities.
Episodic memoryenables robots to perform versatile cognitive tasks
using cognitive maps.
Emotion integrated into robot decision-making, considering intrinsic
motivation.
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 31

32. Future Direction College of Engineering Poonjar
Future Direction
*Humanoid Robots
*Neuromorphic Chips
*Hardware Optimization
*Personalization
*Generalized Framework
*Ethics
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 32

33. Conclusion College of Engineering Poonjar
Conclusion
Neuromorphic computing offers promise for human-like robotic
intelligence in terms of computation, speed, and energy efficiency.
Many articles focused on improving specific applications but lacked
full integration for more capable systems.
A universal training method and conversion mechanisms are essential
for advancing human-like social interactions in neurorobots.
Interdisciplinary collaborations, particularly between roboticists and
neuroscientists, are crucial for further development.
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 33

34. References College of Engineering Poonjar
References
[1] LiMin Fu. 1994. Neural Networks in Computer Intelligence.
McGraw-Hill, Inc., USA.
[2] Kumar Satish. 2004. Neural Networks : A Classroom Approach. New
Delhi: Tata McGraw-Hill.
[3] Hebb, D. O. 1949. The organization of behavior; a neuropsychological
theory. Wiley.
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 34

35. College of Engineering Poonjar
Bettina K Peter (PJR20CS005) Neuromorphic Computing for Interactive Robotics: A Systematic Review 35