Introduction to Internet of Things

IoT Architecture
Embedded Systems
IoT Applications
IoT Research Challenges
IoT Middleware Platforms

1. Sayed Chhattan Shah Associate Professor Department of Information Communications Engineering Hankuk University of Foreign Studies Korea www.mgclab.com The Internet of Things

2. The Internet of Things IoT is simply a concept wherein machines and everyday objects are connected via Internet The thing refers to all the things that can be connected to Internet Door locks Lights Household appliances Car Clothes IoT refer broadly to extension of network connectivity and computing capability to objects, devices, sensors, and items not ordinarily considered to be computers

3. Source: GIV 2025 Unfolding the Industry Blueprint of an Intelligent World More than 9 billion IoT devices are connected to the Internet Number of IoT connected devices is projected to increase to 43 billion by 2023 The Internet of Things

4. The Internet of Things The architecture of IoT is divided into three basic layers Perception layer is used to collect data Network layer provide data transmission services Application layer deliver application specific services to users

5. IoT Communications Models Device-to-device communications The device-to-device communication model represents two or more devices that directly connect and communicate between one another These devices communicate over many types of networks, including IP networks or Internet. This communication model is commonly used in applications like home automation systems

6. IoT Communications Models Device-to-cloud communications IoT device connects directly to an Internet cloud service This approach frequently takes advantage of existing communications mechanisms like traditional wired Ethernet or Wi-Fi connections to establish a connection between the device and the IP network, which ultimately connects to the cloud service

7. IoT Communications Models Device-to-gateway model There is application software operating on a local gateway device, which acts as an intermediary between the device and the cloud service and provides security and other functionality such as data or protocol translation

8. The Internet of Things The concept of combining computers and networks to monitor and control devices has been around for decades Systems for remotely monitoring meters on the electrical grid via telephone lines were in commercial use in late 1970 IP enabled toaster that could be turned on and off over the Internet was featured at an Internet conference in 1990

9. The technologies enabling the Internet of Things

10. The Internet of Things Sensors Sensors perform some input functions by sensing or feeling the physical changes in characteristics of a system in response to a stimuli Converts a non-electrical input into an electrical signal that can be sent to an electronic circuit Visual Sensor Ultrasound Sensor Infrared Sensor

11. The Internet of Things Analog sensors Analogue sensors produce a continuous output signal or voltage which is generally proportional to the quantity being measured. Physical quantities such as temperature, speed, pressure, displacement, and strain are all analogue quantities as they tend to be continuous in nature.

12. The Internet of Things Digital sensors Digital sensors produce a discrete digital output signals or voltages that are a digital representation of the quantity being measured Digital sensors produce a binary output signal in form of logic 1 or logic 0

13. The Internet of Things Active sensors Emit energy of their own and then sense the response of the environment to that energy Radio Detection and Ranging (RADAR) Passive sensors Passive sensors simply receive energy that is produced external to the sensing device A standard camera is embedded with a passive sensor—it receives signals in the form of light and captures them on a storage device

14. The Internet of Things Sensor types Sensor description Examples Position A position sensor measures the position of an object Potentiometer Proximity sensor Occupancy and motion Occupancy sensors detect the presence of people and animals in a surveillance area, while motion sensors detect movement of people and objects Electric eye RADAR Velocity and acceleration Velocity sensors indicates how fast an object moves along a straight line or how fast it rotates. Acceleration sensors measure changes in velocity. Accelerometer Gyroscope Force Force sensors detect whether a physical force is applied and whether the magnitude of force is beyond a threshold. Force gauge Touch sensor Pressure Pressure sensors are related to force sensors and measure the force applied by liquids or gases. Pressure is measured in terms of force per unit area. Barometer Piezometer Source: Deloitte analysis

15. The Internet of Things Sensor types Sensor description Examples Flow Flow sensors detect the rate of fluid flow. They measure the volume or velocity of fluid that has passed through a system in a given period of time. Mass flow sensor Water meter Acoustic Acoustic sensors measure sound levels and convert that information into digital or analog data signals. Microphone Hydrophone Humidity Humidity sensors detect humidity (amount of water vapor) in the air or a mass. Hygrometer Soil moisture sensor Light Light sensors detect the presence of light Infrared sensor Photodetector Flame detector Radiation Radiation sensors detect radiations in the environment. Radiation can be sensed by scintillating or ionization detection. Scintillator Neutron detector Source: Deloitte analysis

16. The Internet of Things Sensor types Sensor description Examples Temperature Temperature sensors measure the amount of heat or cold that is present in a system. They can be broadly of two types: contact and non-contact. Contact temperature sensors need to be in physical contact with the object being sensed. Non-contact sensors do not need physical contact, as they measure temperature through convection and radiation. Thermometer Temperature gauge Chemical Chemical sensors measure the concentration of chemicals in a system. Breathalyzer Smoke detector Biosensors Biosensors detect various biological elements such as organisms, tissues, cells, enzymes, antibodies, and nucleic acids. Blood glucose biosensor Electrocardiograph List of sensors Source: Deloitte analysis

17. The Internet of Things Actuator Actuator is a device that converts an electrical signal into action , often by converting the signal to nonelectrical energy, such as motion A simple example of an actuator is an electric motor that converts electrical energy into mechanical energy

18. The Internet of Things Actuator Types Hydraulic Pneumatic Electrical Thermal Mechanical

19. The Internet of Things Things in IoT usually refers to IoT devices These devices Exchange data with other connected devices and applications Send the data to centralized servers or cloud-based application for processing Perform some tasks locally and other tasks within the IoT infrastructure

20. The Internet of Things There are three primary factors driving the deployment of sensor technology Cheaper sensors Smart sensors: global average sales price 2010-2020, Statista Research Department, Dec 2020 The price of sensors has consistently fallen over the past several years

21. The Internet of Things Smarter sensors A sensor is a part of a larger system that comprises microprocessors, modem chips, power sources, and other related devices. Over the last two decades, microprocessors’ computational power has improved. Smaller sensors There has bee n a rapid growth in the use of smaller sensors that can be embedded in smartphones and wearables.

22. The Internet of Things Enabling network technologies Personal area network Local area network Wide area network Bluetooth Bluetooth Low Energy ZigBee Wi-Fi Wi-Fi WiMAX WiMAX LoRa 4G (LTE) 5G

23. The Internet of Things Bluetooth Low Energy Wi-Fi Z-Wave ZigBee LTE-M NB-IoT LoRa Range 10 m – 1.5 km 15 m – 100 m 30 m – 50 m 30 m – 100 m 1 km – 10 km 1 km – 10 km 2 km – 20 km Throughput 125 kbps to 2 Mbps 54 Mbps to 1.3 Gbps 10 kbps to 100 kbps 20 kbps to 250 kbps Up to 1 Mbps Up to 200 kbps 10 kbps to 50 kbps Power Consumption Low Medium Low Low Medium Low Low Topology P2P Star Mesh Broadcast Star Mesh Mesh Mesh Star Star Star Module Cost ~ 5 USD ~ 10 USD ~ 10 USD 8 ~ 15 USD 8 ~ 20 USD 8 ~ 20 USD 8 ~ 15 USD source: https://www.bluetooth.com/blog/wireless-connectivity-options-for-iot-applications/

24. The Internet of Things Factors driving adoption within the IoT Data rates Source: Deloitte analysis

25. The Internet of Things Factors driving adoption within the IoT Internet transit prices The price charged by an Internet service provider (ISP) to transfer data from one point in the network to another Power efficiency Availability of power-efficient networks such as BLE is critical given the increase in the number of connected devices Source: Deloitte analysis

26. The Internet of Things Data analysis tools and technologies Extracting insight from data requires analysis Source: Deloitte analysis

27. The Internet of Things Analysis is driven by cognitive technologies Computer vision Ability of computers to identify objects, scenes, and activities in images Natural-language processing Ability of computers to work with text the way humans do, extracting meaning from text or even generating text that is readable Speech recognition Speech recognition focuses on accurately transcribing human speech

28. Introduction to Embedded Systems Computers we are familiar with: Desktops Laptops Servers Mobile phones

29. Introduction to Embedded Systems Computers that are often hidden in environment for which they are created Refrigerator Air conditioner MR System

30. Introduction to Embedded Systems An embedded system is a computer system that has a dedicated function within a larger mechanical or electrical or biological system Embedded within other system Computers other than desktop, laptop, and server machines A microcontroller-based system that is designed to control a function or range of functions, and is not meant to be programmed by the end user User may make choices concerning the functionality but cannot change them User cannot make modifications to the software or program

31. Introduction to Embedded Systems

32. Introduction to Embedded Systems Some common characteristics of embedded systems Perform a specific task or a small set of tasks Reactive and real-time Continually reacts to changes in the system’s environment Many embedded systems must perform tasks in real-time Soft real time Hard real time Tight constraints on Cost Energy Size Memory

33. Introduction to Embedded Systems Basic hardware components Sensor measures physical quantity A-D converter converts analog signal sent by sensor into a digital signal Processor processes the data Memory stores data and instructions D-A converter converts digital data fed by processor to analog data Actuator responsible for moving and controlling a mechanism or system

34. Introduction to Embedded Systems Software Components Firmware is a computer program typically stored in a non-volatile memory embedded in a hardware device Firmware is not meant to be modifiable by users, although some systems could provide means of performing upgrades

35. Introduction to Embedded Systems Processors are broadly classified into 3 major categories General Purpose Microprocessors Microcontrollers Digital Signal Processors

36. Introduction to Embedded Systems Microprocessor It is basically entire CPU fabricated on a single chip It consists of a set of registers to store temporary data It consists of an ALU and CU It consists of some mechanism to interface with external devices such as memory and IO through buses

37. Introduction to Embedded Systems Microcomputer It is a computer system build using microprocessor Since microprocessor does not contain memory and IO, we have to interface these to build a microcomputer

38. Introduction to Embedded Systems Microcontroller A computer on a single chip

39. Introduction to Embedded Systems Digital Signal Processor It is a specialized microprocessor chip, with its architecture optimized for the operational needs of digital signal processing Digital signal processors are widely used in audio signal processing, telecommunications, digital image processing, radar, sonar and speech recognition systems, and in common consumer electronic devices such as mobile phones, disk drives and high-definition television (HDTV) products source: https://en.wikipedia.org/wiki/Digital_signal_processor A typical digital processing system

40. McKinsey Global Institute describes the broad range of potential applications in terms of settings where IoT is expected to create value for industry and users. Applications of IoT

41. Apple Smart Watch GPS ECG Blood oxygen level All day activity tracking and sleep monitoring High and low heart rate notifications  The Internet of Things https://www.apple.com/lae/watch/

42. Smart Diapers A diaper and smartphone app for monitoring child's health. Diapers have patches at the front with several colored squares that change color as they react to different compounds, such as water content, proteins or bacteria. Sensors read the data and send it to a physician. The Internet of Things http://iotlineup.com/

43. Smart Home Several environmental, video, audio, and bio sensors are deployed to observe the home environment and physiological health of an individual. The data collected by sensors are sent to an application where numerous algorithms for emotion and sentiment detection, activity recognition and situation management are applied to provide healthcare- and emergency-related services and to manage resources at the home. Credit CC0 Public Domain The Internet of Things

44. Next generation hospital management system

45. The Internet of Things https://www.lgcns.com/En/platform/SmartFactory-Factova Smart Factory is a highly digitized shop floor that continuously collects and shares data through connected machines, devices, and production systems. The data can then be used by self-optimizing devices or across the organization to proactively address issues, improve manufacturing processes and respond to new demands.

46. Warehousing Operations

47. Freight Transportation Internet of Things in Logistics: A collaborative report by DHL and Cisco on implications and use cases for the logistics industry

48. The Internet of Things Smart grid is a next-generation electrical grid that features a variety of ICT-based smart functions aimed at providing high-quality electricity while maximizing energy efficiency

49. The Internet of Things Smart building is any structure that uses automated processes to automatically control the building’s operations including heating, ventilation, air conditioning, lighting, security and energy. A smart building uses sensors, actuators and microchips, in order to collect data and manage it according to a business’ functions and services.

50. Smart city put data and digital technology to work to make better decisions and improve the quality of life More details

51. Device Management Discovery, Monitoring, and Control Interoperability Device Data Applications Network Scalability Data collection and storage Research Challenges

52. Energy Efficiency Many IIoT applications need to run for years on batteries. Failure Management Security and Privacy Real-Time Performance The industrial internet of things and Smart health Research Challenges

53. Middleware is software that provides common services to applications beyond those available from the operating system Types of middleware Message-oriented middleware enables application components using different messaging protocols to communicate to exchange messages Remote procedure call middleware enables one application to trigger a procedure in another application Data or database middleware simplifies access to, and interaction with, back-end databases. Device middleware provides a focused set of integration and connectivity capabilities for developing apps for a specific mobile OS Robotics middleware simplifies the process of integrating robotic hardware, firmware and software from multiple manufacturers and locations IoT Middleware

54. Key Middleware Requirements Resource Discovery, Monitoring, Configuration, and Control Interoperability Data Management Event Notification Services Scalability Reliability High Availability and Disaster Recovery Real-time Services Security and Privacy IoT Middleware Requirements

55. AWS IoT provides the cloud services that connect your IoT devices to other devices and AWS cloud services AWS IoT Architecture diagram of AWS IoT Core components

56. Device Registry keeps track of all of your devices Device SDK helps you easily and quickly connect your hardware device or your mobile application to cloud Device Gateway serves as the entry point for IoT devices connecting to AWS. It provides bi-directional communication, so not only receiving data from devices but also sending it back out to devices Message Broker is a high throughput pub-sub message broker that securely transmits messages to and from all of your IoT devices and applications with low latency. Authentication and Authorization Service ensures that data is never exchanged between devices and AWS IoT Core without a proven identity AWS IoT https://aws.amazon.com/iot-core/features/?pg=ln&sec=hs

57. Device Shadow is a virtual representation of your device in the cloud. It includes the device’s latest state so that applications or other devices can read messages and interact with the device. Device Shadow persists the last reported state and desired future state of each device even when the device is offline. Rules Engine evaluates inbound messages published into AWS IoT Core and transforms and delivers them to another device or a cloud service, based on business rules you define. IoT Device Management helps track, monitor, and manage device fleets for hundreds of thousands to millions of devices. AWS IoT Core for LoRaWAN enables customers to connect wireless devices that use LoRaWAN technology. AWS IoT https://aws.amazon.com/iot-core/features/?pg=ln&sec=hs

58. Azure IoT solutions involve things that generate data, insights that you form about the data, and actions that you take based on the insights Azure IoT Reference Architecture https://docs.microsoft.com/en-us/azure/architecture/reference-architectures/iot

59. Azure IoT Reference Architecture https://docs.microsoft.com/en-us/azure/architecture/reference-architectures/iot

60. Devices Azure IoT supports a large range of devices, from microcontrollers running Azure RTOS and Azure Sphere to developer boards like MX Chip and Raspberry Pi Devices might perform some local processing or just connect directly to central system Azure IoT Hub is a cloud gateway service that enables secure bidirectional communication from a variety of devices. It also include device management with command and control capabilities, and entity store that can be used to store device metadata IoT Hub Device Provisioning Service is used for registering and connecting large sets of devices Azure Digital Twins enables virtual models of real world systems Azure IoT Reference Architecture https://docs.microsoft.com/en-us/azure/architecture/reference-architectures/iot

61. Insights Once devices have been connected in the cloud, their data can be processed and explored to gain custom insights about their environment At a high level there are three ways to process data Hot path analyzes data in near-real-time as it arrives. The output may trigger an alert, or be written to a structured format that can be queried using analytical tools Warm path analyzes data that can accommodate longer delays for more detailed processing Cold path performs batch processing at longer intervals Azure IoT Reference Architecture https://docs.microsoft.com/en-us/azure/architecture/reference-architectures/iot

62. Actions You can use the insights gathered about your data to manage and control your environment Business integration actions might include storing informational messages, raising alarms, sending email, or SMS messages Power BI connects to, models, and visualizes your data Azure Maps allows you to create location aware web and mobile applications Azure Cognitive Search provides a search service over varied types of content Azure Web Apps enables you to deploy web applications that scale with your organization Mobile Apps allows you to build cross platform and native apps for Android, Windows, or Mac Azure IoT Reference Architecture https://docs.microsoft.com/en-us/azure/architecture/reference-architectures/iot