“Scaling Vision-based Edge AI Solutions: From Prototype to Global Deployment,” a Presentation from Network Optix

For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/06/scaling-vision-based-edge-ai-solutions-from-prototype-to-global-deployment-a-presentation-from-network-optix/

Maurits Kaptein, Chief Data Scientist at Network Optix and Professor at the University of Eindhoven, presents the “Scaling Vision-based Edge AI Solutions: From Prototype to Global Deployment” tutorial at the May 2024 Embedded Vision Summit.

The Embedded Vision Summit brings together innovators in silicon, devices, software and applications and empowers them to bring computer vision and perceptual AI into reliable and scalable products. However, integrating recent hardware, software and algorithm innovations into prime-time-ready products is quite challenging. Scaling from a proof of concept—for example, a novel neural network architecture performing a valuable task efficiently on a new piece of silicon—to an AI vision system installed in hundreds of sites requires surmounting myriad hurdles.

First, building on Network Optix’s 14 years of experience, Professor Kaptein details how to overcome the networking, fleet management, visualization and monetization challenges that come with scaling a global vision solution. Second, Kaptein discusses the complexities of making vision AI solutions device-agnostic and remotely manageable, proposing an open standard for AI model deployment to edge devices. The proposed standard aims to simplify market entry for silicon manufacturers and enhance scalability for solution developers. Kaptein outlines the standard’s core components and invites collaborative contributions to drive market expansion.

1. Scaling Vision-Based Edge AI
Solutions: From Prototype to
Global Deployment
prof.dr. Maurits Kaptein
Chief Data Scientist
Network Optix

2. The edge “Video+AI” revolution is just getting started
2© 2024 Network OptixInc.

3. Video+AIcan be beneficial in virtually every vertical
3© 2024 Network Optix Inc.

4. However, as we all know, realizing solutions at scale is a
challenge..
4
60%
“Hardware required
is too costly.”
57%
“Development is too
costly.”
57%
“Hardware is too
power hungry.”
Source: Edge AI and Vision Alliance, Computer Vision Developer Survey, November 2023
“In Situations Where You Would Like To Use Computer Vision/Perceptual AI But Are Not, What Is Preventing You?”
© 2024 Network Optix Inc.

5. Scaling video only solutions is a challenge in its own right
5© 2024 Network OptixInc.
CONNECTING TO VIDEO
SOURCES
MANY HARDWARE CHOICES
MANAGEMENT &
DEPLOYMENT
ARCHIVING & DATA-
MANAGEMENT
CLOUD
CONNECTIVITY
CROSS PLATFORM
ACCESSIBILITY
ALERTS & EVENTS ROUTING
DIGITAL RIGHTS &
MONETIZATION
VISUALIZATION AT SCALE

6. Scaling Video+AIpresents renewed challenges
6© 2024 Network OptixInc.
PIPELINE DEVELOPMENT AI ACCELERATION INFERENCE MANAGEMENT

7. •Technology core:
•Conversionof the model's generic ONNX
specification to a format that can run on the
accelerator. The OAAX toolchain.
•Runningthe specific model specification,
i.e., generating inference.The OAAX
runtime.
•Organization:
•An open initiative (akin ONVIF) with the aim to
build an accredited standard.
•Starting first focus groups summer 2024.
Standardizing the AI acceleration process: OAAX
7© 2024 Network OptixInc.
AI ACCELERATION

8. Contribute, visit, and join us!
2024 Embedded Vision Summit
Building and Scaling AI Applications with the
NxAI Manager, Robert von Emden
Exhibit Hall—ET-1 Wed, May 22 at 2:40 pm
NxEVOS: A New Enterprise Operating System
for Video and Visual AI, Nathan Wheeler
Exhibit Hall—ET-2 Thur, May 23 at 12:00 pm
Visit us at our booth —Booth #304
8
Nxtoolkit for video+AI
Nxtools:
https://www.networkoptix.com/nx-meta
OAAX standard
https://oaax.org
OAAX white-paper
https://www.networkoptix.com/blog/2024/03/05/int
roducing-the-open-ai-accelerator-standard
OAAX code examples and references:
https://github.com/oaax-standard
© 2024 Network Optix Inc.

9. Questions and Answers
Text your questions to [phone]
MauritsKaptein
Network Optixand
University of Eindhoven