“Building Meaningful Products Using Complex Sensor Systems,” a Presentation from DEKA Research & Development

For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/09/building-meaningful-products-using-complex-sensor-systems-a-presentation-from-deka-research-development/

Dirk van der Merwe, Autonomous Robotics Lead at DEKA Research & Development, presents the “Building Meaningful Products Using Complex Sensor Systems” tutorial at the May 2024 Embedded Vision Summit.

Most complex sensor systems begin with a simple goal—ensuring safety and efficiency. Whether it’s avoiding collisions between vehicles or predicting future actions, the essence remains the same: can we control, predict and mitigate risks effectively? While stating this goal is straightforward, achieving it is usually quite challenging. Often, challenges stem from the complexity of the system, inherent limitations of sensors and algorithms and mismatched timescales between sensors and algorithms.

In this talk, van der Merwe explores the key challenges in engineering complex sensor-based systems and outlines effective strategies for overcoming these challenges based on decades of real-world experience. He focuses on four critical areas: system engineering, team organization, data management and simulation. In each of these areas, he shares principles and techniques to help you navigate the challenges of complex sensor systems and deliver impactful solutions to real-world problems.

1. Building Meaningful Products
Using Complex Sensor Systems
Dirk van der Merwe
Autonomous Robotics Lead
Deka Research and Development

2. Deka
2© 2024 Deka Research and Development
•30 years of applying computer vision and
robotics in real world applications.
•800+ Incredibly smart engineers.
•Incredible technical resources.

3. •Sensors have inherent physical limitations.
•Algorithms are prone to weakness and
errors.
•Cross checks are necessary to eliminate
uncertainty and reduce risks.
•Sensor sample times and algorithmic
processing times vary.
•Limited power available for complex
processing.
The World is Complex
3© 2024 Deka Research and Development

4. Example
4© 2024 Deka Research and Development

5. •Up front system engineering.
•Comprehensive problem and solution understanding first.
•Avoid early solution constraints.
Approaches to Tackle Complexity
5© 2024 Deka Research and Development

6. •Dissect into manageable
components.
•Clear interfaces.
Approaches to Tackle Complexity
6© 2024 Deka Research and Development

7. •Iterate rapidly through
representative proof of concepts to
validate technology suitability.
•Rigorous tests to refine
understanding of technology.
•Integrate adjacent technologies
early.
Approaches to Tackle Complexity
7© 2024 Deka Research and Development

8. Example
8© 2024 Deka Research and Development

9. •Data management is pivotal in complex sensor-based systems.
•Organize data meticulously from inception.
•Document data origins and configurations rigorously.
•Ensure data accessibility for reuse and algorithm refinement as
corner cases emerge.
Data Management in Complex Systems
9© 2024 Deka Research and Development

10. •Tailor simulations to specific tasks.
•Don’t overcomplicate for
hypothetical future use.
•Leverage simulations for replaying
real-world data.
•Employ hardware in the loop.
Simulation Accelerates Software Development and Testing
10© 2024 Deka Research and Development

11. •Small teams.
•Multi disciplinary.
•Focused leads.
•Clear short terms objectives.
•Well defined overarching
goals.
Team Organization for Complex System Development
11© 2024 Deka Research and Development

12. First
12© 2024 Deka Research and Development

13. Deka
13© 2024 Deka Research and Development

14. Resources
14© 2024 Deka Research and Development
Resource
Deka Research and Development
https://www.dekaresearch.com
First
https://www.firstinspires.org/robotics/frc