ECOSYSTEM: RENESAS
Ignitarium launches AI applications on RA8D1 MCU
The graphics-enabled MCU is the first ARM® Cortex®-M85 core based MCU with Helium, for AI/ML tasks
Our work as an early RA and RZ ready Partner is a validation of the deep capabilities in AI and Machine Learning, and more specifically our proven track record of implementing highly optimized AI applications on Renesas devices for applications ranging from video, audio and sensor data processing.
Our Offerings
AI pretrained library
The pre-trained AI library is a collection of Vision AI based software applications available to all. The library and sample applications are a good entry point for beginners to start work with Renesas RZ/V and RA8 series.
- Easy to Deploy
Pretrained AI libraries are readily available sample applications which can be run on the device
- Open Source
The source code, the DNN model and the datasets used for the model training are all open source. Open source ensures wider community support
- Free to Use
The executables, models and source code are all available on GitHub free of cost
Applications
Head Counter
Monitors attendance of workers by counting their number entered in the work area.
Supported Hardware: RZ/V2L, RZ/V2H and RA8D1
Supported AI SDK: v2.10
Function: 01_Head_Count
Model: YOLOv3
Dataset: HollywoodHeads
Driver Monitoring System
Detects whether the driver is looking aside, yawning or closing his eyes. Prevents car accidents by detecting when the driver is getting sleepy while driving.
Supported Hardware: RZ/V2L and RZ/V2H
Supported AI SDK: v2.10
Function: 10_Driver_Monitoring_System
Model: TINY/YOLOv3+DeepPose
Dataset: WIDERFACE/WFLW
Attire Detection
Increases the safety level in the factory by monitoring the use of helmets.
Supported Hardware: RZ/V2L, RZ/V2H and RA8D1
Supported AI SDK: v2.10
Function: 01_Safety_Helmet_Detection
Model: YOLOv3
Dataset: Safety Helmet detection on Koggle
Animal Detection
Detect various types of animals entering farms or barns, for pest control.
Supported Hardware: RZ/V2L and RZ/V2H
Supported AI SDK: v2.10
Function: 07_Animal_detection
Model: YOLOv3
Dataset: Animals Detection Images Dataset+Images.cv+Coco Dataset
Access control
Prevents accidents and detects illegal by detecting the entry to prohibited areas.
Supported Hardware: RZ/V2L and RZ/V2H
Supported AI SDK: v2.10
Function: 02_Line_crossing_object_
counting
Model: Tiny/YOLOv2
Dataset: COCO
Office Room Usage Monitor
Monitors if a room is vacant by counting the number of people in the room.
Supported Hardware: RZ/V2L and RZ/V2H
Supported AI SDK: v2.10
Function: 11_Head_count_topview
Model: YOLOv3
Dataset: Various dataset
Human Gaze Detection
Monitors the gaze direction of customer in the retail store, which can be used to collect marketing information.
Supported Hardware: RZ/V2L and RZ/V2H
Supported AI SDK: v2.10
Function: 09_Human_gaze_detection
Model: ResNet-18+Tiny YOLOv2
Dataset: ETH-XGaze+WIDERFACE
Elderly Fall Detection
Enables early rescue by detecting changes in body condition of patients/users in hospitals and care facility when they are alone.
Supported Hardware: RZ/V2L
Supported AI SDK: v2.10
Function: 03_Elderly_fall_detection
Model: TinyYOLOv2+HRNet
Dataset: PASCAL VOC+COCO
Smart Vacuum Cleaner Robot with RA6M5 and RZ/V2H using ROS2 and micro-ROS
- Base Controller
- RA6M5 for motor control
- Runs micro-ROS node for motor commands, IMU, and wheel odometry
- Processing and Perception
- RZ/V2H manages 2D LiDAR and camera and all other software modules for state estimation, navigation and control
- Hardware Accelerated Visual SLAM with DRP-AI and OpenCV for precise localization
- Intelligent Navigation
- ROS2 Navigation Stack for full coverage
- Indoor AMR mode with path planning and dynamic obstacle avoidance
Human Head Counter
Using RENESAS RA8D1, the first ARM® Cortex®-M85 core based MCU with Helium™
- KEY FEATURES
- Suitable for real time detection on low-power, low-cost edge devices
- Ultra lightweight deep learning models with good accuracy
- Leverages Arm HeliumTM technology for high performance
- Able to detect heads from various angles
- TARGET MARKETS & APPLICATIONS
- Elevator passenger counting, conference room usage monitoring
- Occupancy-based Lighting and AC control
- Congestion detection in public transport, stations and malls
Target Markets
Smart Buildings
Smart Cities
Health Care
Industrial / Robotics
Retail & Surveillance
Agriculture
DRP-AI Translator Mounting Flow
Videos
demo
Renesas RZV2L