VinAI is one of the world's top 20 Artificial Intelligence research-based companies, whose determined mission is to bring state-of-the-art research into real-life impacts. On the occasion of AI Day 2022, VinAI is proud to announce two brand new products that have been successfully developed. These products are pioneering in the market and promisingly will further solidify VinAI's position as a regional market leader.
Consistently on the cutting edge of technology, VinAI's Smart Mobility team is proud of their in-house built driving technology. Let's take a look at the new products VinAI has created.
Driver Monitoring System - DMS
According to a report of the United Nations in 2021, more than one million people die from car accidents every year. While approximately 60% of accidents happen as a result of driver distractions (AAA Foundation, 2017), another 20% were caused by driver's drowsiness (ROSPA, 2020).
To tackle these problems, VinAI's specialized Driver and Occupants Monitoring System (DMS) ensures a safe driving experience with our in-cabin solutions by using high-performance cameras and AI to analyze driver behavior patterns to prevent driving errors.
VinAI's DMS was developed to enhance the safety of drivers. Based on face recognition technology, VinAI's solution is to use an infrared (IR) camera and vehicle sensors to detect the driver's status such as sleepiness, drowsiness, or risky behaviors such as distraction or using phones. By doing this, the system can alert the driver to pay attention to controlling the vehicle. VinAI's DMS can also detect the driver's eye movement when wearing sunglasses and a facemask.
The outstanding strength of VinAI's product also lies in its flexibility. In the other words, VinAI's DMS product is designed to be compatible with a wide range of platforms, which allows car makers to integrate it into their existing hardware without having to spend huge efforts on conversion. VinAI's DMS product also runs on multiple SoCs such as: Nvidia, Qualcomm, Renesas, Ambarella, those among the giant global semiconductors.
Introducing: Auto Mirror Adjustment
In order to make the driving experience easier and more convenient, VinAI also developed an automatic mirror adjustment (AMA) feature in their DMS product. With traditional cars, the driver has to adjust the mirror "manually", using controlling buttons and must regularly adjust it many times to get the correct viewing angle. VinAI solves this problem by providing a new automatic mirror adjustment feature, which automatically adjusts the side mirrors to the optimal position based on the driver's eye position information.
In particular, the system begins by estimating the driver's eye position in three-dimensional space. Normally, this problem would require two or more cameras to solve, but with the creativity of the engineering team, the solution that VinAI uses can accurately predict eye position with just a single infrared camera. Then, the system automatically calculates the optimal rotation angle based on the relative position of the eyes relative to the rearview mirror and sends the signal to the rearview mirror. Finally, the mirror receives a control signal from the processor to rotate the mirror face to the desired position. All the driver needs to do is sit in position, press the auto mirror adjustment button and the mirror will automatically be adjusted. The driver will just check and confirm the suitability and comfortability before setting off.
The mirror setting information will be saved to the driver's data. The vehicle will use this information to automatically adjust the mirrors for subsequent driving. The AMA feature not only saves the driver time in adjusting the mirrors, but also suggests the optimal mirror alignment position to make driving safer.
Check out the DMS demo video (this is foundational version, AMA is not included) https://www.youtube.com/watch?v=qY7c1e3lo7s
Advanced Surround View Monitoring - ASVM
Each year, in the US alone, there are 840,000 accidents caused by driver's incapability to monitor all blind spots. With this in mind, VinAI has come up with a solution to popularize a feature that is only available for luxury cars to more middle-end car segments. ASVM is a system that provides 360-degree surround views including top view, rear view, tire view, and 3D view to assist the driver when moving through busy streets, on narrow roads, or in the parking lot.
VinAI's ASVM product has reinvented the driver's experience by offering complete awareness of the situation around the car and identifying obstacles in "blind" areas with their 360-perimeter surround view monitoring system.
One of the advantages of VinAI's ASVM is the smooth and high-quality 360/3D view reconstructed by combining the images from four fisheye cameras with the best-in-class algorithm made by VinAI. The driver can interact with the view by swiping in any direction to see all around the car.
In addition, this system also makes parking simpler, especially for new drivers. ASVM automatically detects vacancies in the parking lot, directs parking in real time, or even automatically parks the car for the driver. In addition, ASVM can estimate the width of the space in narrow roads to determine whether the vehicle can be driven through, and provide the necessary support to the driver if needed.
Introducing: Jelly View
Jelly View is a transparent wraparound view that can see through the entire vehicle. Using the Jelly View system, the driver can see the entire scene outside the vehicle and underneath the vehicle, and can switch between different views using the on-screen control panel.
With this 3D mode, the driver can observe blind spots especially underneath the vehicle that cannot be seen through the mirror, thereby, avoid unexpected accidents on narrow roads, bad roads or in parking lots. ASVM supports the driver with a full view of the front, rear, left, right and below the vehicle to align and park in the parking lot.
For example:
The ASVM system is optimized to deliver best-in-class image stitching quality with high performance and low computation cost. The system is also flexible which can run on different hardware platforms so that it can be integrated into various car ranges from different segments.
Check out the ASVM demo video (this is the foundational version deployed on VFe34, Jelly View is not included):
https://www.youtube.com/watch?v=uJ3Yu9X2W9Y&t=2s
Research
After just three years, VinAI marked its global prominence with 98 publications at the main research tracks of top-tier AI conferences. In addition, VinAI was ranked within a global top 20 of the leading AI Research 2022' by Thundermark Capital.
The only Vietnamese company on the list, the ranking was awarded after an analysis of publications at the two most prestigious AI research conferences leading up to 2022: International Conference on Machine Learning (ICML 2021 - https://icml.cc/) and Neural Information Processing Systems (NeurlPS 2021 - https://nips.cc/).
In another great achievement, the 88 published papers in three years are also a clear demonstration of VinAI's innovation and dedication to world-class research. VinAI had 14, 12, 11 and 11 research papers published at CVPR (h5-index 356), NeurIPS (h5-index 245), ICML (h5-index 204) and ICLR (h5-index 253), respectively. VinAI conducts world-class research in cutting-edge artificial intelligence (AI) technologies, with research spanning major pillars of AI from machine learning to computer vision and natural language processing.
Learn about all these great achievements and witness the amazing new products above at AI DAY 2022
The two-day event will feature keynote presentations from industry leaders, expert panel discussions covering the topics that matter to AI today, casual talks, various hands-on workshops and educational tutorials. Participants will also be exposed to advanced AI products and features in the exhibition booths of VinAI and prestigious sponsors.
The event, which is held under the theme 'Empower the Future' will play host to industry-leading experts and cutting-edge researchers and scientists, including:
- Prof. Wolfram Burgard - Professor for Robotics and Al, Technical University of Nuremberg
- Prof. Alexander J. Smola - Distinguished Scientist / VP, Amazon Web Services (AWS)
- Prof. William T. Freeman - Thomas and Gerd Perkins Professor of Electrical Engineering & Computer Science, MIT
- Prof. Toby Walsh - Laureate Fellow & Scientia professor of AI, UNSW Sydney
- Dr. Hung Bui - Founding Director & CEO, VinAI
- Dr. Duong Van Nguyen - Head of ADAS Department, Panasonic Automotive Europe
- Mr. Ayush Batra - Regional Technology Enablement Director, Intel).
