Video: Discover how the new VL53L9CX LiDAR can be used for people detection maintaining privacy and user safety | Duration: 728s | Summary: Discover how the new VL53L9CX LiDAR can be used for people detection maintaining privacy and user safety | Chapters: LiDAR Introduction (24.8s), Imaging Technologies Overview (83.83s), VL53L90X Module (114.555s), Technical Specifications (175.675s), Sensor Display Views (229.955s), People Tracking (264.33s), Fall Detection Application (320.29s), Hand Gesture Recognition (382.34s), Sensor Applications (421.735s), Robotics and Drones (486.08s), Ecosystem Compatibility (525.73s), Conclusion and Recap (632.93s)
Transcript for "Discover how the new VL53L9CX LiDAR can be used for people detection maintaining privacy and user safety":
Let us continue after this short break, with the next session of the conference. The next presentation will be, talking about lidar. We'll be introducing our, a lidar sensor, for, people detection by... But maintaining privacy and, user safety. And the presenter will be Thomas Weert, product marketing engineer from STMicroelectronics. So let's get started with that presentation. Hello. My name is Thomas Viat. I am a product marketing at Estimate Critonique in charge of imaging product, and I will talk today about the new time of flight v l 53 l nine c x, which is in fact a all in one LiDAR module. So just to talk about imaging first, STMicro is proposing and offering a full, one stop shop for imaging technologies. We start from DTOF, so direct time of flight module on the left. This is what we'll talk about today, but we also offer indirect time of flight, ambulatory sensor, and image sensor, and especially global shutter in our portfolio. But as I said, today, we'll mostly talk about the DTOF module and the new v l 53 l nine c x. So the v l 53 l 90 x is an all in one lidar module. It means that in a single package, you can see on the left, a few millimeter by a few millimeter, you get everything inside. You get the laser emitter, get the receiver, but also the processing inside. And this is a unique sensor on the market because having such resolution, we're talking about 2,300 zones. You can see on the right, short video of how it looks. We can range up to nine meters. In this single, module, this is really important to mention, this sensor can range up to nine meters and up to 100 FPS, and it can work also in ambient light conditions, which is a key achievement for this kind of sensor because you can reach the very bright environment up to five meters at 60 FPS. As I was mentioning, we have, resolution of 54 by 42, around 2,300 zones, and, field of view is matching the resolution. It means that we have an angular resolution of one degree by one degree. We can range up to 100 FPS. We have a very low power mode going down to one twenty milliwatt and we have a linearity. It means the distance is start to be accurate starting at five centimeters. We are B protocol, having MIPI and I3C interface. Very important, we are calibration free. This sensor does not require any calibration. The processing is an ANZOS chip and of course this is class one safe, and which is good because you will not be blind by looking at the invisible light because we we use a nine forty nanometer light. On this video, we have a better view of, what the sensor is doing. We see that, we can recognize easily, the lady approaching the chair, sick... Sitting on the chair. At the bottom right corner, you have, what you see in, in, in regular view. On the left, you have the test map, so, distance information, which also have the IR map on the top right corner. And both information are very useful, for all application we are targeting for, for this sensor. The application we target with this sensor, is people tracking. So, typically, as you will see in this video, we are able, using Sensor, in a full privacy, be able to distinguish people from a chair, for example. And this is very important that we don't choose a two d camera. We don't choose RGB camera. We just choose the time of light, test, and AI information. And as you see we cannot recognize people. We see that there is, there are people, there are humans, but we don't know who is there, if it is a lady, if it is a man, what kind of clothes he is wearing, what what he is doing. And this is really, useful because you get this privacy. And, for many application, especially in, at home, for example, you don't want to get camera looking at you all the time. And this is, really beneficial of using this technology for such applications. The application linked to the people tracking is a fall detection. As you can see on this video, someone is raising his hand, is detected by the sensor, and then when it falls down on the floor, the sensor will detect and will raise an interrupt. This can be very useful because you can detect people, standing up, sitting, but also lying on the floor. This can minimise false alarms and as I mentioned before, this is still private. You don't get any image information, you can get depth and eye information, but based on this, we are able to track people and to see what they are doing. This can be very useful, for example, elderly houses or at home, for example, in your bathroom. When if you fall down, it can call an ambulance. It can call the police, the firemen to help you if you're just, lying on the floor without having your phone next to you. This can save life, actually. Another example application, using the same sensor is to do hand skeleton and gesture. As you can see in this video, using the test information will be useful to recognize where the hand is, how far it is from the sensor. You can recognize fingers easily, you can recognize numbers, many things. And this is very useful because you still benefit from the from the high accuracy but also the privacy image. No distance, no image information, only distance and IR map and these information are very useful to do so. Applications we see for this sensor, one on the left is for content management. You can use this sensor because it can range up to nine meters in silos or water towers, but also in trucks to monitor in real time how full are these containers. Basically, the sensor will look down in the silo and will monitor in real time, to know if it is full or if it is empty. Used with a LoRa, LoRa Ammeter and with a small MCU, you can just raise an interrupt when you reach a given target, a given distance to just to say, oh, it is empty. You need to refill it. Same for trucks. Because you get this information first nine meters but also this resolution, two dot three, k zones, You would get with very high accuracy how the parcel and package are taking what volume each truck. So if you can optimize, the container of the truck to put more, more parcel or less parcel if it is too full. On the right, two markets also, very useful for this sensor, robotic and drones. Room mapping and SLAM need three d sensors. This sensor, the v f 53 l nine, is a perfect application because with the wide angle we have, we can do room mapping, collision avoidance and slope prediction. Drones, as well, can be used for landing assist, thanks to the very high ambient light immunity, but to show collision avoidance. Thanks to the 100 FPS, you would be able to detect obstacles before they arrive in front of the drone. For ecosystem, the sensor is, I three c and EP interface as I was saying before. So on the s ten forty two side, it will be compatible, and it is compatible today with the s ten forty two h five and the s ten forty two n six. For the S1032N6, it will be through I3C, so very low power consumption and very low MIPS and then you have the S1032N6 if you want to get the full resolution at 100 FPS. What is interesting also for the SN52N6 is that you can connect LNCX, one on the MIP and one on the I3C, meaning that you get two sensors, full speed on the SN42N6. If I come back on the S932M6, you can connect multiple IL9 connected to it and we have some examples of using three or four L9CX connected to one single S932M6. On the MPU side, we will be compatible with the S1032 MP2. Departing is ongoing and of course we will benefit from I3C and NiP interface to get high performance MPU. On the ecosystem, we of course offer the sensor in tape and reel with MOQ at 1,000 units and a lead time of 26. For the boards, we offer two boards, one which is the X Nucleo, you are probably familiar with, which is a big blue board you can connect to any Nucleo platform, But we also offer the ST eval via 53 l nine, a very small PCB about one inch by one inch, which has a sensor. And this... With this board is very useful because it is a I3C, connector and an ErsoMiP through a Flex 22 pin FFC cable. To conclude, I put again this slide summarising the VF-eighty three L9 sensor. It can range up to nine meters in an all in one lidar module with a resolution of 2,300 zones. This sensor is just amazing. We strongly recommend you to have a look at it, evaluate it, and play with it, and you will love it because the performances are so great. There is no available, competition sensor able to do the same thing on the market today. Thank you very much for listening this webinar. We hope that you liked it, and don't hesitate to go on list.com to look at this sensor. Thank you.