IP Library Granted Patent US 11,756,461
Granted Patent B2
US 11,756,461 · App. 17/328,115 · Granted Sep 12, 2023

Display system and method

Inventors: Ramiro Almeida (Key Biscayne, FL); Pierre Beaudreau (St-Augustin-de-Desmaures, CA)
Assignee: MAGNA ELECTRONICS INC.
B60K35/00G06V20/58G06V40/103G08G1/005G08G1/04G08G1/09G09G3/001B60K2370/152B60K2370/167B60K2370/175B60K2370/77G06V2201/08G09G2380/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,756,461
App. No.
17/328,115
Granted
Sep 12, 2023
Kind
B2
Abstract

A method, computer program product, and computing system for monitoring one or more machine vision sensors to obtain perception information concerning one or more pedestrians proximate an autonomous vehicle; identifying one or more humanoid shapes within the perception information, thus defining one or more detected humanoid shapes; generating proximate object display information that locates the one or more detected humanoid shapes with respect to the autonomous vehicle; and rendering the proximate object display information on a visual display system, thus confirming the perception of the one or more pedestrians by the autonomous vehicle.

Claims (60)

1. A computer-implemented method, executed on a computing device, the computer-implemented method comprising:

equipping an autonomous vehicle with one or more machine vision sensors;

monitoring the one or more machine vision sensors to obtain perception information concerning one or more pedestrians proximate the autonomous vehicle;

identifying one or more humanoid shapes within the perception information, thus defining one or more detected humanoid shapes;

generating proximate object display information that locates the one or more detected humanoid shapes with respect to the autonomous vehicle;

rendering the proximate object display information on a visual display system of the autonomous vehicle, thus confirming perception of the one or more pedestrians proximate the autonomous vehicle to the one or more pedestrians proximate the autonomous vehicle, wherein the rendered proximate object display information comprises one or more pedestrian figures representing the one or more pedestrians proximate the autonomous vehicle; and

rendering instructions on the visual display system of the autonomous vehicle, the instructions instructing the one or more pedestrians proximate the autonomous vehicle to move in a particular direction, wherein the particular direction is indicated via an arrow.

2. The computer-implemented method of claim 1 wherein identifying the one or more humanoid shapes within the perception information includes:

comparing one or more defined humanoid shapes to one or more unidentified objects within the perception information to identify the one or more humanoid shapes within the perception information.

3. The computer-implemented method of claim 1 wherein the proximate object display information includes dynamic proximate object display information that changes as the location of the one or more detected humanoid shapes changes with respect to the autonomous vehicle.

4. The computer-implemented method of claim 3 wherein rendering the proximate object display information on the visual display system includes:

rendering the dynamic proximate object display information on the visual display system, thus dynamically confirming the perception of the one or more pedestrians by the autonomous vehicle.

5. The computer-implemented method of claim 1 wherein the one of more machine vision sensors includes a LIDAR system.

6. The computer-implemented method of claim 1 wherein the visual display system is configured to be mounted on a roof of the autonomous vehicle.

7. The computer-implemented method of claim 1 wherein the visual display system is a cylindrical visual display system.

8. The computer-implemented method of claim 7 wherein the cylindrical visual display system includes:

an illuminated portion; and

a non-illuminated portion positioned between the illuminated portion and a roof of the autonomous vehicle.

9. The computer-implemented method of claim 1 wherein the visual display system is a 360 degree visual display system.

10. The computer-implemented method of claim 1 wherein the visual display system is integrated into the autonomous vehicle.

11. A computer program product residing on a computer readable medium having a plurality of instructions stored thereon which, when executed by a processor, cause the processor to perform operations, the computer program product comprising:

equipping an autonomous vehicle with one or more machine vision sensors;

monitoring the one or more machine vision sensors to obtain perception information concerning one or more pedestrians proximate the autonomous vehicle;

identifying one or more humanoid shapes within the perception information, thus defining one or more detected humanoid shapes;

generating proximate object display information that locates the one or more detected humanoid shapes with respect to the autonomous vehicle;

rendering the proximate object display information on a visual display system of the autonomous vehicle, thus confirming perception of the one or more pedestrians proximate the autonomous vehicle to the one or more pedestrians proximate the autonomous vehicle, wherein the rendered proximate object display information comprises one or more pedestrian figures representing the one or more pedestrians proximate the autonomous vehicle; and

rendering instructions on the visual display system of the autonomous vehicle, the instructions instructing the one or more pedestrians proximate the autonomous vehicle to move in a particular direction, wherein the particular direction is indicated via an arrow.

12. The computer program product of claim 11 wherein identifying the one or more humanoid shapes within the perception information includes:

comparing one or more defined humanoid shapes to one or more unidentified objects within the perception information to identify the one or more humanoid shapes within the perception information.

13. The computer program product of claim 11 wherein the proximate object display information includes dynamic proximate object display information that changes as the location of the one or more detected humanoid shapes changes with respect to the autonomous vehicle.

14. The computer program product of claim 13 wherein rendering the proximate object display information on the visual display system includes:

rendering the dynamic proximate object display information on the visual display system, thus dynamically confirming the perception of the one or more pedestrians by the autonomous vehicle.

15. The computer program product of claim 11 wherein the one of more machine vision sensors includes a LIDAR system.

16. The computer program product of claim 11 wherein the visual display system is configured to be mounted on a roof of the autonomous vehicle.

17. The computer program product of claim 11 wherein the visual display system is a cylindrical visual display system.

18. The computer program product of claim 17 wherein the cylindrical visual display system includes:

an illuminated portion; and

a non-illuminated portion positioned between the illuminated portion and a roof of the autonomous vehicle.

19. The computer program product of claim 11 wherein the visual display system is a 360 degree visual display system.

20. The computer program product of claim 11 wherein the visual display system is integrated into the autonomous vehicle.

21. A computing system including a processor and memory configured to perform operations, the computing system comprising:

equipping an autonomous vehicle with one or more machine vision sensors;

monitoring the one or more machine vision sensors to obtain perception information concerning one or more pedestrians proximate the autonomous vehicle;

identifying one or more humanoid shapes within the perception information, thus defining one or more detected humanoid shapes;

generating proximate object display information that locates the one or more detected humanoid shapes with respect to the autonomous vehicle;

rendering the proximate object display information on a visual display system of the autonomous vehicle, thus confirming perception of the one or more pedestrians proximate the autonomous vehicle to the one or more pedestrians proximate the autonomous vehicle, wherein the rendered proximate object display information comprises one or more pedestrian figures representing the one or more pedestrians proximate the autonomous vehicle; and

rendering instructions on the visual display system of the autonomous vehicle, the instructions instructing the one or more pedestrians proximate the autonomous vehicle to move in a particular direction, wherein the particular direction is indicated by an arrow.

22. The computing system of claim 21 wherein identifying the one or more humanoid shapes within the perception information includes:

comparing one or more defined humanoid shapes to one or more unidentified objects within the perception information to identify the one or more humanoid shapes within the perception information.

23. The computing system of claim 21 wherein the proximate object display information includes dynamic proximate object display information that changes as the location of the one or more detected humanoid shapes changes with respect to the autonomous vehicle.

24. The computing system of claim 23 wherein rendering the proximate object display information on the visual display system includes:

rendering the dynamic proximate object display information on the visual display system, thus dynamically confirming the perception of the one or more pedestrians by the autonomous vehicle.

25. The computing system of claim 21 wherein the one of more machine vision sensors includes a LIDAR system.

26. The computing system of claim 21 wherein the visual display system is configured to be mounted on a roof of the autonomous vehicle.

27. The computing system of claim 21 wherein the visual display system is a cylindrical visual display system.

28. The computing system of claim 27 wherein the cylindrical visual display system includes:

an illuminated portion; and

a non-illuminated portion positioned between the illuminated portion and a roof of the autonomous vehicle.

29. The computing system of claim 21 wherein the visual display system is a 360 degree visual display system.

30. The computing system of claim 21 wherein the visual display system is integrated into the autonomous vehicle.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 24, 2022
From: OPTIMUS RIDE INC.
To: MAGNA ELECTRONICS INC.
Reel/Frame 059088/0385 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 18, 2022
From: ALMEIDA, RAMIRO; BEAUDREAU, PIERRE
To: OPTIMUS RIDE, INC.
Reel/Frame 059044/0137 →
Continuity (2)
Provisional Application 63028953 · May 22, 2020
Related Publication 20210366272A1 · Nov 25, 2021