IP Library › Granted Patent US 11,474,679
Granted Patent B2
US 11,474,679 · App. 17/216,758 · Granted Oct 18, 2022

Image identification system

Inventor: Cecile Lanza Parker (San Francisco, CA)
Assignee: GM Cruise Holdings LLC
G06F3/04845G01S7/04G01S7/51G01S13/89G01S17/89G06F3/0482G06F2203/04803G06F2203/04806
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,474,679
App. No.
17/216,758
Granted
Oct 18, 2022
Kind
B2
Abstract

Embodiments may relate to a graphical user interface (GUI). The GUI may include a first portion that displays an image related to images of a location. The GUI may also include a second portion that displays an image related to detection and ranging information of the location. The two images may be linked such that an interaction with an object in one portion of the GUI causes changes in the other portion of the GUI. Other embodiments may be described or claimed.

Claims (50)

1. A method for providing intuitive user interactions that reduce object identification time and improve object identification accuracy, comprising:

generating a first portion of a graphical user interface (GUI) comprising visible-light camera images of a location around a vehicle, wherein the visible-light camera images are laid side by side to form an image strip, and a subset of the visible-light camera images are visible to a user through the first portion of the GUI based on a vision field of the image strip;

generating a second portion the GUI comprising a map displaying data from a light detection and ranging (LIDAR) system and a directional halo representing the vision field of the image strip;

receiving a user interaction with an object in the second portion of the GUI;

altering the vision field of the first portion of the GUI to display the object in the first portion of the GUI to the user; and

causing the object in the first portion of the GUI to be accentuated.

2. The method of claim 1 , further comprising:

receiving a confirmation from the user that the object is properly identified.

3. The method of claim 1 , further comprising:

receiving a confirmation from the user that the object is properly classified.

4. The method of claim 1 , further comprising:

receiving a confirmation from the user that the object is properly labeled.

5. The method of claim 1 , further comprising:

storing objects confirmed by the user using the GUI in a database as annotated data usable to train machine learning models.

6. The method of claim 1 , further comprising:

generating a third portion of the GUI comprising a list of object labels.

7. The method of claim 6 , wherein each object label comprises a unique identifier.

8. The method of claim 6 , wherein each object label comprises an object class.

9. The method of claim 6 , wherein each object label comprises metadata about a corresponding object.

10. The method of claim 6 , further comprising:

causing an object label corresponding to the object in the third portion of the GUI to be accentuated.

11. The method of claim 1 , further comprising:

causing the directional halo to be rotated in the second portion of the GUI to represent the altered vision field.

12. The method of claim 1 , further comprising:

causing a breadth of the directional halo to be changed in the second portion of the GUI to represent the altered vision field.

13. The method of claim 1 , further comprising:

causing an indicator to be displayed in the first portion of the GUI in response to the user interaction of the object, wherein the object is not in the vision field of the image strip, and the altering step is performed in response to a further user interaction with the indicator.

14. The method of claim 13 , wherein the indicator comprises an arrow.

15. The method of claim 13 , wherein the indicator comprises a flash at a periphery of the first portion of the GUI.

16. The method of claim 1 , wherein altering the vision field of the first portion of the GUI comprises:

performing a rotation of the vision field to center the object in the vision field.

17. The method of claim 1 , wherein altering the vision field of the first portion of the GUI comprises:

performing a zoom action of the vision field to center the object in the vision field.

18. The method of claim 1 , wherein the map further comprises data from a radio detection and ranging system.

19. One or more non-transitory computer-readable media comprising instructions for providing intuitive user interactions that reduce object identification time and improve object identification accuracy, that, upon execution of the instructions by one or more processors of a computing device, are to cause the computing device to:

generating a first portion of a graphical user interface (GUI) comprising an image strip having camera images of a location around a vehicle laid side by side, wherein a subset of the camera images corresponding to a vision field of the image strip is visible to a user through the first portion of the GUI;

generating a second portion the GUI comprising a map displaying data from a detection and ranging system and a halo graphically representing the vision field of the image strip;

receiving a user interaction with an object in the second portion of the GUI;

causing a change in the vision field of the first portion of the GUI to make the object in the first portion of the GUI visible to the user; and

causing the object in the first portion of the GUI to be accentuated.

20. A object identification system for providing intuitive user interactions that reduce object identification time and improve object identification accuracy, comprising:

one or more processors;

one or more memory devices storing instructions to be executed by the one or more processors; and

one or more display devices in communication with the one or more processors to display a graphical user interface (GUI);

wherein the instructions are to cause the one or more processors to:

generate a first portion of the GUI comprising visible-light camera images of a location around a vehicle, wherein the visible-light camera images are laid side by side to form an image strip, and a subset of the visible-light camera images are visible to a user through the first portion of the GUI based on a vision field of the image strip;

generate a second portion the GUI comprising a map displaying data from a detection and ranging system and a directional halo representing the vision field of the image strip;

receive a user selection of an object in the second portion of the GUI;

update the vision field of the first portion of the GUI to display the object in the first portion of the GUI to the user; and

cause the object in the first portion of the GUI to be highlighted.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 7, 2022
From: PARKER, CECILE LANZA
To: GM CRUISE HOLDINGS LLC
Reel/Frame 061682/0168 →
Continuity (2)
Continuation 16842118 · Apr 7, 2020
Related Publication 20210311616A1 · Oct 7, 2021
Cited By (1)
US 12,731,346