IP Library › Granted Patent US 12,190,610
Granted Patent B2
US 12,190,610 · App. 17/903,362 · Granted Jan 7, 2025

Application for the identification of vehicle features

Inventors: Timothy Wang (Ann Arbor, MI); Roger Akira Kyle (Aubrey, TX); Bryan Else Yamasaki (Frisco, TX); Justin K Shen (Canton, MI); Prince R Remegio (McKinney, TX); Jackson Zhu (Belleville, MI)
Assignees: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.; TOYOTA JIDOSHA KABUSHIKI KAISHA
G06V20/59G06Q10/20G06V10/70G07C5/0825H04N5/272
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,190,610
App. No.
17/903,362
Granted
Jan 7, 2025
Kind
B2
Abstract

Systems and methods are provided for determining features in a vehicle. The interior of the vehicle can be scanned with a camera of a mobile device to locate one or more symbols or shapes within the interior. The one or more symbols or shapes can be processed using one or more machine learning models to obtain data associated with the one or more symbols or shapes. The data associated with the one or more symbols or shapes can be displayed to a driver of the vehicle.

Claims (41)

1. A method for determining features in a vehicle, comprising:

scanning an interior of the vehicle with a camera of a mobile device;

locating one or more symbols or shapes within the interior;

processing the one or more symbols or shapes using one or more machine learning models to determine that a switch comprising the one or more symbols activates a driving feature of the vehicle when the switch is operated by an occupant of the vehicle;

obtaining data associated with the one or more symbols or shapes describing the driving feature; and

displaying the data associated with the one or more symbols or shapes to a driver of the vehicle.

2. The method of claim 1 , wherein displaying the data associated with the one or more symbols or shapes comprises displaying the data on a live camera view of the interior of the vehicle.

3. The method of claim 2 , wherein displaying the data on the live camera view comprises locating one or more additional symbols or shapes within the interior when the live camera view focuses on a different portion of the interior.

4. The method of claim 2 , wherein displaying the data on the live camera view comprises locating one or more additional symbols or shapes within the interior when the live camera view zooms in on a portion of the interior.

5. The method of claim 1 , wherein displaying the data associated with the one or more symbols or shapes comprises displaying the data on a photograph of the interior of the vehicle.

6. The method of claim 1 , wherein determining that the one or more symbols correspond to activating the driving feature of the vehicle comprises determining that a symbol or shape of the one or more symbols or shapes is located on a dashboard of the vehicle.

7. The method of claim 1 , wherein processing the one or more symbols or shapes comprises determining a function of an actuation mechanism based on a shape of the actuation mechanism.

8. The method of claim 1 , wherein locating one or more symbols or shapes within the interior comprises determining what area of the interior is being scanned.

9. The method of claim 8 , wherein determining that the one or more symbols correspond to activating the driving feature of the vehicle is based on the area of the interior being scanned.

10. The method of claim 1 , wherein determining that the one or more symbols correspond to activating the driving feature of the vehicle comprises:

determining that the one or more symbols are associated with an actuation mechanism; and

determining a function of the actuation mechanism.

11. The method of claim 1 , wherein displaying the data comprises displaying a description of the driving feature when the driver presses an image of the one or more symbols on a display.

12. A mobile device comprising:

a processor; and

a memory coupled to the processor to store instructions, which when executed by the processor, cause the processor to perform operations, the operations comprising:

scanning a dashboard of a vehicle with a camera of a mobile device;

locating one or more symbols or shapes displayed on the dashboard;

processing the one or more symbols or shapes using one or more machine learning models;

obtaining data associated with the one or more symbols or shapes;

determining that a switch comprising the one or more symbols or shapes activates a driving feature of the vehicle when the switch is operated by an occupant of the vehicle; and

displaying the data associated with the one or more symbols or shapes to a driver of the vehicle, wherein the data describes the driving feature.

13. The mobile device of claim 12 , wherein displaying the data associated with the one or more symbols or shapes comprises displaying the data on a live camera view of the dashboard.

14. The mobile device of claim 12 , wherein displaying the data associated with the one or more symbols or shapes comprises displaying the data on a photograph of the dashboard.

15. The mobile device of claim 12 , wherein determining that the one or more symbols correspond to activating the driving feature of the vehicle comprises determining that the one or more symbols or shapes are located on a dashboard of the vehicle.

16. A non-transitory machine-readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform operations, the operations comprising:

scanning an interior of a vehicle with a camera of a mobile device;

determining what area of the interior is being scanned;

locating one or more symbols or shapes within the interior;

determining that a switch comprising the one or more symbols or shapes activates a driving feature of the vehicle when the switch is operated by an occupant of the vehicle;

obtaining data associated with the one or more symbols or shapes describing the driving feature; and

displaying the data associated with the one or more symbols or shapes to a driver of the vehicle.

17. The non-transitory machine-readable medium of claim 16 , wherein displaying the data associated with the one or more symbols or shapes comprises displaying the data on a live camera view of the interior of the vehicle.

18. The non-transitory machine-readable medium of claim 16 , wherein displaying the data associated with the one or more symbols or shapes comprises displaying the data on a photograph of the interior of the vehicle.

19. The non-transitory machine-readable medium of claim 16 , wherein determining that the one or more symbols correspond to activating the driving feature of the vehicle comprises determining that a symbol or shape is located on a dashboard of the vehicle.

20. The non-transitory machine-readable medium of claim 16 , wherein processing the one or more symbols or shapes comprises determining a function of an actuation mechanism based on a shape of the actuation mechanism.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 20, 2025
From: TOYOTA JIDOSHA KABUSHIKI KAISHA
To: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.
Reel/Frame 070275/0149 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 6, 2022
From: WANG, TIMOTHY; KYLE, ROGER AKIRA; YAMASAKI, BRYAN ELSE; SHEN, JUSTIN K; REMEGIO, PRINCE R; ZHU, JACKSON
To: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.; TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 060996/0658 →
Continuity (1)
Related Publication 20240078818A1 · Mar 7, 2024
References Cited (10)
US 7418408B1 · Heppe · 2008 [cited by applicant]
US 7672666B2 · Hasan · 2010 [cited by applicant]
US 10629012B1 · Gattu · 2020 [cited by applicant]
US 10962378B2 · Cronin · 2021 [cited by applicant]
US 20060229777A1 · Hudson · 2006 [cited by examiner]
US 20090018859A1 · Purifoy · 2009 [cited by examiner]
US 20180211122A1 · Amico · 2018 [cited by examiner]
CN 109658520A · 2019 [cited by applicant]
CN 111179268A · 2020 [cited by applicant]
CN 114070836A · 2022 [cited by applicant]