IP Library Patent Application 15955338
Patent Application
App. No. 15/955,338

SYSTEM AND METHOD FOR PROVIDING AUGMENTED-REALITY ASSISTANCE FOR VEHICULAR NAVIGATION

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
15/955,338
Abstract

The disclosure is related to a set of augmented reality (AR) driving glasses for use during operation of a vehicle, such as consumer automobile. In some embodiments, the AR driving glasses display one or more images related to vehicle operation, such as navigation images, hazard images, vehicle settings images, and other images. The images are generated based on data collected by one or more sensors of the vehicle (e.g., cameras, GPS, LIDAR, range sensors, ultrasonic sensors, etc.) and/or by one or more sensors included in the AR driving glasses (e.g., cameras, ambient light sensors, motion sensors, biometric sensors, etc.). The images are sized and displayed at a location on the display in accordance with at least data from one or more sensors of the AR driving glasses (e.g., motion data or camera data) and/or data from the vehicle (e.g., vehicle speed).

Claims (104)

1 . An augmented-reality system having an eyewear apparatus comprising:

a frame;

at first lens connected to the frame, the first lens comprising a display;

one or more sensors;

one or more processors operatively coupled to the one or more sensors; and

a memory including instructions, which when executed by the one or more processors, cause the one or more processors to perform a method comprising the steps of:

generating one or more images to be displayed on the displays based at least on data from the one or more sensors.

2 . The system of claim 1 , wherein:

the first lens is located such that it is in front of the eyes of a wearer of the eyewear apparatus,

the eyewear apparatus further comprises:

a second lens, the second lens comprising a display, the second lens located such that it is at a periphery of an eye of the wearer of the eyewear apparatus, and

a transceiver operatively coupled to a vehicle,

the vehicle includes a side mirror camera, and

the method performed by the processors further comprises the step of generating an image of the one or more images on the second lens based on data from the side mirror camera, the data received from the vehicle at the transceiver of the eyewear apparatus.

3 . The system of claim 1 , wherein:

the first lens has a variable focal point,

the one or more sensors comprise an iris scanner, and

the method further comprises the steps of:

receiving, from the iris scanner, biometric data,

matching the received biometric data to a stored user profile, and

controlling the variable focal point of the first lens to become a stored focal point associated with the stored user profile.

4 . The system of claim 1 , wherein:

the one or more sensors comprise a gyroscope, and

the method further comprises the steps of:

receiving, from the gyroscope, one or more of motion and orientation data, and

determining one or more of a location and size of the one or more images to be displayed in accordance with the one or more of motion and orientation data.

5 . The system of claim 1 , further comprising:

one or more cameras directed towards eyes of a wearer of the eyewear apparatus, wherein the method further comprises the steps of:

receiving, from the one or more cameras, one or more captured images including the eyes of the wearer, and

determining one or more of a location and size of the one or more images to be displayed in accordance with the one or more captured images.

6 . The system of claim 1 , further comprising:

a vibrating mechanism, wherein the method further comprises the steps of:

detecting a hazard,

generating one or more image notifications of the hazard, and

while displaying the one or more image notifications of the hazard, causing the vibrating mechanism to vibrate.

7 . The system of claim 1 , further comprising:

a connector cable couplable to a vehicle, the connector cable configured to receive power from the vehicle, and transmit information to and from the vehicle.

8 . The system of claim 1 , further comprising:

a wireless transceiver, wherein the method further comprises the steps of:

receiving, at the wireless transceiver, vehicle speed data from a vehicle operatively coupled to the eyewear apparatus, and

determining one or more of a location and size of the one or more images to be displayed in accordance with the vehicle speed data.

9 . The system of claim 1 , further comprising:

a wireless transceiver, wherein the method further comprises the steps of:

receiving, at the wireless transceiver, vehicle settings data including an indication of a change in a vehicle setting from a vehicle operatively coupled to the eyewear apparatus,

generating a vehicle settings image based on the vehicle settings data, and

displaying the vehicle settings image at a location on the first lens corresponding to a component of the vehicle associated with the vehicle setting.

10 . A method of displaying an image on an eyewear apparatus, the method comprising:

receiving data from one or more sensors included in the eyewear apparatus; and

generating an image for display on a display included in a first lens included in the eyewear apparatus, the images generated based on at least the data from the one or more sensors.

11 . The method of claim 10 , wherein:

the first lens is located such that it is in front of the eyes of a wearer of the eyewear apparatus,

the eyewear apparatus further comprises:

a second lens, the second lens comprising a display, the second lens located such that it is at a periphery of an eye of the wearer of the eyewear apparatus, and

a transceiver operatively coupled to a vehicle,

the vehicle includes a side mirror camera, and

the method further comprises the step of generating an image of the one or more images on the second lens based on data from the side mirror camera, the data received from the vehicle at the transceiver of the eyewear apparatus.

12 . The method of claim 10 , wherein:

the one or more sensors comprise a gyroscope, and

the method further comprises the steps of:

receiving, from the gyroscope, one or more of motion and orientation data, and

determining one or more of a location and size of the one or more images to be displayed in accordance with the one or more of motion and orientation data.

13 . The method of claim 10 , wherein:

the eyewear apparatus further includes one or more cameras directed towards eyes of a wearer of the eyewear apparatus, and

the method further comprises the steps of:

receiving, from the one or more cameras, one or more captured images including the eyes of the wearer, and

determining one or more of a location and size of the one or more images to be displayed in accordance with the one or more captured images.

14 . The method of claim 10 , wherein:

the eyewear apparatus further comprises a vibrating mechanism, and

the method further comprises the steps of:

detecting a hazard,

generating one or more image notifications of the hazard, and

while displaying the one or more image notifications of the hazard, causing the vibrating mechanism to vibrate.

15 . The method of claim 10 , wherein:

the eyewear apparatus further comprises a wireless transceiver, and

the method further comprises the steps of:

receiving, at the wireless transceiver, vehicle speed data from a vehicle operatively coupled to the eyewear apparatus, and

determining one or more of a location and size of the one or more images to be displayed in accordance with the vehicle speed data.

16 . The method of claim 10 , wherein:

the eyewear apparatus further comprises a wireless transceiver, and

the method further comprises the steps of:

receiving, at the wireless transceiver, vehicle settings data including an indication of a change in a vehicle setting from a vehicle operatively coupled to the eyewear apparatus,

generating a vehicle settings image based on the vehicle settings data, and

displaying the vehicle settings image at a location on the first lens corresponding to a component of the vehicle associated with the vehicle setting.

17 . A non-transitory computer-readable medium including instructions, which when executed by one or more processors of an eyewear apparatus, cause the one or more processors to perform a method comprising:

receiving data from one or more sensors included in the eyewear apparatus; and

generating an image for display on a display included in a first lens included in the eyewear apparatus, the images generated based on at least the data from the one or more sensors.

18 . The non-transitory computer-readable medium of claim 17 , wherein:

the first lens is located such that it is in front of the eyes of a wearer of the eyewear apparatus,

the eyewear apparatus further comprises:

a second lens, the second lens comprising a display, the second lens located such that it is at a periphery of an eye of the wearer of the eyewear apparatus, and

a transceiver operatively coupled to a vehicle,

the vehicle includes a side mirror camera, and

the method further comprises the step of generating an image of the one or more images on the second lens based on data from the side mirror camera, the data received from the vehicle at the transceiver of the eyewear apparatus.

19 . The non-transitory computer-readable medium of claim 17 , wherein:

the eyewear apparatus further comprises a wireless transceiver, and

the method further comprises the steps of:

receiving, at the wireless transceiver, vehicle speed data from a vehicle operatively coupled to the eyewear apparatus, and

determining one or more of a location and size of the one or more images to be displayed in accordance with the vehicle speed data.

20 . The non-transitory computer-readable medium of claim 17 , wherein:

the eyewear apparatus further comprises a wireless transceiver, and

the method further comprises the steps of:

receiving, at the wireless transceiver, vehicle settings data including an indication of a change in a vehicle setting from a vehicle operatively coupled to the eyewear apparatus,

generating a vehicle settings image based on the vehicle settings data, and

displaying the vehicle settings image at a location on the first lens corresponding to a component of the vehicle associated with the vehicle setting.

Assignments (5)
RELEASE OF SECURITY INTEREST RECORDED AT REEL/FRAME 050234/0069 Recorded Jun 8, 2022
From: ARES CAPITAL CORPORATION, AS SUCCESSOR COLLATERAL AGENT
To: CITY OF SKY LIMITED; EAGLE PROP HOLDCO LLC; FARADAY & FUTURE INC.; FARADAY FUTURE LLC; FF EQUIPMENT LLC; FF HONG KONG HOLDING LIMITED; FF INC.; FF MANUFACTURING LLC; ROBIN PROP HOLDCO LLC; SMART KING LTD.; SMART TECHNOLOGY HOLDINGS LTD.; FARADAY SPE, LLC
Reel/Frame 060314/0263 →
ACKNOWLEDGEMENT OF SUCCESSOR COLLATERAL AGENT UNDER INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jul 29, 2021
From: BIRCH LAKE FUND MANAGEMENT, LP, AS RETIRING AGENT
To: ARES CAPITAL CORPORATION, AS SUCCESSOR AGENT
Reel/Frame 057019/0140 →
SECURITY INTEREST Recorded Oct 14, 2020
From: ROYOD LLC
To: BIRCH LAKE FUND MANAGEMENT, LP
Reel/Frame 054076/0157 →
ACKNOWLEDGEMENT OF SUCCESSOR COLLATERAL AGENT UNDER INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 5, 2020
From: BIRCH LAKE FUND MANAGEMENT, LP, AS RETIRING AGENT
To: ROYOD LLC, AS SUCCESSOR AGENT
Reel/Frame 052102/0452 →
SECURITY INTEREST Recorded May 1, 2019
From: CITY OF SKY LIMITED; EAGLE PROP HOLDCO LLC; FARADAY FUTURE LLC; FE EQUIPMENT LLC; FF HONG KONG HOLDING LIMITED; FF INC.; FF MANUFACTURING LLC; ROBIN PROP HOLDCO LLC; SMART KING LTD.; SMART TECHNOLOGY HOLDINGS LTD.; FARADAY SPE, LLC; FARADAY & FUTURE INC.
To: BIRCH LAKE FUND MANAGEMENT, LP
Reel/Frame 050234/0069 →