IP Library Granted Patent US 10,347,030
Granted Patent B2
US 10,347,030 · App. 15/595,666 · Granted Jul 9, 2019

Adjusting depth of augmented reality content on a heads up display

Inventors: Brian Mullins (Altadena, CA); Jamieson Christmas (Knowlhill, GB)
Assignee: Envisics Ltd
G06T15/02G06T3/4092G06T19/20G06T15/20G06T15/503G06T2210/62
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,347,030
App. No.
15/595,666
Granted
Jul 9, 2019
Kind
B2
Abstract

Disclosed are systems, methods, and non-transitory computer-readable media for adjusting depth of AR content on HUD. A viewing device identifies, based on sensor data, a physical object visible through a transparent display of the vehicle. The sensor data indicates an initial distance of the physical object from the vehicle. The viewing device gathers virtual content corresponding to the physical object and generates an initial presentation of the virtual content based on the initial distance. The viewing device presents the initial presentation of the virtual content on the transparent display at a position on the transparent display corresponding to the physical object. The viewing device determines, based on updated sensor data, an updated distance of the physical object and generates an updated presentation of the virtual content based on the updated distance. The viewing device presents the updated presentation of the virtual content on the transparent display of the vehicle.

Claims (43)

1. A method comprising:

identifying, based on sensor data gathered by a viewing device incorporated into a vehicle, a first physical object visible through a transparent display of the vehicle, the sensor data indicating an initial distance of the first physical object from the vehicle;

gathering virtual content corresponding to the first physical object;

generating an initial presentation of the virtual content based on the initial distance of the first physical object from the vehicle;

presenting the initial presentation of the virtual content on the transparent display of the vehicle, the virtual content presented at a position on the transparent display corresponding to the first physical object;

determining, based on updated sensor data gathered by the viewing device, an updated distance of the first physical object from the vehicle;

generating an updated presentation of the virtual content based on the updated distance of the first physical object from the vehicle, wherein the initial presentation of the virtual content is generated based on an initial focal point and the updated presentation is generated based on a second focal point that is different than the first focal point, the first focal point corresponding to the initial distance of the first physical object from the vehicle and the second focal point corresponding to the updated distance of the first physical object from the vehicle; and

presenting the updated presentation of the virtual content on the transparent display of the vehicle.

2. The method of claim 1 , wherein the initial presentation of the virtual content is at a first presentation size and the updated presentation of the virtual content is at a second presentation size that is different than the first presentation size.

3. The method of claim 2 , wherein the updated distance is greater than the initial distance, and the updated presentation size is smaller than the initial presentation size.

4. The method of claim 2 , wherein the updated distance is less than the initial distance, and the updated presentation size is greater than the initial presentation size.

5. The method of claim 2 , wherein presenting the initial presentation of the virtual content on the transparent display comprises projecting the initial presentation of the virtual content onto a windshield of the vehicle.

6. The method of claim 2 , wherein the first physical object is a building.

7. The method of claim 1 , wherein the initial presentation of the virtual content appears to extend towards the vehicle from the first focal point and the updated presentation of the virtual content appears to extend towards the vehicle from the second focal point.

8. The method of claim 7 , wherein the first physical object is a cross-street located ahead of the vehicle.

9. The method of claim 1 , further comprising:

generating a presentation of a second virtual content corresponding to the vehicle, the presentation of the second virtual content generated based on a distance between a user operating the vehicle and a front end of the vehicle; and

presenting the second virtual content on the transparent display of the vehicle.

10. A viewing device incorporated into a vehicle, the viewing device comprising:

one or more computer processors; and

one or more non-transitory computer-readable mediums storing instructions that, when executed by the one or more computer processors, cause the viewing device to perform operations comprising:

identifying, based on sensor data gathered by the viewing device, a first physical object visible through a transparent display of the vehicle, the sensor data indicating an initial distance of the first physical object from the vehicle;

gathering virtual content corresponding to the first physical object;

generating an initial presentation of the virtual content based on the initial distance of the first physical object from the vehicle;

presenting the initial presentation of the virtual content on the transparent display of the vehicle, the virtual content presented at a position on the transparent display corresponding to the first physical object;

determining, based on updated sensor data gathered by the viewing device, an updated distance of the first physical object from the vehicle;

generating an updated presentation of the virtual content based on the updated distance of the first physical object from the vehicle, wherein the initial presentation of the virtual content is generated based on an initial focal point and the updated presentation is generated based on a second focal point that is different than the first focal point, the first focal point corresponding to the initial distance of the first physical object from the vehicle and the second focal point corresponding to the updated distance of the first physical object from the vehicle; and

presenting the updated presentation of the virtual content on the transparent display of the vehicle.

11. The viewing device of claim 10 , wherein the initial presentation of the virtual content is at a first presentation size and the updated presentation of the virtual content is at a second presentation size that is different than the first presentation size.

12. The viewing device of claim 11 , wherein the updated distance is greater than the initial distance, and the updated presentation size is smaller than the initial presentation size.

13. The viewing device of claim 11 , wherein the updated distance is less than the initial distance, and the updated presentation size is greater than the initial presentation size.

14. The viewing device of claim 11 , wherein the first physical object is another vehicle.

15. The viewing device of claim 11 , wherein the first physical object is a building.

16. The viewing device of claim 11 , wherein the initial presentation of the virtual content appears to extend towards the vehicle from the first focal point and the updated presentation of the virtual content appears to extend towards the vehicle from the second focal point.

17. The viewing device of claim 16 , wherein the first physical object is a cross-street located ahead of the vehicle.

18. A non-transitory computer-readable medium storing instruction that, when executed by one or more computer processors of a viewing device incorporated into a vehicle, cause the viewing device to perform operations comprising:

identifying, based on sensor data gathered by the viewing device, a first physical object visible through a transparent display of the vehicle, the sensor data indicating an initial distance of the first physical object from the vehicle;

gathering virtual content corresponding to the first physical object;

generating an initial presentation of the virtual content based on the initial distance of the first physical object from the vehicle;

presenting the initial presentation of the virtual content on the transparent display of the vehicle, the virtual content presented at a position on the transparent display corresponding to the first physical object;

determining, based on updated sensor data gathered by the viewing device, an updated distance of the first physical object from the vehicle;

generating an updated presentation of the virtual content based on the updated distance of the first physical object from the vehicle, wherein the initial presentation of the virtual content is generated based on an initial focal point and the updated presentation is generated based on a second focal point that is different than the first focal point, the first focal point corresponding to the initial distance of the first physical object from the vehicle and the second focal point corresponding to the updated distance of the first physical object from the vehicle; and

presenting the updated presentation of the virtual content on the transparent display of the vehicle.

Assignments (6)
RELEASE OF SECURITY INTEREST Recorded Oct 3, 2019
From: AR HOLDINGS I LLC
To: ENVISICS LTD
Reel/Frame 050622/0678 →
SECURITY INTEREST Recorded Jun 26, 2019
From: DAQRI, LLC
To: AR HOLDINGS I LLC
Reel/Frame 049596/0965 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 21, 2019
From: DAQRI, LLC
To: DUALITAS LTD
Reel/Frame 049242/0476 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 21, 2019
From: DUALITAS LTD
To: ENVISICS LTD
Reel/Frame 049242/0554 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 21, 2019
From: CHRISTMAS, JAMIESON
To: ENVISICS LTD
Reel/Frame 049242/0622 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 9, 2017
From: MULLINS, BRIAN
To: DAQRI, LLC
Reel/Frame 043249/0163 →
Continuity (1)
Related Publication 20180330531A1 · Nov 15, 2018
Cited By (1)
US 12,276,788