IP Library › Granted Patent US 10,127,734
Granted Patent B2
US 10,127,734 · App. 15/817,375 · Granted Nov 13, 2018

Augmented reality personalization

Inventor: Matei Stroila (Chicago, IL)
Assignee: HERE Global B.V.
G06T19/006G06T11/60H05K999/99
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,127,734
App. No.
15/817,375
Granted
Nov 13, 2018
Kind
B2
Abstract

A method is provided, such as for mobile augmented reality personalization. A front-facing camera of the mobile device acquires a first view of a user of the mobile device. A personal characteristic of the user of the mobile device is identified from the first view. A location of the mobile device may be determined. A back-facing camera of the mobile device may acquire a second view of a region at the location. Augmented reality information is selected as a function of the personal characteristic. A second view is displayed with the augmented reality information.

Claims (47)

1. A method comprising:

receiving a first view of a face of a user from a first camera;

determining, by a processor, a facial expression characteristic of the user from an analysis of the face of the user;

receiving, by the processor, a second view from a second camera;

identifying, by the processor, one or more points of interest in the second view;

performing, by the processor, a query for the facial expression characteristic of the user that selects data for the one or more points of interest; and

generating, by the processor, a third view comprising the second view with the data for the one or more points of interest.

2. The method of claim 1 , further comprising:

transmitting, by the processor, the third view to a mobile device.

3. The method of claim 1 , wherein identifying the one or more points of interest comprises:

extracting, by the processor, the one or more points of interest using an image recognition algorithm.

4. The method of claim 1 , wherein identifying the one or more points of interest comprises:

extracting, by the processor, the one or more points of interest using optical character recognition.

5. The method of claim 1 , wherein identifying the one or more points of interest comprises:

identifying, by the processor, a template of a building in the second view; and

matching, by the processor, the template to a stored template for a point of interest of the one or more points of interest.

6. The method of claim 1 , further comprising:

performing, by the processor, feature extraction on the face of the user.

7. The method of claim 1 , wherein the analysis of the face determines an identity of the user, wherein the data for the one or more points of interest is selected based on the identity of the user.

8. The method of claim 1 , wherein the analysis of the face determines a permanent feature of the user, wherein the data for the one or more points of interest is selected based on the permanent feature of the user.

9. The method of claim 1 , wherein the analysis of the face determines a temporary feature of the user, wherein the data for the one or more points of interest is selected based on the temporary feature of the user.

10. An apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs; the at least one memory configured to store the computer program code configured to, with the at least one processor, cause the apparatus to at least perform:

identify a first view of a user collected by a first camera of a mobile device;

perform an analysis of the first view of the user from the first camera;

determine a facial expression characteristic of the user from the analysis of the first view;

receive a second view including a point of interest from a second camera of the mobile device;

perform a query for the facial expression characteristic of the user that selects information for the point of interest; and

provide the information with the second view.

11. The apparatus of claim 10 , the at least one memory configured to store the computer program code configured to, with the at least one processor, cause the apparatus to at least perform:

identify the point of interest in the second view using optical character recognition.

12. The apparatus of claim 10 , the at least one memory configured to store the computer program code configured to, with the at least one processor, cause the apparatus to at least perform:

identify the point of interest in the second view using input from the user.

13. An apparatus comprising:

a first camera, the first camera configured to capture a first view;

a second camera, the second camera configured to capture a second view;

a geographic database, the geographic database configured to store data for a point of interest;

a processor, the processor configured to identify a facial expression characteristic of a user from a face of the user in the first view and configured to identify the point of interest in the second view, the processor configured to select a subset of data of the data for the point of interest based on the facial expression characteristic, the processor further configured to generate a third view comprising the second view and the subset of data; and

a display, the display configured to display the third view to the user.

14. The apparatus of claim 13 , wherein the first view, second view, and third view are still images.

15. The apparatus of claim 13 , wherein the processor is configured to identify the point of interest using optical character recognition.

16. The apparatus of claim 13 , wherein the processor is configured to identify the point of interest using a building template.

17. The apparatus of claim 13 , wherein the first camera is a forward facing camera and the second camera is a back facing camera.

18. The apparatus of claim 13 , wherein the geographic database is remotely located from the processor.

19. The apparatus of claim 13 , wherein the data for the point of interest is advertising data.

20. The apparatus of claim 13 , wherein the processor is further configured to identify an age of the user from the face of the user in the first view, wherein the subset of data is further selected based on the age.

Continuity (3)
Continuation 14959620 · Dec 4, 2015
Continuation 13324156 · Dec 13, 2011
Related Publication 20180082485A1 · Mar 22, 2018
Cited By (2)
US 12,602,107 US 12,705,737