IP Library Patent Application 15306734
Patent Application
App. No. 15/306,734

BEHAVIOR TRACKING AND MODIFICATION USING MOBILE AUGMENTED REALITY

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
15/306,734
Abstract

Examples relate to behavior tracking and modification using mobile augmented reality. In some examples, a navigation request for a route to a destination location is received from a user, and a data stream associated with the user is obtained. A first waypoint is identified based on the data stream and first waypoint metadata of a number of waypoint metadata that each include recognition cues for identifying a corresponding waypoint. An orientation of the user is determined based on the data stream and the recognition cues in the first waypoint metadata. A second waypoint is determined based on the characteristics in second waypoint metadata, and a guidance overlay is generated for display to the user based on the orientation, where the guidance overlay specifies a direction and a distance to the second waypoint.

Claims (35)

1 . A system for behavior tracking and modification using mobile augmented reality, comprising:

a capture device to obtain a data stream associated with a user;

a memory configured to store a plurality of waypoint metadata that each include recognition cues for identifying a corresponding waypoint of a plurality of waypoints based on the data stream and characteristics of the corresponding waypoint; and

a processor operatively connected to the memory, the processor to:

receive a navigation request for a route to a destination location;

identify a first waypoint of the plurality of waypoints based on the data stream and first waypoint metadata of the plurality of waypoint metadata;

determine an orientation of the user based on the data stream and the recognition cues in the first waypoint metadata;

determine a second waypoint of the plurality of waypoints based on the characteristics in second waypoint metadata of the plurality of waypoint metadata; and

generate a guidance overlay for display to the user based on the orientation, wherein the guidance overlay specifies a direction and a distance to the second waypoint.

2 . The system of claim 1 , wherein the navigation request includes a user objective selected from a group consisting of congestion avoidance, educational, entertainment, nourishment, promptness, and safety, wherein the second waypoint is further based on the user objective.

3 . The system of claim 1 , further comprising a user display that is configured to be hands-free while a user travels from the first waypoint to the second waypoint.

4 . The system of claim 1 , wherein the capture device is a camera configured to obtain a video stream of a user view, and wherein the identification of the first waypoint is performed by applying object recognition to the video stream.

5 . The system of claim 1 , wherein the processor is further to provide a game reward to the user when the first waypoint is identified based on the data stream and the first waypoint metadata.

6 . The system of claim 1 , wherein the second way point is determined using a Pareto optimization or a Monte Carlo simulation.

7 . A method for behavior tracking and modification using mobile augmented reality, comprising:

receiving a navigation request for a route to a destination location for a user;

obtaining a data stream associated with the user;

identifying a first waypoint of a plurality of waypoints based on the data stream and first waypoint metadata of a plurality of waypoint metadata that each include recognition cues for identifying a corresponding waypoint of the plurality of waypoints;

determining an orientation of the user based on the data stream and the recognition cues in the first waypoint metadata;

determining a second waypoint of the plurality of waypoints based on the characteristics in second waypoint metadata of the plurality of waypoint metadata; and

generating a guidance overlay for display to the user based on the orientation, wherein the guidance overlay specifies a direction and a distance to the second waypoint.

8 . The method of claim 7 , wherein the navigation request includes a user objective selected from a group consisting of congestion avoidance, educational, entertainment, nourishment, promptness, and safety, wherein the second waypoint is further based on the user objective.

9 . The method of claim 7 , wherein the capture device is a camera configured to obtain a video stream of a user view, and wherein the identification of the first waypoint is performed by applying object recognition to the video stream.

10 . The method of claim 7 , further comprising providing a game reward to the user when the first waypoint is identified based on the data stream and the first waypoint metadata.

11 . The method of claim 7 , wherein the second way point is determined using a Pareto optimization or a Monte Carlo simulation.

12 . A non-transitory machine-readable storage medium encoded with instructions executable by a processor for behavior tracking and modification using mobile augmented reality, the machine-readable storage medium comprising instruction to:

receive a navigation request for a route to a destination location for a user;

obtain a video stream associated with the user from a camera;

identify a first waypoint of a plurality of waypoints in the video stream base on first waypoint metadata of a plurality of waypoint metadata that each include recognition cues for identifying a corresponding waypoint of the plurality of waypoints;

determine an orientation of the user based on the video stream and the recognition cues in the first waypoint metadata;

determine a second waypoint of the plurality of waypoints based on the characteristics in second waypoint metadata of the plurality of waypoint metadata; and

generate a guidance overlay for display to the user based on the orientation, wherein the guidance overlay specifies a direction and a distance to the second waypoint.

13 . The non-transitory machine-readable storage medium of claim 12 , wherein the navigation request includes a user objective selected from a group consisting of congestion avoidance, educational, entertainment, nourishment, promptness, and safety, wherein the second waypoint is further based on the user objective.

14 . The non-transitory machine-readable storage medium of claim 12 , wherein the instructions are further to provide a game reward to the user when the second waypoint is identified in the video stream based on the second waypoint metadata.

15 . The non-transitory machine-readable storage medium of claim 12 , wherein the second way point is determined using a Pareto optimization or a Monte Carlo simulation.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2017
From: HEWLETT PACKARD ENTERPRISE DEVELOPMENT LP
To: ENT. SERVICES DEVELOPMENT CORPORATION LP
Reel/Frame 041041/0716 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 21, 2016
From: BESS, CHARLES EDGAR; ALLEN, WILLIAM J.
To: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
Reel/Frame 040392/0468 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 21, 2016
From: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
To: HEWLETT PACKARD ENTERPRISE DEVELOPMENT LP
Reel/Frame 040657/0001 →