IP Library Granted Patent US 11,288,878
Granted Patent B2
US 11,288,878 · App. 17/245,618 · Granted Mar 29, 2022

System and method for placement of augmented reality information for users based on their activity

Inventor: Mona Singh (Cary, NC)
Assignee: PCMS Holdings, Inc.
G06T19/006G06F3/012G06K9/00671G06T19/003G06T19/20G06T2219/2004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,288,878
App. No.
17/245,618
Granted
Mar 29, 2022
Kind
B2
Abstract

Systems and methods described herein are provided for receiving location information for a real-world object in a user's augmented reality (AR) view, determining a direction of travel of a user, determining an activity zone shape associated with the direction of travel, responsive to a determination that the real-world object is within the activity zone, rendering on an AR display AR information associated with the real-world object at a location outside an area of the AR display used to display the activity zone. Some embodiments continue to display AR information in the same location if the user changes his or her gaze to read the AR information. Some embodiments render on an AR display subtle highlighting if an object is inside an activity zone and prominent highlighting if an object is outside an activity zone.

Claims (36)

1. A method comprising:

using at least one sensor of an augmented reality (AR) capable device, determining a current activity of a user of the AR capable device;

determining a direction associated with the determined current activity;

determining an activity zone, the activity zone being defined by a geometric shape centered on the determined direction;

selecting a position for an AR annotation of a real-world object in the activity zone, wherein the selecting of the position is performed such that the AR annotation does not obscure the activity zone; and

displaying the AR annotation on the AR capable device at the selected position.

2. The method of claim 1 , wherein the geometric shape is a 2D shape.

3. The method of claim 1 , wherein the geometric shape is a 3D shape.

4. The method of claim 1 , wherein the current activity is motion of the user, and wherein the determined direction is a direction of motion of the user.

5. The method of claim 4 , wherein the sensor includes at least one of the following: an accelerometer, a compass, a GPS, a gyroscope, a camera, or a LIDAR system.

6. The method of claim 1 , wherein the current activity is associated with a salient object, and wherein the activity zone is determined such that it includes the salient object.

7. The method of claim 1 , wherein the current activity is associated with a plurality of salient objects, and wherein the activity zone is determined such that it includes the plurality of salient objects.

8. The method of claim 1 , further comprising:

using the least one sensor, determining that the current activity of the user has changed;

updating the activity zone according to the changed current activity; and

updating the position of the AR annotation such that the AR annotation does not obscure the activity zone.

9. The method of claim 1 , wherein selecting a position for an AR annotation for the real-world object in the activity zone comprises placing the AR annotation a location along a periphery of the activity zone closest to the location of the real-world object.

10. The method of claim 1 , further comprising displaying a graphic connection between the AR annotation and the real-world object.

11. The method of claim 1 , wherein the activity zone is a circle, an oval, or a rectangle.

12. The method of claim 1 , wherein the activity zone is conical.

13. The method of claim 1 , further comprising displaying a graphical indication of the extent of the activity zone.

14. A system comprising a processor and a non-transitory computer-readable medium storing instructions that are operative, when executed on the processor, to perform functions comprising:

using at least one sensor of an augmented reality (AR) capable device, determining a current activity of a user of the AR capable device;

determining a direction associated with the determined current activity;

determining an activity zone, the activity zone being defined by a geometric shape centered on the determined direction;

selecting a position for an AR annotation of a real-world object in the activity zone, wherein the selecting of the position is performed such that the AR annotation does not obscure the activity zone; and

displaying the AR annotation on the AR capable device at the selected position.

15. The system of claim 14 , wherein the current activity is motion of the user, and wherein the determined direction is a direction of motion of the user.

16. The system of claim 14 , wherein the current activity is associated with a salient object, and wherein the activity zone is determined such that it includes the salient object.

17. The system of claim 14 , further configured to perform:

using the least one sensor, determining that the current activity of the user has changed;

updating the activity zone according to the changed current activity; and

updating the position of the AR annotation such that the AR annotation does not obscure the activity zone.

18. The system of claim 14 , wherein selecting a position for an AR annotation for the real-world object in the activity zone comprises placing the AR annotation a location along a periphery of the activity zone closest to the location of the real-world object.

19. The system of claim 14 , wherein the activity zone is a circle, an oval, or a rectangle.

20. The system of claim 14 , wherein the activity zone is conical.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 7, 2023
From: PCMS HOLDINGS, INC.
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 062900/0645 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 11, 2022
From: SINGH, MONA
To: PCMS HOLDINGS, INC.
Reel/Frame 058618/0633 →
Continuity (3)
Continuation 16466600
Provisional Application 62437455 · Dec 21, 2016
Related Publication 20210248833A1 · Aug 12, 2021
Cited By (1)
US 12,437,487