IP Library Granted Patent US 11,468,604
Granted Patent B2
US 11,468,604 · App. 16/451,526 · Granted Oct 11, 2022

Methods and systems for providing a notification in association with an augmented-reality view

Inventors: Robert Carl Jagnow (Mountain View, CA); Joanna Kim (Mountain View, CA); Catherine Most (San Francisco, CA); Andre Quang Le (San Francisco, CA); Alex Jacobo-Blonder (Fort Lee, NJ); Kasey Klimes (San Francisco, CA); Dominik Kaeser (New York, NY); Rachel Elizabeth Inman (San Francisco, CA)
Assignee: GOOGLE LLC
G06T11/00G06T7/20H04L67/55G06T2210/62G08B21/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,468,604
App. No.
16/451,526
Granted
Oct 11, 2022
Kind
B2
Abstract

The present disclosure is directed to providing a notification in association with an augmented reality (AR) view. In particular, one or more computing devices can generate, for display by at least one of the computing device(s), an interface depicting an AR view of at least a portion of a physical real-world environment. In accordance with aspects of the disclosure, based at least in part on detected movement of the at least one of the computing device(s), the computing device(s) can transition amongst multiple different stages of one or more elements included in the interface to notify a viewer of the interface to mind their situational awareness of the physical real-world environment.

Claims (35)

1. A computer-implemented method comprising:

generating, by a computing device and for display by the computing device, an interface depicting an augmented reality (AR) view of at least a portion of a physical real-world environment, the AR view including one or more displayed augmented reality elements;

determining, by the computing device, a velocity of the computing device;

generating, by the computing device, a heuristic value based on the determined velocity, wherein the heuristic value increases at a heuristic velocity different from the determined velocity and decreases at a cooldown velocity different from the determined velocity;

determining, by the computing device, that the heuristic value has increased to exceed a heuristic threshold, wherein the heuristic value increases at the heuristic velocity when the determined velocity exceeds an upper velocity threshold and the heuristic value decreases at the cooldown velocity when the determined velocity is below a lower velocity, threshold; and

in response to determining that the heuristic value has increased to exceed the heuristic threshold, providing, by the computing device, one or more notifications to a viewer of the interface by transitioning an augmented reality element in the one or more displayed augmented reality elements that was displayed in the AR view prior to determining that the heuristic value exceeds the heuristic threshold for a predetermined period of time from a first stage to a second stage to notify a viewer of the interface to mind their situational awareness of the physical real-world environment.

2. The computer-implemented method of claim 1 , wherein transitioning the augmented reality element in the one or more displayed augmented reality elements that was displayed in the AR view prior to determining that the heuristic value has increased to exceed the heuristic threshold from a first stage to a second stage comprises changing whether at least a portion of the augmented reality element is displayed.

3. The computer-implemented method of claim 1 , wherein transitioning the augmented reality element in the one or more displayed augmented reality elements that was displayed in the AR view prior to determining that the heuristic value has increased to exceed the heuristic threshold from a first stage to a second stage comprises changing one or more transparency, opacity, or gradient levels at which at least a portion of the augmented reality element is displayed.

4. The computer-implemented method of claim 3 , wherein the at least a portion of the augmented reality element is at least partially obscuring the AR view.

5. The computer-implemented method of claim 1 , wherein transitioning the augmented reality element in the one or more displayed augmented reality elements that was displayed in the AR view prior to determining that the heuristic value has increased to exceed the heuristic threshold from a first stage to a second stage comprises increasing a prominence of at least a portion of the augmented reality element based at least in part on an increase in the heuristic value.

6. The computer-implemented method of claim 1 , wherein transitioning the augmented reality element in the one or more displayed augmented reality elements that was displayed in the AR view prior to determining that the heuristic value has increased to exceed the heuristic threshold from a first stage to a second stage comprises reducing a prominence of at least a portion of the augmented reality element based at least in part on a decrease in the heuristic value.

7. The computer-implemented method of claim 1 , wherein transitioning the augmented reality element in the one or more displayed augmented reality elements that was displayed in the AR view prior to determining that the heuristic value has increased to exceed the heuristic threshold a first stage to a second stage comprises increasing a prominence of at least a portion of the augmented reality element based at least in part on a duration of time during which the heuristic value exceeded the heuristic threshold.

8. The computer-implemented method of claim 1 , wherein transitioning the augmented reality element in the one or more displayed augmented reality elements that was displayed in the AR view prior to determining that the heuristic value has increased to exceed the heuristic threshold from a first stage to a second stage comprises reducing a prominence of at least a portion of the augmented reality element based at least in part on time elapsed since the heuristic value increased to exceed the heuristic threshold.

9. The computer-implemented method of claim 1 , wherein transitioning the augmented reality element in the one or more displayed augmented reality elements that was displayed in the AR view prior to determining that the heuristic value has increased to exceed the heuristic threshold from a first stage to a second stage comprises transitioning to a first stage of multiple different stages based at least in part on a determined velocity associated with the heuristic value.

10. The computer-implemented method of claim 9 , wherein transitioning the augmented reality element in the one or more displayed augmented reality elements that was displayed in the AR view prior to determining that the heuristic value has increased to exceed the heuristic threshold from a first stage to a second stage comprises transitioning to the second stage of the multiple different stages based at least in part on time elapsed since transitioning to the first stage.

11. The computer-implemented method of claim 1 , wherein transitioning the augmented reality element in the one or more displayed augmented reality elements that was displayed in the AR view prior to determining that the heuristic value has increased to exceed the heuristic threshold from a first stage to a second stage comprises transitioning amongst the at least a portion of multiple different stages based at least in part on a current state of a finite-state machine comprising multiple different and distinct states defined at least in part by one or more thresholds of the heuristic value.

12. The computer-implemented method of claim 11 , wherein the multiple different and distinct states include a state characterized by limited detected movement.

13. The computer-implemented method of claim 11 , wherein the multiple different and distinct states include a state characterized by disregarding detected movement.

14. A system comprising:

one or more processors; and

a memory storing instructions that when executed by the one or more processors cause the system to perform operations comprising:

generating, for display by at least one computing device, an interface depicting an augmented reality (AR) view of at least a portion of a physical real-world environment, the AR view including one or more displayed augmented reality elements;

determining a velocity of the computing device;

generating a heuristic value based on the determined velocity, wherein the heuristic value increases at a heuristic velocity different from the determined velocity and decreases at a cooldown velocity, different from the determined velocity;

determining that the heuristic value has increased to exceed a heuristic threshold, wherein the heuristic value increases at the heuristic velocity when the determined velocity exceeds an upper velocity threshold and the heuristic value decreases at the cooldown velocity when the determined velocity is below a lower velocity threshold; and

in response to determining that the heuristic value has increased to exceed the heuristic threshold, providing one or more notifications to a viewer of the interface by transitioning an augmented reality element in the one or more displayed augmented reality elements that was displayed in the AR view prior to determining that the heuristic value exceeds the heuristic threshold from a first stage to a second stage to notify a viewer of the interface to mind their situational awareness of the physical real-world environment.

15. The system of claim 14 , wherein transitioning the augmented reality element in the one or more displayed augmented reality elements that was displayed in the AR view prior to determining that the heuristic value has increased to exceed the heuristic threshold from a first stage to a second stage comprises changing whether at least a portion of the augmented reality element is displayed.

16. The system of claim 14 , wherein transitioning the augmented reality element in the one or more displayed augmented reality elements that was displayed in the AR view prior to determining that the heuristic value has increased to exceed the heuristic threshold from a first stage to a second stage comprises changing one or more transparency, opacity, or gradient levels at which at least a portion of the augmented reality element are displayed.

17. The system of claim 16 , wherein the at least a portion of the augmented reality element is at least partially obscuring the AR view.

18. One or more non-transitory computer-readable media comprising instructions that when executed by one or more computing devices cause the one or more computing devices to perform operations comprising:

generating, for display by at least one of the one or more computing devices, an interface depicting an augmented reality (AR) view of at least a portion of a physical real-world environment, the AR view including one or more displayed augmented reality elements;

determining, by the computing device; a velocity of the computing device;

generating, by the computing device, a heuristic value based on the determined velocity; wherein the heuristic value increases at a heuristic velocity different from the determined velocity and decreases at a cooldown velocity different from the determined velocity;

determining that the heuristic value has increased to exceed a heuristic threshold, wherein the heuristic value increases at the heuristic velocity when the determined velocity exceeds an upper velocity threshold and the heuristic value decreases at the cooldown velocity when the determined velocity is below a lower velocity threshold; and

in response to determining that the heuristic value has increased to exceed the heuristic threshold, providing one or more notifications to a viewer of the interface by transitioning an augmented reality element in the one or more displayed augmented reality elements that was displayed in the AR view prior to determining that the heuristic value exceeds the heuristic threshold from a first stage to a second stage to notify a viewer of the interface to mind their situational awareness of the physical real-world environment.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 9, 2019
From: JAGNOW, ROBERT CARL; KIM, JOANNA; MOST, CATHERINE; LE, ANDRE QUANG
To: GOOGLE LLC
Reel/Frame 050013/0730 →
Continuity (1)
Related Publication 20200410720A1 · Dec 31, 2020
Cited By (1)
US 12,315,363