IP Library Granted Patent US 11,991,418
Granted Patent B1
US 11,991,418 · App. 16/510,869 · Granted May 21, 2024

Methods and apparatus for modifying an augmented and/or virtual reality experience

Inventors: Matt McCarty (Irvine, CA); Hector Medina (Laguna Beach, CA); David Cole (Aliso Viejo, CA); Alan Moss (Laguna Beach, CA)
Assignee: Nevermind Capital LLC
H04N21/47217G06F3/011H04N21/42202
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,991,418
App. No.
16/510,869
Granted
May 21, 2024
Kind
B1
Abstract

Methods and apparatus for implementing a playback system capable of operating as a virtual or augmented reality device are described. In various embodiment one or more environmental triggers are detected and an action is taken based on the detected trigger, user input and/or other environmental conditions. The methods allow a user who is subject to an immersive experience to smoothly transition in/or out of the virtual environment and respond to environmental triggers which may require a user to take an action.

Claims (36)

1. A method of operating a playback system, the method comprising:

presenting, on a display of the playback system, a first immersive content item in a first immersive presentation mode comprising a first set of presentation characteristics, wherein the first immersive content item is presented as part of an immersive content playback session;

detecting, by the playback system, a trigger external to the immersive content playback session;

in response to detecting the trigger external to the immersive content playback session:

determining a trigger type of the detected trigger, wherein the trigger type is at least one of a first type and a second type;

determining, based on the trigger type of the detected trigger, an interface associated with the detected trigger, the interface comprising a second immersive content item associated with the detected trigger;

modifying, by the playback system, the first set of presentation characteristics in accordance with the trigger type to obtain a second immersive presentation mode comprising a second set of presentation characteristics; and

presenting, on the display of the playback system, the interface associated with the detected trigger concurrently with the first immersive content item in the second immersive presentation mode.

2. The method of claim 1 , wherein the trigger type of the detected trigger is an environmental trigger type and wherein the second immersive content item comprises a video stream captured by a camera oriented towards an area of an environment from which the detected trigger was initiated.

3. The method of claim 2 , wherein detecting the trigger comprises detecting a person or animal has entered an area of an environment in which a user of the playback system is located, and wherein the camera oriented towards the area of the environment from which the detected trigger was initiated comprises a head-mounted camera facing away from the user.

4. The method of claim 1 , further comprising:

detecting at least one of an input indicative of a return to the first immersive presentation mode and inactivity of the interface associated with the detected trigger during a predetermined length of time after detecting the trigger; and

presenting, on the display of the playback system and in response to detection of at least one of the input and the inactivity during the predetermined length of time, the first immersive content item in the first immersive presentation mode.

5. The method of claim 1 , wherein the trigger type of the detected trigger is an incoming communication notification type, and wherein the interface associated with the detected trigger comprises an incoming communication notification and at least one communication response option.

6. The method of claim 1 , wherein the trigger type of the detected trigger is content-based trigger type, and wherein the interface associated with the detected trigger type comprises a co-viewing experience option.

7. The method of claim 1 , wherein the first and second immersive content items comprise media content items.

8. The method of claim 1 , wherein the second immersive content item comprises a video stream.

9. The method of claim 1 , wherein the concurrent presentation of the interface of the detected trigger and the first immersive content item provides functionality for a user to respond to the detected trigger via the interface without exiting an immersive experience.

10. The method of claim 1 , further comprising:

in response to the detected trigger being the first type, modifying the first set of presentation characteristics with presentation characteristics associated with the first type; and

in response to the detected trigger being the second type, modifying the first set of presentation characteristics with presentation characteristics associated with the second type.

11. A playback system, comprising:

a receiver configured to detect a trigger external to the playback system;

a display;

a camera; and

a processor configured to:

cause a first immersive content item to be presented on the display in a first immersive presentation mode comprising a first set of presentation characteristics, wherein the first immersive content item is presented as part of an immersive content playback session;

determine a trigger type of the detected trigger, wherein the trigger type is at least one of a first type and a second type;

determine, based on the type of the detected trigger, an interface associated with the detected trigger and comprising a second immersive content item associated with the detected trigger, wherein the detected trigger corresponds to activity occurring external to the immersive content playback session and wherein the second immersive content item is a video image captured by the camera of a surrounding area in which a user of the playback system is located;

modify the first set of presentation characteristics in accordance with the trigger type to obtain a second immersive presentation mode comprising a second set of presentation characteristics; and

cause the interface associated with the detected trigger to be presented on the display concurrently with the first immersive content item, wherein the processor is further configured to cause the first immersive content item to be displayed in the second immersive presentation mode.

12. The playback system of claim 11 , wherein the receiver is further configured to detect at least one of a trigger signal from an external system, an environmental based trigger; and a content based trigger.

13. The playback system of claim 11 , wherein the interface associated with the detected trigger comprises a pause indicator.

14. The playback system of claim 11 , wherein the first and second immersive content items comprise media content items.

15. The playback system of claim 11 , wherein the second immersive content item comprises a video stream.

16. The playback system of claim 11 , wherein the concurrent presentation of the interface of the detected trigger and the first immersive content item provides functionality for a user to respond to the detected trigger via the interface without exiting an immersive experience.

Assignments (2)
NUNC PRO TUNC ASSIGNMENT Recorded Jul 7, 2020
From: NEXTVR INC.
To: NEVERMIND CAPITAL LLC
Reel/Frame 053139/0942 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 4, 2019
From: MCCARTY, MATT; MEDINA, HECTOR; COLE, DAVID; MOSS, ALAN
To: NEXTVR INC.
Reel/Frame 050268/0926 →
Continuity (3)
Provisional Application 62697408 · Jul 13, 2018
Provisional Application 62697404 · Jul 13, 2018
Provisional Application 62697290 · Jul 12, 2018
Cited By (2)
US 12,394,158 US 12,717,594