IP Library Granted Patent US 11,526,211
Granted Patent B2
US 11,526,211 · App. 16/401,707 · Granted Dec 13, 2022

Methods and apparatus for controlling, implementing and supporting trick play in an augmented reality device

Inventors: Hector Medina (Laguna Beach, CA); Alan McKay Moss (Laguna Beach, CA); David Cole (Aliso Viejo, CA)
Assignee: Nevermind Capital LLC
G06F3/017G06F3/0346G06T19/006H04N21/2387H04N21/41407
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,526,211
App. No.
16/401,707
Granted
Dec 13, 2022
Kind
B2
Abstract

Methods and Apparatus for controlling, implementing and supporting trick Play in an augmented reality (AR) device are described. Detected changes in AR device orientation and/or AR device position are detected and used in controlling temporal playback operations.

Claims (57)

1. A method of operating a playback device, the method comprising:

displaying image content captured by a camera of the playback device and at least some additional image content;

detecting user input indicative of activation of a temporal replay-enabled control interface;

switching from a first mode of operation to a temporal replay-enabled mode of operation in response to detecting activation of the temporal replay-enabled control interface; and

detecting, in the temporal replay-enabled mode, a rotational change around an axis of the playback device,

wherein, in the temporal replay-enabled mode, the rotational change of the playback device controls a playback of the at least some additional image content relative to the display of the image content captured by the camera, such that the display of the at least some additional image content is different from the playback of the image content captured by the camera.

2. The method of claim 1 , wherein the additional image content comprises content corresponding to a sporting event.

3. The method of claim 1 , wherein the additional image content is video content.

4. The method of claim 1 , further comprising:

controlling, during the temporal replay-enabled mode of operation, the playback of the at least some additional content relative to the playback of the image content captured by the camera based on the detected rotational change of the playback device.

5. The method of claim 4 , further comprising:

detecting a rate of rotational change of the playback device; and

controlling a playback speed of the at least some additional content relative to the playback of the image content captured by the camera based on the rate of rotational change.

6. The method of claim 5 , wherein detecting the rotational change of the playback device comprises detecting a rotation of the playback device; and

wherein controlling the playback speed comprises performing one of i) a fast forward operation or ii) a reverse operation, wherein the fast forward operation is performed in response to rotation of the playback device in a first direction, and wherein the reverse operation is performed in response to rotation of the playback device in a second direction.

7. The method of claim 6 , further comprising:

storing information indicative of a default orientation of the playback device, wherein the default orientation of the playback device comprises an orientation of the playback device at an activation time of the temporal replay-enabled mode of operation and corresponds to playback of the additional image content at a normal playback rate;

wherein controlling the playback speed further comprises:

detecting a rotation from the default orientation of the playback device that satisfies a criterion, wherein the criterion corresponds to an amount of rotation sufficient to trigger controlling the playback speed; and

initiating, in response to detecting the rotation that satisfies the criterion, controlling the playback speed.

8. The method of claim 1 , further comprising:

determining a direction of a rotation of the playback device;

implementing a fast forward operation in response to a clockwise rotation of the playback device; and

implementing a reverse operation in response to a counterclockwise rotation of the playback device.

9. The method of claim 8 , further comprising:

controlling a speed of the fast forward operation or the reverse operation based on an amount of detected rotation.

10. The method of claim 8 , further comprising:

controlling a speed of the fast forward operation or the reverse operation based on a length of time a detected rotation exceeds a rotation used to enable the fast forward operation or the reverse operation.

11. The method of claim 7 , further comprising:

detecting an orientation of the playback device indicative of a disablement of the controlling the playback speed of the at least some additional content; and

switching to the normal playback rate in response to the disablement of the controlling the playback speed.

12. The method of claim 1 , further comprising adjusting, in accordance with the rotational change of the playback device, the playback of the at least some additional image content to maintain the orientation of the at least some additional image content relative to the display of the image content.

13. A playback device, comprising:

a camera;

a display;

a processor configured to:

cause to be displayed, on the display, image content captured by the camera and at least some additional image content;

detect user input indicative of activation of a temporal replay-enabled control interface;

switch from a first mode of operation to a temporal replay-enabled mode of operation in response to detecting activation of the temporal replay-enabled control interface; and

detect, in the temporal replay-enabled mode, a rotational change around an axis of the playback device,

wherein, in the temporal replay-enabled mode, the rotational change of the playback device controls a playback of the at least some additional image content relative to the display of the image content captured by the camera, such that the display of the at least some additional image content is different from the playback of the image content captured by the camera.

14. The playback device of claim 13 , wherein the processor is further configured to:

control, during the temporal replay-enabled mode of operation, the playback of the at least some additional image content relative to the playback of the image content captured by the camera based on the detected rotational change of the playback device.

15. The playback device of claim 14 , further comprising:

an inertial measurement unit (IMU) including at least one gyroscope for measuring angular rate; and

wherein the processor is further configured to:

determine the rotational change of the playback device based on angular rate measurements from the gyroscope.

16. The playback device of claim 13 , wherein the processor is further configured to:

determine a direction of a rotation of the playback device;

implementing a fast forward operation in response to a clockwise rotation of the playback device; and

implementing a reverse operation in response to a counterclockwise rotation of the playback device.

17. The playback device of claim 16 , wherein the processor is further configured to:

control a speed of the fast forward operation or the reverse operation based on an amount of detected rotation.

18. The playback device of claim 16 , wherein the processor is further configured to:

control a speed of the fast forward operation or the reverse operation based on a length of time a detected rotation exceeds a rotation used to enable the fast forward operation or the reverse operation.

19. The method of claim 1 , wherein the image content captured by the camera comprises near real-time image content.

20. The playback device of claim 13 , wherein the image content captured by the camera comprises near real-time image content.

Assignments (2)
NUNC PRO TUNC ASSIGNMENT Recorded Jul 7, 2020
From: NEXTVR INC.
To: NEVERMIND CAPITAL LLC
Reel/Frame 053139/0942 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2019
From: MEDINA, HECTOR; MOSS, ALAN MCKAY; COLE, DAVID
To: NEXTVR INC.
Reel/Frame 049067/0017 →
Continuity (2)
Provisional Application 62668778 · May 8, 2018
Related Publication 20190346933A1 · Nov 14, 2019