IP Library Granted Patent US 10,120,437
Granted Patent B2
US 10,120,437 · App. 15/011,119 · Granted Nov 6, 2018

Methods and systems for associating input schemes with physical world objects

Inventor: Edison Lin (Menlo Park, CA)
Assignee: Rovi Guides, Inc.
G06F3/011G06F3/017G06F3/167H04N21/41407H04N21/4223H04N21/4532H04N21/4755H04N21/47202H04N21/4821
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,120,437
App. No.
15/011,119
Granted
Nov 6, 2018
Kind
B2
Abstract

A media guidance application that allows users to associate input schemes with physical objects in an augmented reality environment is disclosed. Specifically, the media guidance application may recognize physical objects in an augmented reality environment and allow users to identify input schemes to associate with the physical objects. Such input schemes may define ways in which the users may control presentation of media content by interacting with the physical objects.

Claims (44)

1. A method for controlling presentation of media content with physical world objects, the method comprising:

storing a first digital description of a first physical object in an augmented reality environment of a user;

receiving a user input from the user assigning an input scheme for controlling a presentation of media content to the first physical object by:

receiving a voice input from the user identifying an attribute of the presentation of the media content to be controlled;

detecting a user gesture occurring simultaneously with the receiving of the voice input, identifying an interaction with the first physical object that controls the attribute; and

associating the detected user gesture with the attribute identified by the voice input from the user based on the user gesture occurring simultaneously with the receiving of the voice input; and

after receiving the user input assigning the input scheme for controlling presentation of media content to the first physical object:

detecting the first physical object in the augmented reality environment by comparing digital descriptions of physical objects in the augmented reality environment to the first digital description of the first physical object; and

in response to detecting the first physical object in the augmented reality environment, controlling presentation of media content using the input scheme.

2. The method of claim 1 , wherein the first digital description of the first physical object is created using image segmentation and edge detection on an image of the first physical object.

3. The method of claim 1 , wherein the first digital description of the first physical object is an alphanumeric value describing the shape and color of the first physical object.

4. The method of claim 1 , wherein the user initially identifies the first physical object by performing a hand gesture over the first physical object.

5. The method of claim 1 , wherein the input scheme for controlling presentation of media content is one of a plurality of predefined input schemes, each associated with a physical object.

6. The method of claim 1 , wherein the user input assigning an input scheme for controlling presentation of media content to the first physical object includes navigating to the input scheme in a list of predefined input schemes.

7. The method of claim 1 , wherein storing a first digital description of a first physical object in an augmented reality environment comprises:

creating an object identifier associated with the first physical object; and

storing the object identifier and the first digital description in a database listing object identifiers, each corresponding to a digital description.

8. The method of claim 7 , further comprising storing a media asset identifier associated with the media asset and the object identifier in a database listing object identifiers, each corresponding to a media asset.

9. The method of claim 1 wherein controlling the presentation of the media content using the input scheme comprises:

detecting an additional user gesture that matches the user gesture identifying the interaction with the first physical object that controls the attribute; and

adjusting the attribute of the presentation of the media content based on detecting the additional user gesture.

10. The method of claim 9 , wherein the attribute of the presentation of the media content comprises at least one of: volume of the presentation of the media content, playback speed of the presentation of the media content, and pause/play functionality of the presentation of the media content.

11. A system for controlling presentation of media content with physical world objects, the system comprising:

storage circuitry configured to store a first digital description of a first physical object in an augmented reality environment of a user; and

control circuitry configured to:

receive a user input from the user assigning an input scheme for controlling a presentation of media content to the first physical object by:

receiving a voice input from the user identifying an attribute of the presentation of the media content to be controlled;

detecting a user gesture occurring simultaneously with the receiving of the voice input, identifying an interaction with the first physical object that controls the attribute; and

associating the detected user gesture with the attribute identified by the voice input from the user based on the user gesture occurring simultaneously with the receiving of the voice input; and

after receiving the user input assigning the input scheme for controlling presentation of media content to the first physical object:

detect the first physical object in the augmented reality environment by comparing digital descriptions of physical objects in the augmented reality environment to the first digital description of the first physical object; and

in response to detecting the first physical object in the augmented reality environment, control presentation of media content using the input scheme.

12. The system of claim 11 , wherein the first digital description of the first physical object is created using image segmentation and edge detection on an image of the first physical object.

13. The system of claim 11 , wherein the first digital description of the first physical object is an alphanumeric value describing the shape and color of the first physical object.

14. The system of claim 11 , wherein the user initially identifies the first physical object by performing a hand gesture over the first physical object.

15. The system of claim 11 , wherein the input scheme for controlling presentation of media content is one of a plurality of predefined input schemes, each associated with a physical object.

16. The system of claim 11 , wherein the user input assigning an input scheme for controlling presentation of media content to the first physical object includes navigating to the input scheme in a list of predefined input schemes.

17. The system of claim 11 , wherein control circuitry is further configured, when storing a first digital description of a first physical object in an augmented reality environment, to create an object identifier associated with the first physical object; and

storage circuitry further configured to store the object identifier and the first digital description in a database listing object identifiers, each corresponding to a digital description.

18. The system of claim 17 , further comprising storing a media asset identifier associated with the media asset and the object identifier in a database listing object identifiers, each corresponding to a media asset.

19. The system of claim 11 wherein the control circuitry is configured to control the presentation of the media content using the input scheme by:

detecting an additional user gesture that matches the user gesture identifying the interaction with the first physical object that controls the attribute; and

adjusting the attribute of the presentation of the media content based on detecting the additional user gesture.

20. The system of claim 19 , wherein the attribute of the presentation of the media content comprises at least one of: volume of the presentation of the media content, playback speed of the presentation of the media content, and pause/play functionality of the presentation of the media content.

Assignments (7)
CHANGE OF NAME Recorded Oct 2, 2024
From: ROVI GUIDES, INC.
To: ADEIA GUIDES INC.
Reel/Frame 069085/0731 →
RELEASE OF SECURITY INTEREST Recorded Jun 5, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
Reel/Frame 053481/0790 →
RELEASE OF SECURITY INTEREST Recorded Jun 5, 2020
From: HPS INVESTMENT PARTNERS, LLC
To: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
Reel/Frame 053458/0749 →
SECURITY INTEREST Recorded Jun 1, 2020
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS INC.; VEVEO, INC.; INVENSAS CORPORATION; INVENSAS BONDING TECHNOLOGIES, INC.; TESSERA, INC.; TESSERA ADVANCED TECHNOLOGIES, INC.; DTS, INC.; PHORUS, INC.; IBIQUITY DIGITAL CORPORATION
To: BANK OF AMERICA, N.A.
Reel/Frame 053468/0001 →
PATENT SECURITY AGREEMENT Recorded Nov 25, 2019
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Reel/Frame 051110/0006 →
SECURITY INTEREST Recorded Nov 22, 2019
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
To: HPS INVESTMENT PARTNERS, LLC, AS COLLATERAL AGENT
Reel/Frame 051143/0468 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 23, 2016
From: LIN, EDISON
To: ROVI GUIDES, INC.
Reel/Frame 037802/0959 →
Continuity (1)
Related Publication 20170220103A1 · Aug 3, 2017
Cited By (1)
US 12,399,551