IP Library Granted Patent US 10,277,933
Granted Patent B2
US 10,277,933 · App. 13/457,534 · Granted Apr 30, 2019

Method and device for augmenting user-input information related to media content

Inventors: Narayanan Venkitaraman (Palatine, IL); Santosh S. Basapur (Hanover Park, IL); Shirley A. Chaysinh (Grayslake, IL); Young S. Lee (Palatine, IL); Hiren M. Mandalia (Elk Grove Village, IL)
Assignee: ARRIS Enterprises LLC
H04N21/254H04N21/4316H04N21/478H04N21/4722H04N21/4882H04N21/854G06F17/3082G06F17/30817
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,277,933
App. No.
13/457,534
Granted
Apr 30, 2019
Kind
B2
Abstract

Disclosed is a method of augmenting user-input information that includes associating a first secondary device with primary media content, receiving user-input information input at the first secondary device, and analyzing the user-input information to identify user-content metadata. The method further includes at least one of: receiving primary-content metadata related to the primary media content and deriving primary-content metadata from the primary media content and identifying associations between the user-content metadata and the primary-content metadata.

Claims (53)

1. A method of augmenting user comments, the method comprising:

associating a first secondary device with a primary media device, the primary media device for displaying media content, and wherein the first secondary device comprises a secondary display device, a user interface for entering an input, and a client application for providing the user interface;

receiving, in the first secondary device, a user comment that is provided as the input at the first secondary device by a user of the first secondary device, wherein the input of the user comment is during and responsive to a display of a primary media content on the primary media device for viewing by the user;

analyzing the user comment to automatically generate user-content metadata comprising one or more of a keyword from the user comment and a key phrase from the user comment;

at least one of: receiving primary-content metadata related to the primary media content and deriving primary-content metadata from the primary media content,

wherein the primary-content metadata comprises information identifying a person speaking in the primary media content at a time of the display of the primary media content on the primary media device for viewing by the user, the time associated with the input of the user comment; and further comprises information spoken by the person during or proximate to the time; and

in one or more devices, using the user-content metadata and the primary-content metadata to automatically generate an identified association between the user comment and the primary-content metadata, the generating comprising analyzing the user-content metadata and the primary-content metadata to identify one or more associations between the user-content metadata and the primary-content metadata,

wherein the primary-content metadata comprises information relating to a specific viewable object displayed in a scene in the primary media content, and wherein the identified association includes information that relates the user comment to the specific viewable object displayed by the primary media device during the receiving of the user comment by the first secondary device.

2. The method of claim 1 wherein the specific viewable object displayed in a scene in the primary media content is one of: a person, a feature, an article, an item associated with a brand identity, an item associated with model information, an item associated with review information, an item associated with price information, an item associated with specifications information, an item of clothing, an item of food, a room, and a scene location.

3. The method of claim 1 further comprising enhancing viewable primary media content by displaying at least a part of the user comment along with the primary media content.

4. The method of claim 1 :

further comprising providing for display to a user of the first secondary device one or more of the identified associations;

wherein the user comment includes at least one of: a text-based and a voice-based user comment.

5. The method of claim 4 wherein deriving primary-content metadata is accomplished by at least one of: a server, the first secondary device, the primary media source, and the primary media device.

6. The method of claim 1 further comprising storing the identified associations for retrieval by a second secondary device separate from the first secondary device to which the user comment was first input.

7. The method of claim 6 further comprising viewing the identified associations on a user interface displayed on the first secondary device.

8. The method of claim 1 :

further comprising communicating at least a portion of the primary-content metadata from the first secondary device to a server;

wherein the primary-content metadata are derived from the primary media content provided at least in part by the first secondary device.

9. The method of claim 8 further comprising transmitting primary-content metadata to the first secondary device for association with user-content metadata.

10. A method of operating a first secondary device in a manner that complements operation of a primary media device for displaying media content, the method comprising:

establishing an association of the first secondary device with respect to the primary media device, wherein the first secondary device comprises a secondary display device, a user interface for entering a user comment, and a client application for providing the user interface;

receiving, in the first secondary device, the user comment that is provided to the first secondary device by a user of the first secondary device, wherein the user comment relates to a primary media content that is concurrently output by the primary media device for viewing by the user during the receiving;

analyzing the user comment, wherein the user comment comprises a user comment responsive to the output of the primary media content;

analyzing the primary media content; and

in one or more devices, automatically generating an identified association of the user comment, based at least on a first result from the analyzing of the user comment and a second result from the analyzing of the primary media content, wherein the first result comprises one or more of a keyword from the user comment and a key phrase from the user comment, and the second result comprises information relating to a specific viewable object displayed in a scene in the primary media content, to identify one or more associations between the user comment and the primary media content;

wherein the information relating to the specific viewable object comprises information identifying a person speaking in the primary media content at a time of the concurrent output of the primary media content on the primary media device for viewing by the user, the time associated with the receiving of the user comment; and further comprises information spoken by the person during or proximate to the time; and

wherein the identified association includes information that relates the user comment to the specific viewable object displayed by the primary media device during the receiving of the user comment by the first secondary device.

11. The method of claim 10 wherein analyzing the user comment includes identifying user-content metadata associated with the user comment.

12. The method of claim 11 wherein analyzing the primary media content includes at least one of: analyzing the primary media content to identify primary-content metadata associated with the primary media content and accessing pre-derived primary-content metadata.

13. The method of claim 12 wherein analyzing the user comment includes utilizing an extractor that extracts at least one keyword or key phrase from the user comment to form at least a part of the user-content metadata.

14. The method of claim 13 wherein analyzing the primary media content includes utilizing one or both of a media analyzer and an object detector to identify one or more of: an object, a location, speech, and text, to form at least a part of the primary-content metadata.

15. The method of claim 14 wherein identifying associations between the user comment and the primary media content includes identifying primary-content metadata that are similar to user-content metadata.

16. The method of claim 15 further comprising creating augmented user-input information by augmenting at least a portion of the user comment to include at least a portion of primary-content metadata that are associated therewith.

17. The method of claim 16 further comprising storing the augmented user-input information for retrieval by at least one of the first secondary device and a second secondary device.

18. The method of claim 16 wherein the primary media device is a display device and the first secondary device is a mobile device wherein the user interface is configured to provide viewing of at least a portion of the augmented user-input information.

19. A system for receiving supplemental information related to a primary media content, the system comprising:

a mobile device associated with and distinct from another device, wherein the mobile device comprises a display device, a user interface, and a client application for providing the user interface;

the user interface of the mobile device, configured to receive and display a user comment on the mobile device, wherein the user comment is received from a user responsive to a viewing of the primary media content;

a transmitter inside the mobile device configured to transmit at least a portion of the user comment to the other device that contains the primary media content, the primary media content comprising a scene that was viewable by a user of the mobile device at a time when the user comment was, at least in part, input into the mobile device during the viewing of the primary media content; and

a receiver inside the mobile device configured to receive a communication from the other device, wherein the communication includes an augmented user-input information that comprises the user comment and further includes one or more of: an object list that includes association information that relates the user comment to a specific viewable object displayed in the scene, and object-identification information that includes association information that relates the user comment to a specific physical object viewable in the scene,

wherein the augmented user-input information further includes one or more of: primary-content metadata derived from primary media content that are associated with the scene, and user-content metadata derived from the user comment,

wherein the primary-content metadata comprises information identifying a person speaking in the primary media content at the time, and further comprises information spoken by the person during or proximate to the time, and

wherein the association information is automatically generated based at least on a result from an analysis of the user comment, the result comprising one or more of a keyword from the user comment and a key phrase from the user comment, and further based at least on an analysis of the primary media content.

20. A method of enhancing primary media content, the method comprising:

receiving a user comment on a secondary device associated with and distinct from a primary media device, wherein the secondary device comprises a secondary display device, a user interface for entering the user comment, and a client application for providing the user interface;

obtaining user-content metadata from the user comment, the user-content metadata comprising one or more of a keyword from the user comment and a key phrase from the user comment;

receiving, in the secondary device, primary-content metadata related to a primary media content that was displayed on the primary media device at a time, for viewing by a user of the secondary device during the receiving of the user comment in the secondary device;

wherein the primary-content metadata comprises information identifying a person speaking in the primary media content at the time, and further comprises information spoken by the person during or proximate to the time, and

determining whether the user comment is responsive to the display of the primary media content by analyzing the user-content metadata and the primary-content metadata; and

in one or more devices, based at least on the determining whether the user comment is responsive to the display of the primary media content, generating an augmented user comment by automatically associating the primary-content metadata and the user comment, wherein the augmented user comment includes automatically generated association information that relates the user comment to a specific viewable physical object displayed in one or more scenes viewable in the primary media content.

21. The method of claim 20 further including enhancing the primary media content by displaying at least a part of the augmented user comment on the primary media device when the augmented user comment is being viewed by the user on the secondary device.

22. The method of claim 21 further including displaying at least a part of the augmented user comment on the secondary device.

Assignments (14)
RELEASE OF SECURITY INTEREST AT REEL/FRAME 049905/0504 Recorded Dec 19, 2024
From: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
To: ARRIS ENTERPRISES LLC (F/K/A ARRIS ENTERPRISES, INC.); ARRIS TECHNOLOGY, INC.; ARRIS SOLUTIONS, INC.; COMMSCOPE, INC. OF NORTH CAROLINA; COMMSCOPE TECHNOLOGIES LLC; RUCKUS WIRELESS, LLC (F/K/A RUCKUS WIRELESS, INC.)
Reel/Frame 071477/0255 →
SECURITY INTEREST Recorded Dec 17, 2024
From: ARRIS ENTERPRISES LLC; COMMSCOPE TECHNOLOGIES LLC; COMMSCOPE INC., OF NORTH CAROLINA; OUTDOOR WIRELESS NETWORKS LLC; RUCKUS IP HOLDINGS LLC
To: APOLLO ADMINISTRATIVE AGENCY LLC
Reel/Frame 069889/0114 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2022
From: ARRIS TECHNOLOGY, INC.
To: ARRIS ENTERPRISES, INC.
Reel/Frame 060791/0583 →
SECURITY INTEREST Recorded Nov 19, 2021
From: ARRIS SOLUTIONS, INC.; ARRIS ENTERPRISES LLC; COMMSCOPE TECHNOLOGIES LLC; COMMSCOPE, INC. OF NORTH CAROLINA; RUCKUS WIRELESS, INC.
To: WILMINGTON TRUST
Reel/Frame 060752/0001 →
PATENT SECURITY AGREEMENT Recorded Jul 3, 2019
From: ARRIS ENTERPRISES LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 049820/0495 →
TERM LOAN SECURITY AGREEMENT Recorded Jul 3, 2019
From: COMMSCOPE, INC. OF NORTH CAROLINA; COMMSCOPE TECHNOLOGIES LLC; ARRIS ENTERPRISES LLC; ARRIS TECHNOLOGY, INC.; RUCKUS WIRELESS, INC.; ARRIS SOLUTIONS, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 049905/0504 →
ABL SECURITY AGREEMENT Recorded Jul 3, 2019
From: COMMSCOPE, INC. OF NORTH CAROLINA; COMMSCOPE TECHNOLOGIES LLC; ARRIS ENTERPRISES LLC; ARRIS TECHNOLOGY, INC.; RUCKUS WIRELESS, INC.; ARRIS SOLUTIONS, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 049892/0396 →
CHANGE OF NAME Recorded Jul 2, 2019
From: ARRIS ENTERPRISES, INC.
To: ARRIS ENTERPRISES LLC
Reel/Frame 049649/0062 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Apr 8, 2019
From: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
To: ARRIS GROUP, INC.; ARRIS ENTERPRISES, INC.; ARRIS SOLUTIONS, INC.; ARRIS KOREA, INC.; ARRIS HOLDINGS CORP. OF ILLINOIS, INC.; BIG BAND NETWORKS, INC.; TEXSCAN CORPORATION; POWER GUARD, INC.; 4HOME, INC.; ACADIA AIC, INC.; AEROCAST, INC.; BROADBUS TECHNOLOGIES, INC.; GENERAL INSTRUMENT CORPORATION; GENERAL INSTRUMENT AUTHORIZATION SERVICES, INC.; GENERAL INSTRUMENT INTERNATIONAL HOLDINGS, INC.; IMEDIA CORPORATION; JERROLD DC RADIO, INC.; LEAPSTONE SYSTEMS, INC.; MODULUS VIDEO, INC.; MOTOROLA WIRELINE NETWORKS, INC.; NETOPIA, INC.; NEXTLEVEL SYSTEMS (PUERTO RICO), INC.; QUANTUM BRIDGE COMMUNICATIONS, INC.; SETJAM, INC.; SUNUP DESIGN SYSTEMS, INC.; UCENTRIC SYSTEMS, INC.; GIC INTERNATIONAL HOLDCO LLC; GIC INTERNATIONAL CAPITAL LLC; CCE SOFTWARE LLC; THE GI REALTY TRUST 1996
Reel/Frame 048825/0294 →
CHANGE OF NAME Recorded Mar 13, 2019
From: ARRIS ENTERPRISES, INC.
To: ARRIS ENTERPRISES LLC
Reel/Frame 050128/0986 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2015
From: ARRIS TECHNOLOGY, INC
To: ARRIS ENTERPRISES, INC.
Reel/Frame 037328/0341 →
MERGER AND CHANGE OF NAME Recorded Mar 10, 2015
From: GENERAL INSTRUMENT CORPORATION; GENERAL INSTRUMENT CORPORATION
To: ARRIS TECHNOLOGY, INC.
Reel/Frame 035176/0620 →
SECURITY AGREEMENT Recorded May 28, 2013
From: ARRIS GROUP, INC.; ARRIS ENTERPRISES, INC.; ARRIS SOLUTIONS, INC.; ARRIS KOREA, INC.; ARRIS HOLDINGS CORP. OF ILLINOIS; BIGBAND NETWORKS, INC.; TEXSCAN CORPORATION; POWER GUARD, INC.; 4HOME, INC.; ACADIA AIC, INC.; AEROCAST, INC.; BROADBUS TECHNOLOGIES, INC.; GENERAL INSTRUMENT CORPORATION; GENERAL INSTRUMENT AUTHORIZATION SERVICES, INC.; GENERAL INSTRUMENT INTERNATIONAL HOLDINGS, INC.; IMEDIA CORPORATION; JERROLD DC RADIO, INC.; LEAPSTONE SYSTEMS, INC.; MODULUS VIDEO, INC.; MOTOROLA WIRELINE NETWORKS, INC.; NETOPIA, INC.; NEXTLEVEL SYSTEMS (PUERTO RICO), INC.; QUANTUM BRIDGE COMMUNICATIONS, INC.; SETJAM, INC.; SUNUP DESIGN SYSTEMS, INC.; UCENTRIC SYSTEMS, INC.; GIC INTERNATIONAL HOLDCO LLC; GIC INTERNATIONAL CAPITAL LLC; CCE SOFTWARE LLC; THE GI REALTY TRUST 1996
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 030498/0023 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 23, 2012
From: VENKITARAMAN, NARAYANAN; BASAPUR, SANTOSH S.; CHAYSINH, SHIRLEY A.; LEE, YOUNG S.; MANDALIA, HIREN M.
To: GENERAL INSTRUMENT CORPORATION
Reel/Frame 028256/0695 →
Continuity (1)
Related Publication 20130290859A1 · Oct 31, 2013