IP Library › Granted Patent US 10,528,319
Granted Patent B2
US 10,528,319 · App. 15/374,555 · Granted Jan 7, 2020

Audio association systems and methods

Inventors: April Slayden Mitchell (San Jose, CA); Susie Wee (Palo Alto, CA); Mark C. Solomon (San Jose, CA); Glenn A. Wong (Redwood City, CA)
Assignee: Hewlett-Packard Development Company, L.P.
G06F3/167G06F3/0481G10L21/028H04N7/15
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,528,319
App. No.
15/374,555
Granted
Jan 7, 2020
Kind
B2
Abstract

Audio capture systems and methods applicable to a large interactive device (LID) are provided. An audio capture method can include relating captured ambient audio provided by a first user with media presented to the first user via the LID. The method can also include indicating related media displayed on the LID based upon an audio input provided by the first user.

Claims (56)

1. An audio capture method for a large interactive device (LID), comprising:

capturing a first audio input provided by a first user related with a first media content presented to the first user via the LID;

detecting associations between the first audio input provided by the first user and a second media content, related to content of the first media, by accessing remote resources;

synchronizing the first audio input provided by the first user, the first media content, and the second media content by:

marking the first audio input with a reference mark;

marking the first media content with the reference mark; and

marking the second media content with the reference mark;

indicating the second media content displayed elsewhere upon the LID based upon the synchronization of the first audio input, the first media content, and the second media content; and

moving the indicated second media content to a location upon the LID proximate the first user.

2. The method of claim 1 , further comprising:

determining a proximate location for the first user with respect to the LID in response to capturing the first audio input provided by the first user; and

moving the second media content to the proximate location for the first user with respect to the LID.

3. The method of claim 1 , further comprising storing the captured first audio input and the second media content.

4. The method of claim 1 , further comprising:

processing the captured first audio input; and

identifying the first user as a specific source of the captured first audio input.

5. The method of claim 1 , further comprising:

capturing a second audio input provided by a second user with a third media content presented to the second user via the LID; and

indicating the third media content presented to the second user via the LID based upon the first audio input provided by the first user.

6. The method of claim 1 , wherein indicating the first and the second media content comprises altering visible media parameters.

7. The method of claim 4 , wherein indicating the third media content presented to the second user comprises altering visible media parameters.

8. The method of claim 1 , wherein:

the first and the second media content presented to the first user via the LID changes with time; and

the captured first audio input provided by the first user is temporally linked to the first media content.

9. The method of claim 1 , wherein detecting the associations comprises detecting a keyword type association or a conceptual association.

10. The method of claim 9 , wherein detecting the keyword type association comprises:

converting the first audio input provided by the first user to text; and

associating the text with the second media content displayed elsewhere upon the LID.

11. An audio capture system comprising:

a large interactive device (LID) to provide a first media content to a first user, wherein the LID comprises a plurality of touch sensitive display devices;

a processor;

a directional audio capture device to capture a first audio input provided by the first user;

a memory storing instructions that, when executed by the processor, cause the processor to:

determine a proximate location for the first user with respect to the LID upon capturing the first audio input via the directional audio capture device;

relate the captured first audio input provided by the first user with the first media content provided to the first user;

detect associations between the first audio input provided by the first user and a second media content, related to the content of the first media, currently displayed elsewhere upon the LID;

synchronize the first audio input provided by the first user, the first media content, and the second media content by:

marking the first audio input with a reference mark;

marking the first media content with the reference mark; and

marking the second media content with the reference mark;

move the second media content displayed elsewhere upon the LID, based upon the synchronization of first the audio input provided by the first user, the first media content, and the second media content to a location upon the LID proximate the first user, wherein the movement of the second media content corresponds to the proximate location for the first user with respect to the LID; and

store at least a portion of the captured first audio input and the second media content in the memory.

12. The system of claim 11 , further comprising instructions to cause the processor to:

capture a second audio input provided by a second user related with a third media content presented to the second user via the LID; and

indicate third media content presented to the second user via the LID based upon an audio input provided by the first user.

13. A non-transitory computer-readable medium, containing instructions executable by a processor to cause the processor to:

capture an audio input provided by a first user;

determine a proximate location for the first user with respect to a large interactive device (LID) in response to capturing the audio input;

relate the captured audio input provided by the first user with a first media content provided to the first user;

detect associations between the audio input provided by the first user and a second media content, related to content of the first media by accessing remote resources; and

synchronize the audio input provide by the first user, the first media content, and the second media content by:

marking the audio input with a reference mark;

marking the first media content with the reference mark; and

marking the second media content with the reference mark.

14. The non-transitory computer-readable medium of claim 13 , further comprising instructions to cause the processor to associate at least a portion of the captured audio input with the first user.

15. The non-transitory computer-readable medium of claim 13 , further comprising instructions to cause the processor to temporally relate the captured audio input provided by the first user with time dependent and changing media content.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 3, 2017
From: MITCHELL, APRIL SLAYDEN; WEE, SUSIE; SOLOMON, MARK C.; WONG, GLENN A.
To: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
Reel/Frame 042231/0327 →
Continuity (2)
Continuation 13983247
Related Publication 20170131971A1 · May 11, 2017