IP Library Granted Patent US 11,677,801
Granted Patent B2
US 11,677,801 · App. 17/745,844 · Granted Jun 13, 2023

Capture, recording, and streaming of media content

Inventors: Brian Schmidt (Sunnyvale, CA); George Leiming Xing (Mountain View, CA); Matt Snider (Sunnyvale, CA); Sunbir Gill (San Jose, CA)
Assignee: Google LLC
H04L65/762H04L41/509H04L41/5025H04L43/106H04L65/70H04L65/80
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,677,801
App. No.
17/745,844
Granted
Jun 13, 2023
Kind
B2
Abstract

A method includes receiving user input indicating a selection of a subset of two or more of a plurality of audio layers for media content to be provided to a user, each of the subset of audio layers corresponding to one or more audio sources, receiving second user input indicating volume levels for the two or more audio layers of the plurality of audio layers, capturing, based on the first user input, the two or more audio layers of the plurality of audio layers for a media content item to be provided to the user, and creating an output audio layer for the media content item by mixing the two or more audio layers of the plurality of audio layers without including other audio layers of the plurality of audio layers, the output audio layer reflecting the volume levels indicated by the second user input. The method further includes causing the media content item to be provided to the user using the output audio layer reflecting the indicated volume levels.

Claims (56)

1. A method comprising:

receiving first user input indicating a selection of a subset of two or more audio layers of a plurality of audio layers for media content to be provided to a user, each of the subset of audio layers corresponding to one or more audio sources;

receiving second user input indicating volume levels for the two or more audio layers of the plurality of audio layers;

capturing, based on the first user input, the two or more audio layers of the plurality of audio layers for a media content item to be provided to the user;

creating an output audio layer for the media content item by mixing the two or more audio layers of the plurality of audio layers without including other audio layers of the plurality of audio layers, the output audio layer reflecting the volume levels indicated by the second user input; and

causing the media content item to be provided to the user using the output audio layer reflecting the indicated volume levels.

2. The method of claim 1 , further comprising:

determining an output sample rate for the output audio layer;

encoding the output audio layer at the determined output sample rate; and

transmitting the encoded output audio layer to a media hosting service for presentation to the user.

3. The method of claim 2 , further comprising:

identifying a capability of a local device of the user; and

selecting a codec to perform the encoding of the output audio layer based on the capability of the local device.

4. The method of claim 3 , wherein the capability of the local device is based on hardware of the local device or a bandwidth associated with the local device.

5. The method of claim 2 , further comprises converting an initial sample rate of the output audio layer to the determined output sample rate, wherein converting the initial sample rate to the determined output sample rate comprises (i) dropping one or more samples associated with the output audio layer in response to the initial sample rate being higher than the determined output sample rate, or (ii) duplicating one or more samples associated with the output audio layer in response to the initial sample rate being lower than the determined output sample rate.

6. The method of claim 1 , wherein the plurality of audio layers comprise a local audio input layer, an application audio layer, a system notification audio layer and a phone call audio layer.

7. The method of claim 1 , further comprising:

storing, based on the first user input and the second user input, data identifying the two or more audio layers and data identifying the volume levels of the two or more audio layers.

8. A system comprising:

a memory; and

a processor, operatively coupled with the memory, to perform operations comprising:

receiving first user input indicating a selection of a subset of two or more audio layers of a plurality of audio layers for media content to be provided to a user, each of the subset of audio layers corresponding to one or more audio sources;

receiving second user input indicating volume levels for the two or more audio layers of the plurality of audio layers;

capturing, based on the first user input, the two or more audio layers of the plurality of audio layers for a media content item to be provided to the user;

creating an output audio layer for the media content item by mixing the two or more audio layers of the plurality of audio layers without including other audio layers of the plurality of audio layers, the output audio layer reflecting the volume levels indicated by the second user input; and

causing the media content item to be provided to the user using the output audio layer reflecting the indicated volume levels.

9. The system of claim 8 , the operations further comprising:

determining an output sample rate for the output audio layer;

encoding the output audio layer at the determined output sample rate; and

transmitting the encoded output audio layer to a media hosting service for presentation to the user.

10. The system of claim 9 , the operations further comprising:

identifying a capability of a local device of the user; and

selecting a codec to perform the encoding of the output audio layer based on the capability of the local device.

11. The system of claim 10 , wherein the capability of the local device is based on hardware of the local device or a bandwidth associated with the local device.

12. The system of claim 9 , the operations further comprising converting an initial sample rate of the output audio layer to the determined output sample rate, wherein converting the initial sample rate to the determined output sample rate comprises (i) dropping one or more samples associated with the output audio layer in response to the initial sample rate being higher than the determined output sample rate, or (ii) duplicating one or more samples associated with the output audio layer in response to the initial sample rate being lower than the determined output sample rate.

13. The system of claim 8 , wherein the plurality of audio layers comprise a local audio input layer, an application audio layer, a system notification audio layer and a phone call audio layer.

14. The system of claim 8 , the operations further comprising:

storing, based on the first user input and the second user input, data identifying the two or more audio layers and data identifying the volume levels of the two or more audio layers.

15. A non-transitory computer readable medium comprising instructions, which when executed by a processor, cause the processor to perform operations comprising:

receiving first user input indicating a selection of a subset of two or more audio layers of a plurality of audio layers for media content to be provided to a user, each of the subset of audio layers corresponding to one or more audio sources;

receiving second user input indicating volume levels for the two or more audio layers of the plurality of audio layers;

capturing, based on the first user input, the two or more audio layers of the plurality of audio layers for a media content item to be provided to the user;

creating an output audio layer for the media content item by mixing the two or more audio layers of the plurality of audio layers without including other audio layers of the plurality of audio layers, the output audio layer reflecting the volume levels indicated by the second user input; and

causing the media content item to be provided to the user using the output audio layer reflecting the indicated volume levels.

16. The non-transitory computer readable medium of claim 15 , the operations further comprising:

determining an output sample rate for the output audio layer;

encoding the output audio layer at the determined output sample rate; and

transmitting the encoded output audio layer to a media hosting service for presentation to the user.

17. The non-transitory computer readable medium of claim 16 , the operations further comprising:

identifying a capability of a local device of the user; and

selecting a codec to perform the encoding of the output audio layer based on the capability of the local device.

18. The non-transitory computer readable medium of claim 17 , wherein the capability of the local device is based on hardware of the local device or a bandwidth associated with the local device.

19. The non-transitory computer readable medium of claim 16 , the operations further comprising converting an initial sample rate of the output audio layer to the determined output sample rate, wherein converting the initial sample rate to the determined output sample rate comprises (i) dropping one or more samples associated with the output audio layer in response to the initial sample rate being higher than the determined output sample rate, or (ii) duplicating one or more samples associated with the output audio layer in response to the initial sample rate being lower than the determined output sample rate.

20. The non-transitory computer readable medium of claim 15 , wherein the plurality of audio layers comprise a local audio input layer, an application audio layer, a system notification audio layer and a phone call audio layer.

21. The non-transitory computer readable medium of claim 15 , the operations further comprising:

storing, based on the first user input and the second user input, data identifying the two or more audio layers and data identifying the volume levels of the two or more audio layers.

Assignments (2)
CHANGE OF NAME Recorded Aug 25, 2022
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 061327/0241 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 1, 2022
From: SCHMIDT, BRIAN; XING, GEORGE LEIMING; SNIDER, MATT; GILL, SUNBIR
To: GOOGLE INC.
Reel/Frame 060689/0902 →
Continuity (5)
Continuation 17135921 · Dec 28, 2020
Continuation 16356998 · Mar 18, 2019
Continuation 15294143 · Oct 14, 2016
Provisional Application 62241612 · Oct 14, 2015
Related Publication 20220279029A1 · Sep 1, 2022