IP Library Granted Patent US 9,705,728
Granted Patent B2
US 9,705,728 · App. 13/834,394 · Granted Jul 11, 2017

Methods, systems, and media for media transmission and management

Inventor: Matt Bridges (New Providence, NJ)
Assignee: Google Inc.
H04L29/06476H04N21/23418H04N21/2665H04N21/26603H04N21/44008H04N21/4622H04N21/83
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,705,728
App. No.
13/834,394
Granted
Jul 11, 2017
Kind
B2
Abstract

Methods, systems, and media for media transmission and management are provided. In some implementations, a method for media content management is provided, the method comprising: receiving a portion of a media data stream from a first computing device prior to the first computing device processing the portion of the media data stream; processing the portion of the media data stream to identify an object of interest within the media data stream; determining an entity associated with the object of interest; associating a content item with the object of interest based on the determined entity; generating a first representation of the portion of the media data stream, wherein the first representation is associated with the content item; receiving a second representation of the media data stream from a second computing device; determining whether the second representation matches the first representation; and transmitting the content item associated with the first representation to the second computing device for placement within the media data stream in response to determining that the second representation matches the first representation.

Claims (89)

1. A system for media content management, the system comprising:

a hardware processor coupled with memory containing computer executable instructions that, when executed by the hardware processor, is configured to:

identify a plurality of computing devices associated with a content provider, wherein each of the plurality of computing devices has provided an indication allowing the transmission of sequences of one or more media data streams;

divide the plurality of computing devices associated with a content provider based on device information that includes network bandwidth information of each of the plurality of computing devices or processing capability of each of the plurality of computing devices by assigning a first set of the plurality of computing devices to transmit full sequences of frames corresponding to a media data stream and assigning a second set of the plurality of computing devices to transmit fingerprints of the media data stream, wherein the first set of the plurality of computing devices includes a first computing device and the second set of the plurality of computing devices includes a second computing device;

receive a sequence of the media data stream from the first computing device prior to the first computing device processing the sequence of the media data stream for presentation on the first computing device and in response to receiving an authorization from the first computing device to process media data streams for related content items;

process the sequence of the media data stream received from the first computing device, wherein the processing includes identifying an object of interest within the media data stream received from the first computing device;

determine an entity associated with the object of interest identified within the media data stream received from the first computing device; associate a content item with the object of interest based on the determined entity;

generate a first video fingerprint of the sequence of the media data stream, wherein the first video fingerprint is associated with the content item and placement information associated with the content item and wherein the content item and the placement information associated with the content item are transmitted in connection with the sequence of the media data stream for rendering on the first computing device;

receive a second video fingerprint of the media data stream from the second computing device;

determine whether the second computing device has been assigned to the second set of the plurality of computing devices; compare the second video fingerprint with the first video fingerprint in response to determining that the second computing device was assigned to the second set of the plurality of computing devices and in response to receiving the second video fingerprint of the media data stream; and

transmit the content item and the placement information associated with the content item associated to the second computing device for placement within the media data stream in response to the comparison indicating that the second video fingerprint matches the first video fingerprint.

2. The system of claim 1 , wherein the processor is further configured to transmit an instruction to delay the processing of the media data stream on the first computing device.

3. The system of claim 1 , wherein the hardware processor is further configured to receive the indication from each of the plurality of computing devices to allow portions of the media data stream to be transmitted prior to processing the portions of the media data stream.

4. The system of claim 1 , wherein the hardware processor is further configured to:

detect a face within the sequence of the media data stream using a facial recognition technique; and

determine the entity associated with the detected face.

5. The system of claim 1 , wherein the hardware processor is further configured to:

identify a text portion within the sequence of the media data stream using an optical character recognition technique;

determine whether the identified text portion meets one or more criterion;

determine the content item associated with the identified text portion in response to the text portion meeting the one or more criterion; and

transmit the content item to the second computing device, wherein the content item causes the second computing device to navigate to a destination corresponding to the identified text portion.

6. The system of claim 1 , wherein the hardware processor is further configured to:

extract the object of interest from the sequence of the media data stream using an object recognition technique; and

identify a product associated with the object of interest, wherein the content item includes information relating to the identified product.

7. The system of claim 1 , wherein the hardware processor is further configured to:

extract an audio sample from the sequence of the media data stream;

identify a keyword in the audio sample using an audio recognition technique; and

determine a product associated with the identified keyword, wherein the content item includes information relating to the determined product.

8. The system of claim 1 , wherein the first video fingerprint and the second video fingerprint include a smaller amount of media data than the received sequence of the media data stream.

9. A method for media content management, the method comprising:

identifying, using a hardware processor, a plurality of computing devices associated with a content provider, wherein each of the plurality of computing devices has provided an indication allowing the transmission of sequences of one or more media data streams;

dividing, using the hardware processor, the plurality of computing devices associated with a content provider based on device information that includes network bandwidth information of each of the plurality of computing devices or processing capability of each of the plurality of computing devices by assigning a first set of the plurality of computing devices to transmit full sequences of frames corresponding to a media data stream and assigning a second set of the plurality of computing devices to transmit fingerprints of the media data stream, wherein the first set of the plurality of computing devices includes a first computing device and the second set of the plurality of computing devices includes a second computing device;

receiving, using the hardware processor, a sequence of the media data stream from the first computing device prior to the first computing device processing the sequence of the media data stream for presentation on the first computing device and in response to receiving an authorization from the first computing device to process media data streams for related content items;

processing, using the hardware processor, the sequence of the media data stream received from the first computing device, wherein the processing includes identifying an object of interest within the media data stream received from the first computing device;

determining, using the hardware processor, an entity associated with the object of interest identified within the media data stream received from the first computing device;

associating, using the hardware processor, a content item with the object of interest based on the determined entity;

generating, using the hardware processor, a first video fingerprint of the sequence of the media data stream, wherein the first video fingerprint is associated with the content item and placement information associated with the content item and wherein the content item and the placement information associated with the content item are transmitted in connection with the sequence of the media data stream for rendering on the first computing device;

receiving, using the hardware processor, a second video fingerprint of the media data stream from the second computing device;

determining, using the hardware processor, whether the second computing device has been assigned to the second set of the plurality of computing devices;

comparing, using the hardware processor, the second video fingerprint with the first video fingerprint in response to determining that the second computing device was assigned to the second set of the plurality of computing devices and in response to receiving the second video fingerprint of the media data stream; and

transmitting, using the hardware processor, the content item and the placement information associated with the content item associated to the second computing device for placement within the media data stream in response to the comparison indicating that the second video fingerprint matches the first video fingerprint.

10. The method of claim 9 , further comprising transmitting an instruction to delay the processing of the media data stream on the first computing device.

11. The method of claim 9 , further comprising receiving the indication from each of the plurality of computing devices to allow portions of the media data stream to be transmitted prior to processing the portions of the media data stream.

12. The method of claim 9 , further comprising:

detecting a face within the of the media data stream using a facial recognition technique; and

determining the entity associated with the detected face.

13. The method of claim 9 , further comprising:

identifying a text portion within the sequence of the media data stream using an optical character recognition technique;

determining whether the identified text portion meets one or more criterion;

determining the content item associated with the identified text portion in response to the text portion meeting the one or more criterion; and

transmitting the content item to the second computing device, wherein the content item causes the second computing device to navigate to a destination corresponding to the identified text portion.

14. The method of claim 9 , further comprising:

extracting the object of interest from the sequence of the media data stream using an object recognition technique; and

identifying a product associated with the object of interest, wherein the content item includes information relating to the identified product.

15. The method of claim 9 , further comprising:

extracting an audio sample from the sequence of the media data stream;

identifying a keyword in the audio sample using an audio recognition technique; and

determining a product associated with the identified keyword, wherein the content item includes information relating to the determined product.

16. The method of claim 9 , wherein the first video fingerprint and the second video fingerprint include a smaller amount of media data than the received sequence of the media data stream.

17. A non-transitory computer-readable medium containing computer executable instructions that, when executed by a processor, cause the processor to perform a method for media content management, the method comprising:

identifying a plurality of computing devices associated with a content provider, wherein each of the plurality of computing devices has provided an indication allowing the transmission of sequences of one or more media data streams;

dividing the plurality of computing devices associated with a content provider based on device information that includes network bandwidth information of each of the plurality of computing devices or processing capability of each of the plurality of computing devices by assigning a first set of the plurality of computing devices to transmit full sequences of frames corresponding to a media data stream and assigning a second set of the plurality of computing devices to transmit fingerprints of the media data stream, wherein the first set of the plurality of computing devices includes a first computing device and the second set of the plurality of computing devices includes a second computing device;

receiving a sequence of the media data stream from the first computing device prior to the first computing device processing the sequence of the media data stream for presentation on the first computing device and in response to receiving an authorization from the first computing device to process media data streams for related content items;

processing the sequence of the media data stream received from the first computing device, wherein the processing includes identifying an object of interest within the media data stream received from the first computing device;

determining an entity associated with the object of interest identified within the media data stream received from the first computing device;

associating a content item with the object of interest based on the determined entity;

generating a first video fingerprint of the sequence of the media data stream, wherein the first video fingerprint is associated with the content item and placement information associated with the content item and wherein the content item and the placement information associated with the content item are transmitted in connection with the sequence of the media data stream for rendering on the first computing device;

receiving a second video fingerprint of the media data stream from the second computing device;

determining whether the second computing device has been assigned to the second set of the plurality of computing devices;

comparing the second video fingerprint with the first video fingerprint in response to determining that the second computing device was assigned to the second set of the plurality of computing devices and in response to receiving the second video fingerprint of the media data stream; and

transmitting the content item and the placement information associated with the content item associated to the second computing device for placement within the media data stream in response to the comparison indicating that the second video fingerprint matches the first video fingerprint.

18. The non-transitory computer-readable medium of claim 17 , wherein the method further comprises transmitting an instruction to delay the processing of the media data stream on the first computing device.

19. The non-transitory computer-readable medium of claim 17 , wherein the method further comprises receiving the indication from each of the plurality of computing devices to allow portions of the media data stream to be transmitted prior to processing the portions of the media data stream.

20. The non-transitory computer-readable medium of claim 17 , wherein the method further comprises:

detecting a face within the sequence of the media data stream using a facial recognition technique; and

determining the entity associated with the detected face.

21. The non-transitory computer-readable medium of claim 17 , wherein the method further comprises:

identifying a text portion within the sequence of the media data stream using an optical character recognition technique; and

determining whether the identified text portion meets one or more criterion;

determining the content item associated with the identified text portion in response to the text portion meeting the one or more criterion; and

transmitting the content item to the second computing device, wherein the content item causes the second computing device to navigate to a destination corresponding to the identified text portion.

22. The non-transitory computer-readable medium of claim 17 , wherein the method further comprises:

extracting the object of interest from the sequence of the media data stream using an object recognition technique; and

identifying a product associated with the object of interest, wherein the content item includes information relating to the identified product.

23. The non-transitory computer-readable medium of claim 17 , wherein the method further comprises:

extracting an audio sample from the sequence of the media data stream;

identifying a keyword in the audio sample using an audio recognition technique; and

determining a product associated with the identified keyword, wherein the content item includes information relating to the determined product.

24. The non-transitory computer-readable medium of claim 17 , wherein the first video fingerprint and the second video fingerprint include a smaller amount of media data than the received sequence of the media data stream.

Assignments (2)
CHANGE OF NAME Recorded Oct 2, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044097/0658 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 17, 2015
From: BRIDGES, MATT
To: GOOGLE INC.
Reel/Frame 036117/0526 →
Continuity (1)
Related Publication 20140281004A1 · Sep 18, 2014