IP Library Granted Patent US 11,727,045
Granted Patent B2
US 11,727,045 · App. 17/240,238 · Granted Aug 15, 2023

Using cross-matching between users and matching against reference data to facilitate content identification

Inventors: Zbigniew Skolicki (Cracow, PL); Jurek Foryciarz (Cracow, PL); Jan Wicijowski (Cracow, PL); Grzegorz Glowaty (Cracow, PL)
Assignee: Google LLC
G06F16/435G06F16/24558G06F16/24578G06F16/40G06F16/433G06F16/48G06F16/683G06F16/783G06F16/907G06F16/951
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,727,045
App. No.
17/240,238
Granted
Aug 15, 2023
Kind
B2
Abstract

Techniques for identifying video and/or audio content are presented. An identification management component (IMC) groups users determined to be at least potentially be watching the same content based on first content fingerprints associated with respective content viewed by the users on communication devices, and a defined matching criterion. IMC facilitates identifying the content associated with the group of users based on first content fingerprints associated with the group of users and first reference content fingerprints. IMC receives a second content fingerprint associated with a communication device of a user in the group, sends the second content fingerprint to a third-party identification component for comparison with second reference content fingerprints, and receives content identification information in response. IMC identifies the content for the group of users based on the content identification information and/or the content identification made based on the first content fingerprints associated with the group.

Claims (56)

1. A method for identifying content, the method comprising:

receiving, using a hardware processor, from a first device, a first fingerprint associated with a first media content item and, from a second device, a second fingerprint associated with a second media content item;

determining, using the hardware processor, that the first media content item associated with the first device is related to the second media content item associated with the second device by determining that characteristic components of a characteristic type match between a first group of characteristic components associated with the first fingerprint and a second group of characteristic components associated with the second fingerprint;

identifying, using the hardware processor, the second media content item based on an identification of the first media content item, wherein the first media content item was identified based on the first fingerprint; and

transmitting, using the hardware processor, the identification of the second media content item to at least one of the first device and the second device.

2. The method of claim 1 , further comprising identifying the first media content item based on the first content fingerprint, wherein a confidence value is associated with the identification and wherein the second media content item is identified in response to determining that the confidence value exceeds a predetermined threshold.

3. The method of claim 1 , wherein the determination that the first media content item is related to the second media content item includes determining that at least a predetermined number of characteristics components from the first group of characteristic components match the second group of characteristic components.

4. The method of claim 1 , wherein the first media content item is being presented on the first device and the second media content item is being presented on the second device.

5. The method of claim 4 , further comprising generating a subset of user accounts that includes a first user account associated with the first device and a second user account associated with the second device based on the determining that the confidence value exceeds the predetermined threshold.

6. The method of claim 4 , further comprising:

in response to determining that the confidence value does not exceed the predetermined threshold, requesting a third content fingerprint associated with the first media content item;

receiving, from the first device, the third content fingerprint associated with the first media content item;

determining a second identity of the first media content item based on the third content fingerprint; and

identifying the second media content item based on the second identity of the first media content item.

7. The method of claim 6 , wherein determining the second identity of the first media content item further comprises comparing the third content fingerprint to content fingerprints of previously identified media content items.

8. The method of claim 6 , further comprising:

transmitting, to a third device, the third content fingerprint; and

receiving, from the third device, the second identity of the first media content item.

9. A system for identifying content, the system comprising:

a memory; and

a hardware processor that, when executing computer-executable instructions stored in the memory, is configured to:

receive, from a first device, a first fingerprint associated with a first media content item and, from a second device, a second fingerprint associated with a second media content item;

determine that the first media content item associated with the first device is related to the second media content item associated with the second device by determining that characteristic components of a characteristic type match between a first group of characteristic components associated with the first fingerprint with a second group of characteristic components associated with the second fingerprint;

identify the second media content item based on an identification of the first media content item, wherein the first media content item was identified based on the first fingerprint; and

transmit the identification of the second media content item to at least one of the first device and the second device.

10. The system of claim 9 , wherein the hardware processor is further configured to identify the first media content item based on the first content fingerprint, wherein a confidence value is associated with the identification and wherein the second media content item is identified in response to determining that the confidence value exceeds a predetermined threshold.

11. The system of claim 9 , wherein the determination that the first media content item is related to the second media content item includes determining that at least a predetermined number of characteristics components from the first group of characteristic components match the second group of characteristic components.

12. The system of claim 9 , wherein the first media content item is being presented on the first device and the second media content item is being presented on the second device.

13. The system of claim 12 , wherein the hardware processor is further configured to generate a subset of user accounts that includes a first user account associated with the first device and a second user account associated with the second device based on the determining that the confidence value exceeds the predetermined threshold.

14. The system of claim 12 , wherein the hardware processor is further configured to:

in response to determining that the confidence value does not exceed the predetermined threshold, request a third content fingerprint associated with the first media content item;

receive, from the first device, the third content fingerprint associated with the first media content item;

determine a second identity of the first media content item based on the third content fingerprint; and

identify the second media content item based on the second identity of the first media content item.

15. The system of claim 14 , wherein determining the second identity of the first media content item further comprises comparing the third content fingerprint to content fingerprints of previously identified media content items.

16. The system of claim 14 , wherein the hardware processor is further configured to:

transmit, to a third device, the third content fingerprint; and

receive, from the third device, the second identity of the first media content item.

17. A non-transitory computer-readable medium containing computer-executable instructions that, when executed by a hardware processor, cause the hardware processor to perform a method for identifying content, the method comprising:

receiving, from a first device, a first fingerprint associated with a first media content item and, from a second device, a second fingerprint associated with a second media content item;

determining that the first media content item associated with the first device is related to the second media content item associated with the second device by determining that characteristic components of a characteristic type match between a first group of characteristic components associated with the first fingerprint and a second group of characteristic components associated with the second fingerprint;

identifying the second media content item based on an identification of the first media content item, wherein the first media content item was identified based on the first fingerprint; and

transmitting the identification of the second media content item to at least one of the first device and the second device.

18. The non-transitory computer-readable medium of claim 17 , wherein the method further comprises identifying the first media content item based on the first content fingerprint, wherein a confidence value is associated with the identification and wherein the second media content item is identified in response to determining that the confidence value exceeds a predetermined threshold.

19. The non-transitory computer-readable medium of claim 17 , wherein the determination that the first media content item is related to the second media content item includes determining that at least a predetermined number of characteristics components from the first group of characteristic components match the second group of characteristic components.

20. The non-transitory computer-readable medium of claim 17 , wherein the first media content item is being presented on the first device and the second media content item is being presented on the second device.

21. The non-transitory computer-readable medium of claim 20 , wherein the method further comprises generating a subset of user accounts that includes a first user account associated with the first device and a second user account associated with the second device based on the determining that the confidence value exceeds the predetermined threshold.

22. The non-transitory computer-readable medium of claim 20 , wherein the method further comprises:

in response to determining that the confidence value does not exceed the predetermined threshold, requesting a third content fingerprint associated with the first media content item;

receiving, from the first device, the third content fingerprint associated with the first media content item;

determining a second identity of the first media content item based on the third content fingerprint; and

identifying the second media content item based on the second identity of the first media content item.

23. The non-transitory computer-readable medium of claim 22 , wherein determining the second identity of the first media content item further comprises comparing the third content fingerprint to content fingerprints of previously identified media content items.

24. The non-transitory computer-readable medium of claim 22 , wherein the method further comprises:

transmitting, to a third device, the third content fingerprint; and

receiving, from the third device, the second identity of the first media content item.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 29, 2024
From: SKOLICKI, ZBIGNIEW; FORYCIARZ, JUREK; WICIJOWSKI, JAN; GLOWATY, GRZEGORZ
To: GOOGLE INC.
Reel/Frame 067553/0433 →
CHANGE OF NAME Recorded May 29, 2024
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 067567/0028 →