IP Library › Granted Patent US 11,727,681
Granted Patent B2
US 11,727,681 · App. 16/627,991 · Granted Aug 15, 2023

Media annotation with product source linking

Inventors: Henry Scott-Green (Marina del Rey, CA); Anjali Malik (Mountain View, CA)
Assignee: Google LLC
G06V20/20G06F16/957G06F40/134G06T5/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,727,681
App. No.
16/627,991
Granted
Aug 15, 2023
Kind
B2
Abstract

Technology is disclosed for annotating and source linking the objects displayed in an image. An example method including detecting, by a processing device, an object in an image; associating the object in the image with a source indicator; annotating, by the processing device, the image to indicate the object is associated with the source indicator; receiving a user selection of the object in the image; and identifying a source based on the source indicator and on contextual data associated with the user selection, wherein the source comprises information about the object.

Claims (50)

1. A method comprising:

detecting, by a processing device, a set of objects depicted in an image;

selecting an object from the set of objects detected in the image that satisfies one or more criteria based on at least viewership data, wherein the viewership data indicates information about a plurality of viewers comprising two or more of: one or more current viewers of the image, one or more future viewers of the image, or one or more past viewers of the image;

associating the selected object in the image with a source indicator;

responsive to associating the selected object in the image with the source indicator, annotating, by the processing device, the image to indicate the object is associated with the source indicator;

receiving a user selection of the object in the image; and

identifying a source based on the source indicator and on contextual data associated with the user selection, wherein the source comprises information about the object.

2. The method of claim 1 , wherein the image comprises one or more frames of a video and wherein the object is displayed in the one or more frames.

3. The method of claim 2 , wherein the viewership data comprises consumption data, and wherein the consumption data comprises a measurement based on one or more of a portion of the video that is paused, a portion of the video that is zoomed in on, a portion of the video that is re-watched, a duration of the consumption, a quantity of the at least one of the one or more current viewers, the one or more future viewers, or the one or more past viewers, or a drop off rate of the at least one of the one or more current viewers, the one or more future viewers, or the one or more past viewers.

4. The method of claim 1 , wherein the viewership data indicates a preference of the one or more current viewers, the one or more future viewers, or the one or more past viewers.

5. The method of claim 1 , wherein identifying the source comprises:

determining a plurality of sources that are associated with the object based on the source indicator;

selecting the source from the plurality of sources based on the contextual data associated with the user selection; and

providing a source identifier for presenting the source to a viewer of the image.

6. The method of claim 1 , wherein the contextual data comprises a geographic location of a user viewing the image, a source preference of the user, or an availability of the object at a time of the user selection.

7. The method of claim 1 , wherein annotating the image comprises updating a presentation of the image in a user interface to emphasize the object, wherein the updating comprises at least one of outlining, highlighting, color altering, or brightening a portion of the image.

8. The method of claim 1 , wherein receiving a user selection of the object in the image comprises receiving an indication that a user has selected a portion of the image comprising the object in a user interface.

9. The method of claim 1 , wherein detecting the set of objects in the image comprises:

performing digital image processing on image data of the image; and

recognizing one or more of the objects in the image based on the digital image processing.

10. A system comprising:

a memory; and

a processing device communicably coupled to the memory, the processing device to execute instructions to carry out operations comprising:

detecting a set of objects depicted in an image;

selecting an object from the set of objects detected in the image that satisfies one or more criteria based on at least viewership data, wherein the viewership data indicates information about a plurality of viewers comprising two or more of: one or more current viewers of the image, one or more future viewers of the image, or one or more past viewers of the image;

associating the selected object in the image with a source indicator;

responsive to associating the selected object in the image with the source indicator, annotating, by the processing device, the image to indicate the object is associated with the source indicator;

receiving a user selection of the object in the image; and

identifying a source based on the source indicator and on contextual data associated with the user selection, wherein the source comprises information about the object.

11. The system of claim 10 , wherein the image comprises one or more frames of a video and wherein the object is displayed in the one or more frames.

12. The system of claim 11 , wherein the viewership data comprises consumption data, and wherein the consumption data comprises a measurement based on one or more of a portion of the video that is paused, a portion of the video that is zoomed in on, a portion of the video that is re-watched, a duration of the consumption, a quantity of the at least one of the one or more current viewers, the one or more future viewers, or the one or more past viewers, or a drop off rate of the at least one of the one or more current viewers, the one or more future viewers, or the one or more past viewers.

13. A non-transitory computer-readable storage medium having instructions stored thereon that, when executed by a processing device, cause the processing device to perform operations comprising:

detecting a set of objects depicted in an image;

selecting an object from the set of objects detected in the image that satisfies one or more criteria based on at least viewership data, wherein the viewership data indicates information about a plurality of viewers comprising two or more of: one or more current viewers of the image, one or more future viewers of the image, or one or more past viewers of the image;

associating the selected object in the image with a source indicator;

responsive to associating the selected object in the image with the source indicator, annotating, by the processing device, the image to indicate the object is associated with the source indicator;

receiving a user selection of the object in the image; and

identifying a source based on the source indicator and on contextual data associated with the user selection, wherein the source comprises information about the object.

14. The non-transitory computer-readable storage medium of claim 13 , wherein the image comprises one or more frames of a video and wherein the object is displayed in the one or more frames.

15. The non-transitory computer-readable storage medium of claim 13 , wherein the viewership data indicates a preference of the one or more current viewers, the one or more future viewers, or the one or more past viewers.

16. The non-transitory computer-readable storage medium of claim 13 , wherein identifying the source comprises:

determining a plurality of sources that are associated with the object based on the source indicator;

selecting the source from the plurality of sources based on the contextual data associated with the user selection; and

providing a source identifier for presenting the source to a viewer of the image.

17. The non-transitory computer-readable storage medium of claim 13 , wherein the contextual data comprises a geographic location of a user viewing the image, a source preference of the user, or an availability of the object at a time of the user selection.

18. The non-transitory computer-readable storage medium of claim 13 , wherein annotating the image comprises updating a presentation of the image in a user interface to emphasize the object, wherein the updating comprises at least one of outlining, highlighting, color altering, or brightening a portion of the image.

19. The non-transitory computer-readable storage medium of claim 13 , wherein receiving a user selection of the object in the image comprises receiving an indication that a user has selected a portion of the image comprising the object in a user interface.

20. The non-transitory computer-readable storage medium of claim 13 , wherein detecting the set of objects in the image comprises:

performing digital image processing on image data of the image; and

recognizing one or more of the objects in the image based on the digital image processing.

Continuity (1)
Related Publication 20220027624A1 · Jan 27, 2022