Content replacement with onscreen displays
View Patent ↗A method of content replacement with onscreen displays. The method can further include sending an overlay request to provide overlay content and an overlay format. The method can include receiving the overlay content and the overlay format selected in view of overlay parameters. The method can include superimposing the overlay content over the media content using the overlay format. The method can include detecting a presence of an onscreen display. The method can include determining a location of a portion of the onscreen display that extends underneath the overlay content. The method can include defining a window in the overlay content that corresponds to at least the location of the portion of the onscreen display. The method can include setting a transparency level of the overlay content in the window to permit the portion of the onscreen display to be at least partially visible through the overlay content.
1. A method comprising:
receiving, at a processing device of a client device, media content from a content feed;
receiving, at the processing device, overlay content from a content computing device in communication with the processing device;
compositing, by the processing device, the media content, an onscreen display, and the overlay content into a composite image, wherein the media content comprises a bottom layer of the composite image and includes a first set of pixels, the onscreen display comprises a middle layer of the composite image and includes a second set of pixels separate from the first set of pixels, and the overlay content comprises a top layer of the composite image and includes a third set of pixels separate from the first set of pixels and the second set of pixels;
determining, by the processing device, a location of the overlay content that overlaps a portion of the onscreen display;
defining, by the processing device, a portion of the third set of pixels as a window in the overlay content that corresponds to the location of the overlay content that overlaps the onscreen display; and
adjusting, by the processing device, a transparency level of the portion of the third set of pixels to permit a portion of the second set of pixels to be at least partially visible through the window.
2. The method of claim 1 , further comprising displaying, by the processing device, the composite image on a display screen of the client device.
3. The method of claim 1 , wherein adjusting the transparency level of the portion of the third set of pixels comprises setting the transparency level to a full transparency level.
4. The method of claim 1 , wherein the onscreen display comprises at least one of a volume level indicator, a menu, or a programming guide of the client device.
5. The method of claim 1 , wherein the onscreen display comprises at least one of a volume level indicator, a menu, or a programming guide of a computing device in communication with the client device.
6. The method of claim 1 , further comprising:
generating, by the processing device, fingerprints of the received media content;
identifying, by the processing device, the media content using the generated fingerprints;
determining, by the processing device, a size of an obstruction in the media content, wherein the obstruction includes at least a portion of the media content with no overlap with the generated fingerprints; and
designating, by the processing device, the obstruction as the onscreen display.
7. The method of claim 1 , further comprising:
generating, by the processing device, fingerprints of the received media content;
identifying, by the processing device, the media content using the generated fingerprints;
determining, by the processing device, an identification accuracy level of a portion of the media content;
determining, by the processing device, that the identification accuracy level of the portion is below a threshold level; and
designating, by the processing device, the portion as the onscreen display.
8. The method of claim 7 , wherein identifying the media content using the generated fingerprints comprises:
hashing rows and columns of a first image frame to determine first hash values of the media content;
hashing rows and columns of a second image frame to determine second hash values for the second image frame;
comparing the second hash values to the first hash values;
identifying one or more of the second hash values that do not match the first hash values; and
determining a location of the onscreen display in the second image frame, the location associated with the one or more second hash values that do not match the first hash values.
9. The method of claim 8 , wherein the location associated with the one or more second hash values that do not match the first hash values defines a rectangle where the onscreen display is located in the second image frame.
10. The method of claim 1 , wherein determining the location of the overlay content that overlaps the portion of the onscreen display comprises:
accessing a database of onscreen displays for the client device;
detecting the onscreen display of the composite image;
determining a type of the onscreen display;
identifying a size, a shape, and a screen location of the onscreen display associated with the type of the onscreen display in the database; and
defining the portion of the onscreen display overlapped by the overlay content based on the size, the shape, and the screen location of the onscreen display.
11. A client device comprising:
a non-transitory computer-readable storage medium storing instructions; and
a processing device in communication with the non-transitory computer-readable storage medium and configured to execute the instructions, the executed instructions causing the processing device to perform operations comprising;
receiving media content from a content feed;
receiving overlay content from a content computing device in communication with the client device;
compositing the media content, an onscreen display, and the overlay content into a composite image, wherein the media content comprises a bottom layer of the composite image and includes a first set of pixels, the onscreen display comprises a middle layer of the composite image and includes a second set of pixels separate from the first set of pixels, and the overlay content comprises a top layer of the composite image and includes a third set of pixels separate from the first set of pixels and the second set of pixels;
determining a location of the overlay content that overlaps a portion of the onscreen display;
defining a portion of the third set of pixels as a window in the overlay content that corresponds to the location of the overlay content that overlaps the onscreen display; and
adjusting a transparency level of the portion of the third set of pixels to permit a portion of the second set of pixels to be at least partially visible through the window.
12. The client device of claim 11 , wherein the operations further comprise displaying the composite image on a display screen of the client device.
13. The client device of claim 11 , wherein adjusting the transparency level of the portion of the third set of pixels comprises setting the transparency level to a full transparency level.
14. The client device of claim 11 , wherein the onscreen display comprises at least one of a volume level indicator, a menu, or a programming guide of the client device.
15. The client device of claim 11 , wherein the onscreen display comprises at least one of a volume level indicator, a menu, or a programming guide of a computing device in communication with the client device.
16. The client device of claim 11 , wherein the operations further comprise:
generating fingerprints of the received media content;
identifying the media content using the generated fingerprints;
determining a size of an obstruction in the media content, wherein the obstruction includes at least a portion of the media content with no overlap with the generated fingerprints; and
designating the obstruction as the onscreen display.
17. The client device of claim 11 , wherein the operations further comprise:
generating fingerprints of the received media content;
identifying the media content using the generated fingerprints;
determining an identification accuracy level of a portion of the media content;
determining that the identification accuracy level of the portion is below a threshold level; and
designating the portion as the onscreen display.
18. The client device of claim 17 , wherein identifying the media content using the generated fingerprints comprises:
hashing rows and columns of a first image frame to determine first hash values of the media content;
hashing rows and columns of a second image frame to determine second hash values for the second image frame;
comparing the second hash values to the first hash values;
identifying one or more of the second hash values that do not match the first hash values; and
determining a location of the onscreen display in the second image frame, the location associated with the one or more second hash values that do not match the first hash values.
19. The client device of claim 18 , wherein the location associated with the one or more second hash values that do not match the first hash values defines a rectangle where the onscreen display is located in the second image.
20. The client device of claim 11 , wherein determining the location of the overlay content that overlaps the portion of the onscreen display comprises:
accessing a database of onscreen displays for the client device;
detecting the onscreen display of the composite image;
determining a type of the onscreen display;
identifying a size, a shape, and a screen location of the onscreen display associated with the type of the onscreen display in the database; and
defining the portion of the onscreen display overlapped by the overlay content based on the size, the shape, and the screen location of the onscreen display.