Video overlayers, distribution management systems and computer-implemented methods of overlaying a video with product data
The subject application provides a video overlayer ( 100 ), a distribution management system and a computer-implemented method ( 600 ) of overlaying a video ( 200 ) with product data. The inventors have found that the use an interactive video overlay makes it easy and convenient for viewers to purchase products seen in videos. In particular, the inventors propose to draw the viewer's attention to certain products in a video and to allow the viewer to interact to buy the product directly in the video. The proposed solution saves time as it eliminates the need to search for products viewed in videos. Also, the proposed solution allows for the sense of immediacy that comes with online shopping by providing fast and efficient service to viewers. Indeed, when viewers see a product that they like in a video, they can simply click a link or button to purchase it right away.
1 . A video overlayer for overlaying a video, at a viewer device, via a video player, with product data,
the video comprising a plurality of video frames associated with timing information, wherein at least one video frame, called remarkable video frame, comprises at least one visually identifiable object of interest, which location in the video frame being previously known or determined,
the viewer device having at least one display,
the video player being configured for displaying the video on the display, the video player having a play function and a pause function, the play function being configured for playing a video, the pausing function being configured for pausing the playing of a video, the video overlayer comprising,
at least one first processor configured for,
accessing a product database associating at least one product image with product data,
providing a human perceptible video overlay which is configured to be synchronized in time with the video based on the timing information, such that all or part of its content overlays the video, at a particular point in time of the video, the human perceptible video overlay comprising, for at least one remarkable video frame,
at least one first overlay container configured for overlaying the remarkable video frame with a first interactive content configured for allowing a predetermined viewer interaction, the location of the points defining a border of the first interactive content being previously known or determined, and
at least one second overlay container, associated with the first overlay container, and configured for overlaying the remarkable video frame with a second interactive content having at least one user selectable option configured for allowing a predetermined viewer interaction, the second interactive content being configured according to the product data of at least one product associated with the visually identifiable object of interest,
executing the play function of the video player, and
when the current video frame is a remarkable video frame, displaying the corresponding first overlay container, wherein,
the first processor is further configured for pausing the playing of the video, in response to a predetermined viewer interaction with the first interactive content or the pause function,
the first processor is further configured for, when the playing of the video is paused,
obtaining, based on the current remarkable video frame and the associated first overlay container, an image crop that includes the visually identifiable object of interest,
recognizing or identifying, from the product database, based on the image crop, at least one product image that substantially matches the visually identifiable object of interest,
retrieving, from the product database, the product data that is associated with the recognized product, and
displaying the second overlay container according to the retrieved product data.
2 . The video overlayer of claim 1 , wherein the first interactive content comprises at least one interactive symbol configured for overlaying all or part of the visually identifiable object of interest.
3 . The video overlayer of claim 1 , wherein the first interactive content comprises a first interactive bounding box surrounding the visually identifiable object of interest and configured for overlaying the visually identifiable object of interest.
4 . The video overlayer of claim 1 , wherein the first interactive content comprises a second interactive bounding box configured for comprising a list of visually identifiable objects of interest that are present on the remarkable video frame.
5 . The video overlayer of claim 1 , wherein the first processor is further configured for selecting, based on image information associated with each remarkable video frame, a single remarkable video frame from among a plurality of consecutive remarkable video frames.
6 . A distribution management system of a media asset management system, for distributing at least one video to a viewer device having at least one display, the distribution management system comprising,
the video overlayer according to claim 1 ,
a video player configured for displaying a video on the display, the video player having a play function and a pause function, the play function being configured for playing a video, the pausing function being configured for pausing the playing of a video, and
a product database associating at least one product image with product data.
7 . A computer-implemented method of overlaying a video with product data, the computer-implemented method being performed in a system comprising,
a viewer device having at least one display,
a video player configured for displaying a video on the display, the video player having a play function and a pause function, the play function being configured for playing a video, the pausing function being configured for pausing the playing of a video,
a product database associating at least one product image with product data, and,
at least one second processor, the computer-implemented method comprising the steps of, with the second processor,
obtaining a video to be played by the video player, the video comprising a plurality of video frames and timing information associated with the plurality of video frames, wherein at least one video frame, called remarkable video frame, comprises at least one visually identifiable object of interest, which location in the video frame being previously known or determined,
providing a human perceptible video overlay which is configured to be synchronized in time with the video based on the timing information, such that all or part of its content overlays the video, at a particular point in time of the video, the human perceptible video overlay comprising, for at least one remarkable video frame,
at least one first overlay container configured for overlaying the remarkable video frame with a first interactive content configured for allowing a predetermined viewer interaction, the location of the points defining a border of the first interactive content being previously known or determined and
at least one second overlay container, associated with the first overlay container, and configured for overlaying the remarkable video frame with a second interactive content having at least one user selectable option configured for allowing a predetermined viewer interaction, the second interactive content being configured according to the product data of at least one product associated with the visually identifiable object of interest,
executing the play function of the video player, and
when the current video frame is a remarkable video frame, displaying the corresponding first overlay container wherein, with the second processor,
in response to a predetermined viewer interaction with the first interactive content or the pause function, pausing the playing of the video,
when the playing of the video is paused,
obtaining, based on the current remarkable video frame and the associated first overlay container, an image crop that includes the visually identifiable object of interest,
recognizing or identifying, from the product database, based on the image crop, at least one product image that substantially matches the visually identifiable object of interest,
retrieving, from the product database, the product data that is associated with the recognized product, and
displaying the second overlay container according to the retrieved product data.
8 . The computer-implemented method of claim 7 , further comprising, with the second processor, before the step of displaying the first overlay container, selecting, based on image information associated with each remarkable video frame, only one remarkable video frame from among a plurality of consecutive remarkable video frames.
9 . The computer-implemented method of claim 7 , further comprising, with the second processor, before the step of recognizing or identifying,
delineating, in the image crop, the visually identifiable object of interest from a background region, and
subtracting the background region from the image crop so as to leave only a polygon bounding the visually identifiable object of interest region.
10 . The computer-implemented method of claim 7 , further comprising, with the second processor, the step of recognizing or identifying comprises the steps of,
generating a first embedding vector for the image crop using an embedding generation technique,
generating at least one second embedding vector for at least one product image using the embedding generation technique,
comparing the first embedding vector with all or part of the second embedding vectors, thereby generating a similarity measure for each comparison, and
selecting the product images associated with a similarity measure that is beyond a predetermined similarity measure.
11 . The computer-implemented method of claim 7 , further comprising, with the second processor, in response to a predetermined viewer interaction with the video player and/or the human perceptible video overlay, resuming the playing of the video, at a point where the playing of the video was paused, the predetermined viewer interaction is indicative that the viewer interaction is complete.
12 . The computer-implemented method of claim 11 , further comprising,
providing a memory, wherein, with the second processor, when the viewer interaction completion is indicative of a desire to shop for a product associated with the visually identifiable object of interest,
saving, in a wish list, an information representing the desire to shop for the product associated with the visually identifiable object of interest, and
storing, in the memory, the wish list.
13 . The computer-implemented method of claim 12 , further comprising, with the second processor,
modifying the human perceptible video overlay to further comprise at least one third overlay container configured for overlaying the remarkable video frame with a third interactive content having at least one user selectable option configured for allowing a predetermined viewer interaction, the third interactive content being configured according to all or part of a wish list, wherein, when the playing of the video is paused, with the second processor, in response to a predetermined viewer interaction with the video player and/or the human perceptible video overlay,
displaying the third overlay container according to all or part of the wish list.
14 . A computer program product comprising a non-transitory computer-readable medium storing instructions which, when the program is executed by a computer, cause the computer to carry out the steps of the computer-implemented method according to claim 7 .