IP Library Granted Patent US 10,547,899
Granted Patent B2
US 10,547,899 · App. 15/865,958 · Granted Jan 28, 2020

System for distributing metadata embedded in video

Inventors: Mark Eyer (Woodinville, WA); Paul Hearty (Poway, CA)
Assignee: Sony Corporation
H04N21/44008G11B27/034H04H60/73H04N21/2353H04N21/23614H04N21/435H04N21/8358H04H2201/50
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,547,899
App. No.
15/865,958
Granted
Jan 28, 2020
Kind
B2
Abstract

A method, non-transitory computer-readable storage medium, and reception apparatus for extracting metadata, and an information providing apparatus for providing the metadata. The method for extracting metadata includes processing, by circuitry of the reception apparatus, content that includes the metadata embedded therein. The metadata is embedded as a watermark in a first portion of a video frame of the content. The circuitry determines symbol values of the watermark from the video frame based on luminance values in pixels of the first portion of the video frame of the content to extract the metadata. At least one of the luminance values is less than 16.

Claims (49)

1. A method of a reception apparatus for extracting metadata, the method comprising:

processing, by circuitry of the reception apparatus, content that includes the metadata embedded therein, the metadata being embedded as a watermark in a video frame of the content; and

detecting, by the circuitry, symbol values of the watermark embedded in the video frame based on luminance values in pixels of the video frame of the content and based on at least one predetermined luminance value threshold, wherein

at least one of the luminance values in the pixels of the video frame corresponding to symbol values of the watermark is less than a value corresponding to black, a maximum luminance value in the pixels of the video frame corresponding to symbol values of the watermark is less than a value corresponding to white, and

each of the symbol values has one of N possible values that are detected based on (N−1) predetermined luminance value thresholds that delineate ranges of luminance values detected as each of the N possible values, where N is an integer greater than 1.

2. The method according to claim 1 , wherein the same watermark is embedded in a plurality of consecutive video frames of the content.

3. The method according to claim 1 , further comprising:

detecting a predetermined fixed pattern of symbol values based on luminance values in pixels of the video frame of the content, wherein

the step of detecting detects the symbol values when the predetermined fixed pattern is detected to extract the metadata.

4. The method according to claim 1 , wherein the step of determining further comprises:

averaging, for each subset of the pixels making up one of the symbol values, the luminance values; and

detecting the symbol values based on the averaged luminance values.

5. The method according to claim 1 , wherein each of the symbol values has one of two possible values and the predetermined luminance value threshold delineates ranges of luminance values detected as each of the two possible values.

6. The method according to claim 1 , wherein each of the symbol values has one of four possible values and the at least one predetermined luminance value threshold includes three luminance value thresholds delineating ranges of luminance values detected as each of the four possible values.

7. The method according to claim 1 , wherein the same watermark is encoded entirely within luminance values of at least one of line 1 and line 2 of the video frame of the content and the watermark is not encoded in any other lines of the video frame.

8. A non-transitory computer-readable storage medium storing a program, which when executed by a computer causes the computer to perform a method of a reception apparatus for extracting metadata, the method comprising:

processing content that includes the metadata embedded therein, the metadata being embedded as a watermark in a video frame of the content; and

detecting symbol values of the watermark embedded in the video frame based on luminance values in pixels of the video frame of the content and based on at least one predetermined luminance value threshold, wherein

at least one of the luminance values in the pixels of the video frame corresponding to symbol values of the watermark is less than a value corresponding to black, a maximum luminance value in the pixels of the video frame corresponding to symbol values of the watermark is less than a value corresponding to white, and

each of the symbol values has one of N possible values that are detected based on (N−1) predetermined luminance value thresholds that delineate ranges of luminance values detected as each of the N possible values, where N is an integer greater than 1.

9. A reception apparatus, comprising:

a memory; and

a processing unit that, according to instructions loaded from the memory,

processes content that includes metadata embedded therein, the metadata being embedded as a watermark in a video frame of the content; and

detects symbol values of the watermark embedded in the video frame based on luminance values in pixels of the video frame of the content and based on at least one predetermined luminance value threshold, wherein

at least one of the luminance values in the pixels of the video frame corresponding to symbol values of the watermark is less than a value corresponding to black, a maximum luminance value in the pixels of the video frame corresponding to symbol values of the watermark is less than a value corresponding to white, and

each of the symbol values has one of N possible values that are detected based on (N−1) predetermined luminance value thresholds that delineate ranges of luminance values detected as each of the N possible values, where N is an integer greater than 1.

10. The reception apparatus according to claim 9 , wherein the same watermark is embedded in a plurality of consecutive video frames of the content.

11. The reception apparatus according to claim 9 , wherein the processing unit:

detects a predetermined fixed pattern of symbol values based on luminance values in pixels of the video frame of the content; and

detects the symbol values when the predetermined fixed pattern is detected to extract the metadata.

12. The reception apparatus according to claim 9 , wherein the processing unit:

averages, for each subset of the pixels making up one of the symbol values, the luminance values; and

detects the symbol values based on the averaged luminance values.

13. The reception apparatus according to claim 9 , wherein each of the symbol values has one of two possible values and the predetermined luminance value threshold delineates ranges of luminance values detected as each of the two possible values.

14. The reception apparatus according to claim 9 , wherein each of the symbol values has one of four possible values and the at least one predetermined luminance value threshold includes three luminance value thresholds delineating ranges of luminance values detected as each of the four possible values.

15. The reception apparatus according to claim 9 , wherein the same watermark is entirely encoded within luminance values of at least line 1 and line 2 of the video frame of the content and the watermark is not encoded in any other lines of the video frame.

16. An information providing apparatus, comprising:

a memory; and

a processing unit that, according to instructions loaded from the memory,

receives or retrieves content to be provided to a reception apparatus,

embeds metadata in a video frame of the content, the metadata being embedded as a watermark in a video frame of the content, and

provides the content to the reception apparatus, wherein

the metadata is extracted by the reception apparatus based on luminance values in pixels of the video frame of the content and based on at least one predetermined luminance value threshold, wherein

at least one of the luminance values in the pixels of the video frame corresponding to symbol values of the watermark is less than a value corresponding to black, a maximum luminance value in the pixels of the video frame corresponding to symbol values of the watermark is less than a value corresponding to white, and

each of the symbol values has one of N possible values that are detected based on (N−1) predetermined luminance value thresholds that delineate ranges of luminance values detected as each of the N possible values, where N is an integer greater than 1.

17. The information providing apparatus according to claim 16 , wherein the same watermark is embedded in a plurality of consecutive video frames of the content.

18. The information providing apparatus according to claim 16 , wherein each of the symbol values has one of two possible values and the predetermined luminance value threshold delineates ranges of luminance values detected as each of the two possible values.

19. The information providing apparatus according to claim 16 , wherein each of the symbol values has one of four possible values and the at least one predetermined luminance value threshold includes three luminance value thresholds delineating ranges of luminance values detected as each of the four possible values.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 30, 2020
From: SONY CORPORATION
To: SATURN LICENSING LLC
Reel/Frame 052256/0443 →
Continuity (3)
Continuation 14741168 · Jun 16, 2015
Provisional Application 62135246 · Mar 19, 2015
Related Publication 20180176640A1 · Jun 21, 2018