IP Library Granted Patent US 10,057,591
Granted Patent B2
US 10,057,591 · App. 15/135,989 · Granted Aug 21, 2018

Method and device for processing a video stream in a video camera

Inventors: Song Yuan (Sodra Sandby, SE); Alexandre Martins (Malmo, SE)
Assignee: AXIS AB
H04N19/46H04N19/115H04N19/137H04N19/167H04N19/176H04N19/186H04N19/85H04N21/435H04N21/84
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,057,591
App. No.
15/135,989
Granted
Aug 21, 2018
Kind
B2
Abstract

A method for processing an image in a video device, comprises reading an image and combining the image with metadata related to the image by embedding the metadata in or with the image. The method further includes combining transforming the image and extracting the metadata from the image, before encoding the image in an encoder and utilizing the metadata as input in further processing.

Claims (50)

1. A method for processing an image in a video device, the method comprising:

reading an image;

combining the image with metadata related to the image by embedding the metadata into the image, wherein

the image includes a plurality of blocks of pixels,

each block of pixels includes a plurality of pixels, and

the metadata is embedded into the image such that particular metadata, corresponding to a particular block of pixels of the plurality of blocks of pixels, is embedded in the particular block of pixels;

dewarping the image with the embedded metadata to generate a dewarped image;

extracting the metadata from the dewarped image to generate a transformed image and forwarding the transformed image to an encoder;

encoding the transformed image in the encoder; and

utilizing the metadata as input in further processing.

2. The method of claim 1 , wherein the further processing comprises processing of the image or processing of subsequent images.

3. The method of claim 1 , wherein the further processing comprises processing the metadata.

4. The method of claim 1 , wherein the further processing comprises image analysis, vision applications, performing rate control, performing frame stitching, action triggering or supporting image analysis tools, and combinations thereof.

5. The method of claim 1 , further comprising deriving the metadata from the image prior to embedding it into the image.

6. The method of claim 1 , converting the image from a raster format to a block format is performed prior to transforming the image, and wherein converting the image back from a block format to a raster format is performed prior to processing the image using the metadata as input.

7. The method of claim 1 , comprising combining the image with metadata prior to, and/or following transforming the image, wherein the metadata is in the form of overlays.

8. The method of claim 1 , wherein metadata is combined with the image by embedding the metadata as an additional color space component to a corresponding pixel block.

9. The method of claim 1 , wherein the metadata is combined with the image by padding a color space component of a specific pixel block with the metadata corresponding to the specific pixel block.

10. The method of claim 1 , wherein the metadata replaces a portion of the color or luminance information in the image.

11. The method of claim 1 , wherein the metadata is appended to every macro block in a block formatted image.

12. The method of claim 1 , wherein the metadata is selected from the group comprising: signal to noise metadata, compression metadata, motion metadata, privacy mask metadata and region of interest metadata, and combinations thereof.

13. The method of claim 1 , wherein the video device is a video camera, a video encoder, a video transcoder, or a video management system.

14. A video device arranged to perform the method of claim 1 , said video device comprising:

an image processing pipeline configured to extract the metadata from the dewarped image, and further being configured to embed said metadata or other metadata into the image;

a transformer configured to receive the image with embedded metadata and to dewarp the image with the embedded metadata according to defined settings; and

an extractor configured to extract the metadata from the dewarped image with the metadata, and to forward the transformed image to an image encoder configured to compress the image according to a particular protocol.

15. The video device of claim 14 , wherein the video device is a video camera, a video encoder, a video transcoder, or a video management system.

16. An electronic device, comprising:

circuitry configured to

read an image;

combine the image with metadata related to the image by embedding the metadata into the image, wherein

the image includes a plurality of blocks of pixels,

each block of pixels includes a plurality of pixels, and

the metadata is embedded into the image such that particular metadata, corresponding to a particular block of pixels of the plurality of blocks of pixels, is embedded in the particular block of pixels;

dewarp the image with the embedded metadata to generate a dewarped image;

extract the metadata from the dewarped image to generate a transformed image; and

forward the transformed image to an encoder; and

the encoder configured to

encode the transformed image; and

utilize the metadata as input in further processing.

17. A method for processing an image in a video device, the method comprising:

reading an image;

combining the image with metadata related to the image by embedding the metadata into the image, wherein

the image includes a plurality of blocks of pixels,

each block of pixels includes a plurality of pixels, and

the metadata is embedded into the image such that particular metadata, corresponding to a particular block of pixels of the plurality of blocks of pixels and defining movement of the particular block of pixels, is embedded in the particular block of pixels;

spatially transforming the image with the embedded metadata;

extracting the metadata from the image and forwarding the image to an encoder;

encoding the image in the encoder; and

utilizing the metadata as input in further processing.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 22, 2016
From: YUAN, SONG; MARTINS, ALEXANDRE
To: AXIS AB
Reel/Frame 038498/0865 →
Priority Claims (1)
EP 15164848 · Apr 23, 2015 · regional
Continuity (1)
Related Publication 20160316219A1 · Oct 27, 2016
Cited By (2)
US 12,289,483 US 12,505,510