IP Library › Granted Patent US 11,178,406
Granted Patent B2
US 11,178,406 · App. 16/651,695 · Granted Nov 16, 2021

Video compression apparatus, electronic apparatus, and video compression program

Inventors: Daisaku Komiya (Tokyo, JP); Naoki Sekiguchi (Yashio, JP)
Assignee: NIKON CORPORATION
H04N19/172H04N19/146H04N19/513H04N19/85
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,178,406
App. No.
16/651,695
Granted
Nov 16, 2021
Kind
B2
Abstract

A video compression apparatus includes: an acquisition unit configured to acquire video data including a plurality of frames outputted from an imaging element that has a first imaging region to image a subject and a second imaging region to image a subject and for which a first frame rate can be set for the first imaging region and a second frame rate higher than the first frame rate can be set for the second imaging region; and a compression unit configured to compress the video data acquired by the acquisition unit based on the first frame rate and the second frame rate.

Claims (38)

1. A video compression apparatus, comprising a processor and associated memory configured to:

acquire video data including a plurality of frames outputted from an imaging element (i) that has a first imaging region to image a subject and a second imaging region to image a subject and (ii) for which a first frame rate can be set for the first imaging region and a second frame rate higher than the first frame rate can be set for the second imaging region;

set, with regard to image data of the first imaging region, a specific motion vector showing that no motion exists in an object in the image data of the first imaging region;

execute, with regard to image data of the second imaging region, detection of a motion vector;

execute, with regard to the image data of the first imaging region, a motion compensation based on the specific motion vector; and

execute, with regard to the image data of the second imaging region, a motion compensation based on the detected motion vector.

2. The video compression apparatus according to claim 1 , wherein the processor is further configured to:

generate, with regard to each of the plurality of frames, based on difference data between the frame and a prediction frame for predicting the frame, a reference frame referred to by a frame inputted temporally after the frame; and

execute the motion compensation on the image data of the first imaging region based on the specific motion vector and the reference frame and execute the motion compensation on the image data of the second imaging region based on the detected motion vector and the reference frame.

3. A video compression apparatus comprising a processor and associated memory configured to:

acquire video data including a plurality of frames outputted from an imaging element (i) that has a first imaging region to image a subject and a second imaging region to image a subject and (ii) for which a first frame rate can be set for the first imaging region and a second frame rate higher than the first frame rate can be set for the second imaging region;

generate, with regard to each of the plurality of frames, based on difference data between the frame and a prediction frame for predicting the frame, a reference frame referred to by a frame inputted temporally after the frame;

execute detection of a motion vector on image data of the first imaging region and execute detection of a motion vector on image data of the second imaging region;

execute, with regard to the image data of the first imaging region, motion compensation based on the reference frame; and

execute, with regard to the image data of the second imaging region, motion compensation based on the reference frame and the detected motion vector.

4. The video compression apparatus according to claim 3 , wherein the processor is further configured to

determine, with regard to the image data of the first imaging region, the reference frame as the prediction frame for predicting the frame temporally after the frame.

5. A video compression apparatus, further comprising a processor and associated memory configured to:

acquire video data including a plurality of frames outputted from an imaging element (i) that has a first imaging region to image a subject and a second imaging region to image a subject (ii) and for which a first frame rate can be set for the first imaging region and a second frame rate higher than the first frame rate can be set for the second imaging region; and

compress the acquired video data based on a third frame and a fourth frame, the third frame being generated based on a first frame in the video data that is outputted from the first imaging region on first timing and a second frame in the video data that is outputted from the second imaging region on the first timing, and the fourth frame being generated based on the first frame outputted from the first imaging region on the first timing and a second frame outputted from the second imaging region on second timing different from the first timing.

6. The video compression apparatus according to claim 5 , wherein the processor is further configured to:

update, based on (i) a first frame imaged by at least a first imaging region among the first imaging region for which the first frame rate is set and a second imaging region for which the second frame rate is set and (ii) a second frame imaged by the second imaging region temporally after the first frame among the plurality of frames, the second frame as a fifth frame obtained by synthesizing image data of the first imaging region in the first frame and image data of the second imaging region in the second frame; and

update the second frame to the fifth frame by applying the image data of the second imaging region in the second frame to a range in the image data of the second imaging region in the second frame that is overlapped with the image data of the first imaging region in the first frame.

7. The video compression apparatus according to claim 6 ,

wherein the processor is configured to update the second frame to the fifth frame by applying the image data of the second imaging region in the first frame to a range in the second frame that does not belong to any of the second imaging region in the second frame or the first imaging region in the first frame.

8. A video compression apparatus for compressing video data including a plurality of frames outputted from an imaging element (i) that has a first imaging region to image a subject and a second imaging region to image a subject and (ii) for which a first frame rate can be set for the first imaging region and a second frame rate higher than the first frame rate can be set for the second imaging region, the apparatus comprising a processor and associated memory configured to:

generate, with regard to respective ones of the plurality of frames and based on difference data between each frame and a prediction frame for predicting the frame, reference frames referred to by frames inputted temporally after the frame; and

execute a motion compensation on a specific reference frame among the plurality of generated reference frames using a frame among the plurality of frames that was imaged by the second frame rate,

wherein the respective plurality of frames includes at least image data of a first imaging region corresponding to the first imaging region for which the first frame rate is set, and

the processor is configured to execute motion compensation on the image data of the first imaging region using, as the specific reference frame, one of the plurality of reference frames generated using a frame temporally previous to the frame.

9. A non-transitory computer-readable medium comprising a video compression program that causes a processor to execute:

acquisition processing to acquire video data including a plurality of frames outputted from an imaging element (i) that has a first imaging region to image a subject and a second imaging region to image a subject and (ii) for which a first frame rate can be set for the first imaging region and a second frame rate higher than the first frame rate can be set for the second imaging region; and

compression processing to compress the video data acquired by the acquisition processing based on a third frame and a fourth frame, the third frame being generated based on a first frame in the video data that is outputted from the first imaging region on first timing and a second frame in the video data that is outputted from the second imaging region on the first timing, and the fourth frame being generated based on the first frame outputted from the first imaging region on the first timing and a second frame in the video data outputted from the second imaging region on second timing different from the first timing.

10. A non-transitory computer-readable medium comprising a video compression program that causes a processor to compress video data including a plurality of frames outputted from an imaging element (i) that has a first imaging region to image a subject and a second imaging region to image a subject and (ii) for which a first frame rate can be set for the first imaging region and a second frame rate higher than the first frame rate can be set for the second imaging region, the program causing the processor to execute:

generation processing to generate, with regard to respective ones of the plurality of frames and based on difference data between each frame and a prediction frame for predicting the frame, reference frames referred to by frames inputted temporally after the frame; and

motion compensation processing to use a specific reference frame among the reference frames generated by the generation processing to execute the motion compensation on a frame imaged at the second frame rate among the plurality of frames,

wherein the respective plurality of frames includes at least image data of a first imaging region corresponding to the first imaging region for which the first frame rate is set, and

motion compensation is executed on the image data of the first imaging region using, as the specific reference frame, one of the plurality of reference frames generated using a frame temporally previous to the frame.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 10, 2020
From: KOMIYA, DAISAKU; SEKIGUCHI, NAOKI
To: NIKON CORPORATION
Reel/Frame 054327/0767 →
Priority Claims (1)
JP JP2017-192102 · Sep 29, 2017 · national
Continuity (1)
Related Publication 20200304809A1 · Sep 24, 2020