IP Library › Granted Patent US 11,758,181
Granted Patent B2
US 11,758,181 · App. 17/437,583 · Granted Sep 12, 2023

Encoding method, encoding apparatus, and program

Inventors: Seishi Takamura (Musashino, JP); Gene Cheung (North York, CA); Cheng Yang (Minhang District Shanghai, CN)
Assignees: NIPPON TELEGRAPH AND TELEPHONE CORPORATION; Inter-University Research Institute Corporation Research Organization Of Information And Systems
H04N19/527H04N19/103H04N19/137H04N19/172H04N19/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,758,181
App. No.
17/437,583
Granted
Sep 12, 2023
Kind
B2
Abstract

An encoding method is performed by an encoding apparatus, and the encoding method includes a step in which an image of an object captured by a camera in a plurality of frames of a moving image is analyzed and it is determined whether camera parameters relating to an intrinsic matrix of the camera are invariable, a step in which, when the camera parameters are invariable, six parameters representing destinations of three points for a projective transformation unit of the image of the object are generated, and a homography matrix is generated on the basis of the six parameters, and a step in which projective transformation is performed on the projective transformation unit of the image of the object using the homography matrix, and a prediction signal of the image of the object is generated on the basis of the result of the projective transformation.

Claims (21)

1. An encoding method performed by an encoding apparatus, comprising:

steps in which, on the basis of an image of an object captured by a camera in a plurality of frames of a moving image, it is determined whether camera parameters relating to an intrinsic matrix of the camera are the same in the plurality of frames, and the camera parameters are output to a predetermined apparatus when the camera parameters are the same;

steps in which, when the camera parameters are the same, six parameters representing destinations of three points defined in the image of the object are generated by a six-dimensional search which updates a third column of a matrix representing a space rotation amount when the camera moves between two positions, a homography matrix is generated on the basis of the six parameters, and the six parameters are output to the predetermined apparatus;

a step in which projective transformation using the homography matrix is performed on a decoded image of the moving image;

a step in which a prediction residual signal which is a difference between the result of the projective transformation and the frame is generated; and

a step in which the prediction residual signal is encoded.

2. The encoding method according to claim 1 ,

wherein the object has a flat exterior shape.

3. An encoding apparatus, comprising:

an analyzer configured to, on the basis of an image of an object captured by a camera in a plurality of frames of a moving image, determine whether camera parameters relating to an intrinsic matrix of the camera are the same in the plurality of frames, and output the camera parameters to a predetermined apparatus when the camera parameters are the same;

a matrix generator configured to, when the camera parameters are the same, generate six parameters representing destinations of three points defined in the image of the object by a six-dimensional search which updates a third column of a matrix representing a space rotation amount when the camera moves between two positions, generate a homography matrix on the basis of the six parameters, and output the six parameters to the predetermined apparatus;

a projective transformer configured to perform projective transformation using the homography matrix on a decoded image of the moving image;

a subtracter configured to generate a prediction residual signal which is a difference between the result of the projective transformation and the frame; and

an encoder configured to encode the prediction residual signal,

wherein each of the analyzer, the matrix generator, the projective transformer, the subtracter and the encoder is implemented by:

i) computer executable instructions executed by the at least one processor,

ii) at least one circuitry or

iii) a combination of computer executable instructions executed by at least one processor and at least one circuitry.

4. The encoding apparatus according to claim 3 ,

wherein the object has a flat exterior shape.

5. A non-transitory computer readable medium storing a program causing a computer to function as the encoding apparatus according to claim 3 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 9, 2021
From: TAKAMURA, SEISHI; CHEUNG, GENE; YANG, CHENG
To: NIPPON TELEGRAPH AND TELEPHONE CORPORATION; INTER-UNIVERSITY RESEARCH INSTITUTE CORPORATION RESEARCH ORGANIZATION OF INFORMATION AND SYSTEMS
Reel/Frame 057430/0024 →
Priority Claims (1)
JP 2019-047260 · Mar 14, 2019 · national
Continuity (1)
Related Publication 20220141483A1 · May 5, 2022