IP Library › Granted Patent US 12,081,873
Granted Patent B2
US 12,081,873 · App. 17/617,420 · Granted Sep 3, 2024

Image processing device, image processing method, and non-transitory storage medium

Inventors: Jianquan Liu (Tokyo, JP); Junnan Li (Tokyo, JP)
Assignee: NEC CORPORATION
H04N23/698H04N23/611
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,081,873
App. No.
17/617,420
Granted
Sep 3, 2024
Kind
B2
Abstract

The present invention provides an image processing apparatus ( 10 ) including a detection unit ( 12 ) that detects a plurality of predetermined points of a body of each of a plurality of persons from an image in an image circle of a fisheye image, a gravity direction determination unit ( 13 ) that determines a gravity direction in a position of each of the plurality of persons from the plurality of predetermined points, a reference point decision unit ( 14 ) that decides a reference point, based on the gravity direction in the position of each of the plurality of persons, a complementary circular image generation unit ( 16 ) that generates a complementary circular image that is a circular image acquired by adding a complementary image to the image in the image circle of the fisheye image, and that has, as a center, the reference point different from a center of the image in the image circle, and an expansion unit ( 17 ) that panoramically expands the complementary circular image, based on the reference point, and generates a panoramic image.

Claims (35)

1. An image processing apparatus, comprising:

at least one memory storing one or more instructions; and

at least one processor configured to execute the one or more instructions to:

generate a complementary circular image that is a circular image acquired by adding a complementary image to an image in an image circle in an image generated by a fisheye lens camera, and that has, as a center, a reference point different from a center of the image in the image circle; and

panoramically expand the complementary circular image, based on the reference point, and generate a panoramic image.

2. The image processing apparatus according to claim 1 , wherein

the at least one processor configured to execute the one or more instructions to generate the complementary circular image in which a maximum value of a distance from the reference point to a point on a circumference of the image in the image circle is a radius.

3. The image processing apparatus according to claim 1 , wherein

the at least one processor configured to execute the one or more instructions to decide a reference line that does not overlap a person, cut open the complementary circular image from the reference line, and generate the panoramic image.

4. The image processing apparatus according to claim 1 ,

wherein the processor is further configured to execute the one or more instructions to:

detect a plurality of predetermined points of a body of each of a plurality of persons from the image in the image circle;

determine a gravity direction in a position of each of a plurality of persons, based on the plurality of predetermined points; and

decide the reference point, based on a gravity direction in the position of each of the plurality of persons.

5. The image processing apparatus according to claim 4 , wherein,

the at least one processor configured to execute the instructions to set an intersection point as the reference point in case of a straight line that passes through a position of each of the plurality of persons and extends in a gravity direction in the position of each of the plurality of persons intersects at one point.

6. The image processing apparatus according to claim 4 , wherein, the at least one processor configured to execute the one or more instructions to set, as the reference point, a point in which a distance from each of a plurality of the straight lines satisfies a predetermined condition in case of a straight line that passes through a position of each of the plurality of persons and extends in a gravity direction in the position of each of the plurality of persons does not intersect at one point.

7. The image processing apparatus according to claim 4 , wherein

the at least one processor configured to execute the one or more instructions to detect a plurality of points of a body in which a line connecting the points is parallel to a gravity direction in an image generated by capturing a standing person from the front.

8. The image processing apparatus according to claim 4 , wherein

the at least one processor configured to execute the one or more instructions to detect a plurality of points of a body in which a line connecting the points is perpendicular to a gravity direction in an image generated by capturing a standing person from the front.

9. The image processing apparatus according to claim 1 , wherein

the at least one processor configured to execute the one or more instructions to perform, at a plurality of rotation angles, processing of rotating the image in the image circle, analyzing the image in the image circle after the rotation, and detecting a plurality of predetermined points of a body of a person.

10. The image processing apparatus according to claim 4 , wherein,

the at least one processor configured to execute the one or more instructions to:

generate the complementary circular image in case of the reference point does not coincide with a center of the image in the image circle, and

panoramically expand the complementary circular image.

11. The image processing apparatus according to claim 4 , wherein

the at least one processor configured to execute the one or more instructions to panoramically expand the image in the image circle instead of the complementary circular image in case of the reference point coincides with a center of the image in the image circle.

12. An image processing method, comprising:

generating a complementary circular image that is a circular image acquired by adding a complementary image to an image in an image circle in an image generated by a fisheye lens camera, and that has, as a center, a reference point different from a center of the image in the image circle; and

panoramically expanding the complementary circular image, based on the reference point, and generating a panoramic image.

13. A non-transitory storage medium storing a program causing a computer to:

generate a complementary circular image that is a circular image acquired by adding a complementary image to an image in an image circle in an image generated by a fisheye lens camera, and that has, as a center, a reference point different from a center of the image in the image circle; and

panoramically expand the complementary circular image, based on the reference point, and generate a panoramic image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 8, 2021
From: LIU, JIANQUAN; LI, JUNNAN
To: NEC CORPORATION
Reel/Frame 058334/0913 →
Continuity (1)
Related Publication 20220247924A1 · Aug 4, 2022