IP Library › Granted Patent US 11,551,330
Granted Patent B2
US 11,551,330 · App. 16/870,945 · Granted Jan 10, 2023

Systems and methods for generating panorama image

Inventors: Chuan Qin (Hangzhou, CN); Chengzhe Meng (Hangzhou, CN)
Assignee: ZHEJIANG DAHUA TECHNOLOGY CO., LTD.
G06T3/4038G06T3/4007G06T3/60G06T7/70H04N5/23238H04N13/207G06T2207/20221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,551,330
App. No.
16/870,945
Granted
Jan 10, 2023
Kind
B2
Abstract

The present disclosure relates to image processing systems and methods. The method may include obtaining a first image and a second image. The first image may be captured by a first camera lens of a panorama device and the second image may be captured by a second camera lens of the panorama device. The method may also include performing an interpolation based on a center of the first image to obtain a first rectangular image, and performing an interpolation based on a center of the second image to obtain a second rectangular image. The method may further include generating a fused image based on the first rectangular image and the second rectangular image, and mapping the fused image to a spherical panorama image.

Claims (65)

1. An image processing system for generating a spherical panorama image, comprising:

at least one storage device including a set of instructions;

at least one processor in communication with the at least one storage device, wherein when executing the set of instructions, the at least one processor is configured to cause the system to:

obtain a first image and a second image, wherein the first image is captured by a first camera lens of a panorama device and the second image is captured by a second camera lens of the panorama device;

obtain a first rectangular image by performing an interpolation based on a plurality of first fan-shaped images, wherein a top side of the first rectangular image corresponds to a center of the first image and each one of the plurality of first fan-shaped images is part of the first image;

obtain a second rectangular image by performing an interpolation based on a plurality of second fan-shaped images, wherein a bottom side of the second rectangular image corresponds to a center of the second image and each one of the plurality of second fan-shaped images is part of the second image;

generate a fused image based on the first rectangular image and the second rectangular image; and

map the fused image to a spherical panorama image.

2. The image processing system of claim 1 , wherein the first camera lens and the second camera lens are arranged oppositely, the first camera lens corresponding to a forward direction and the second camera lens corresponding to a backward direction.

3. The image processing system of claim 1 , wherein

a field of view (FOV) of the first camera lens exceeds 180°, and

a FOV of the second camera lens exceeds 180°.

4. The image processing system of claim 1 , wherein the at least one processor is configured to cause the system to:

determine one or more location parameters of the first image, wherein the center of the first image corresponds to a forward direction, a top, a bottom, a left, and a right of the first image correspond to northward, southward, western, and eastern, respectively; and

determine one or more location parameters of the second image, wherein the center of the second image corresponds to a backward direction, a top, a bottom, a left, and a right of the second image correspond to northward, southward, eastern, and western, respectively.

5. The image processing system of claim 4 , wherein

the top side of the first rectangular image corresponds to the forward direction;

a bottom side of the first rectangular image corresponds to western, northward, eastern, and southward;

the bottom side of the second rectangular image corresponds to the backward direction; and

a top side of the second rectangular image corresponds to western, northward, eastern, and southward.

6. The image processing system of claim 1 , wherein to generate a fused image, the at least one processor is configured to cause the system to:

generate a stitched image by stitching a bottom side of the first rectangular image and a top side of the second rectangular image, the stitched image including a stitching region; and

generate the fused image by fusing the stitching region of the stitched image.

7. The image processing system of claim 6 , wherein the bottom side of the first rectangular image and the top side of the second rectangular image correspond to a same direction.

8. The image processing system of claim 1 , wherein to map the fused image to a spherical panorama image, the at least one processor is configured to cause the system to:

determine a mapping relationship between a two-dimensional (2D) coordinate system and a spherical coordinate system; and

map the fused image to the spherical panorama image according to the mapping relationship.

9. The image processing system of claim 1 , wherein the at least one processor is further configured to cause the system to:

rotate the spherical panorama image with 90° such that a top vertex of the spherical panorama image corresponds to northward and a bottom vertex of the spherical panorama image corresponds to southward.

10. The image processing system of claim 1 , wherein:

an aspect ratio of the first rectangular image is or substantially is 2:0.5; or

an aspect ratio of the second rectangular image is or substantially is 2:0.5.

11. An image processing method implemented on a computing device having at least one processor, at least one computer-readable storage medium, and a communication platform connected to a network, comprising:

obtaining a first image and a second image, wherein the first image is captured by a first camera lens of a panorama device and the second image is captured by a second camera lens of the panorama device;

obtaining a first rectangular image by performing an interpolation based on a plurality of first fan-shaped images, wherein a top side of the first rectangular image corresponds to a center of the first image and each one of the plurality of first fan-shaped images is part of the first image;

obtaining a second rectangular image by performing an interpolation based on a plurality of second fan-shaped images, wherein a bottom side of the second rectangular image corresponds to a center of the second image and each one of the plurality of second fan-shaped images is part of the second image;

generating a fused image based on the first rectangular image and the second rectangular image; and

mapping the fused image to a spherical panorama image.

12. The image processing method of claim 11 , wherein the first camera lens and the second camera lens are arranged oppositely, the first camera lens corresponding to a forward direction and the second camera lens corresponding to a backward direction.

13. The image processing method of claim 11 , wherein

a field of view (FOV) of the first camera lens exceeds 180°, and

a FOV of the second camera lens exceeds 180°.

14. The image processing method of claim 11 , further comprising

determining one or more location parameters of the first image, wherein the center of the first image corresponds to a forward direction, a top, a bottom, a left, and a right of the first image correspond to northward, southward, western, and eastern, respectively; and

determining one or more location parameters of the second image, wherein the center of the second image corresponds to a backward direction, a top, a bottom, a left, and a right of the second image correspond to northward, southward, eastern, and western, respectively.

15. The image processing method of claim 14 , wherein

the top side of the first rectangular image corresponds to the forward direction;

a bottom side of the first rectangular image corresponds to western, northward, eastern, and southward;

the bottom side of the second rectangular image corresponds to the backward direction; and

a top side of the second rectangular image corresponds to western, northward, eastern, and southward.

16. The image processing method of claim 11 , wherein generating a fused image comprises:

generating a stitched image by stitching a bottom side of the first rectangular image and a top side of the second rectangular image, the stitched image including a stitching region; and

generating the fused image by fusing the stitching region of the stitched image.

17. The image processing method of claim 16 , wherein the bottom side of the first rectangular image and the top side of the second rectangular image correspond to a same direction.

18. The image processing method of claim 11 , wherein mapping the fused image to a spherical panorama image comprises:

determining a mapping relationship between a two-dimensional (2D) coordinate system and a spherical coordinate system; and

mapping the fused image to the spherical panorama image according to the mapping relationship.

19. The image processing method of claim 11 , further comprising:

rotate the spherical panorama image with 90° such that a top vertex of the spherical panorama image corresponds to northward and a bottom vertex of the spherical panorama image corresponds to southward.

20. A non-transitory computer-readable storage medium, comprising at least one set of instructions, wherein when executed by at least one processor of a computing device, the at least one set of instructions directs the at least one processor to perform acts of:

obtaining a first image and a second image, wherein the first image is captured by a first camera lens of a panorama device and the second image is captured by a second camera lens of the panorama device;

obtaining a first rectangular image by performing an interpolation based on a plurality of first fan-shaped images, wherein a top side of the first rectangular image corresponds to a center of the first image and each one of the plurality of first fan-shaped images is part of the first image;

obtaining a second rectangular image by performing an interpolation based on a plurality of second fan-shaped images, wherein a bottom side of the second rectangular image corresponds to a center of the second image and each one of the plurality of second fan-shaped images is part of the second image;

generating a fused image based on the first rectangular image and the second rectangular image; and

mapping the fused image to a spherical panorama image.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 12, 2020
From: QIN, CHUAN
To: ZHEJIANG DAHUA TECHNOLOGY CO., LTD.
Reel/Frame 052925/0409 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 12, 2020
From: MENG, CHENGZHE
To: ZHEJIANG DAHUA TECHNOLOGY CO., LTD.
Reel/Frame 052925/0464 →
Priority Claims (1)
CN 201711098923.5 · Nov 9, 2017 · national
Continuity (2)
Continuation PCTCN2018114297 · Nov 7, 2018
Related Publication 20200273149A1 · Aug 27, 2020