IP Library › Granted Patent US 11,212,436
Granted Patent B2
US 11,212,436 · App. 16/870,225 · Granted Dec 28, 2021

Image processing and presentation

Inventors: Chao Weng (Shenzhen, CN); Hongjing Chen (Shenzhen, CN)
Assignee: SZ DJI TECHNOLOGY CO., LTD.
H04N5/23232G06T7/13G06T7/337H04N5/2628H04N5/272
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,212,436
App. No.
16/870,225
Granted
Dec 28, 2021
Kind
B2
Abstract

An image presentation method includes obtaining a first image captured by a first image sensor and a second image captured by a second image sensor; size-processing the first image according to at least one of a target resolution, an aspect ratio of the first image, or an aspect ratio of the second image to generate a size-processed first image having the target resolution; and generating a presenting image at least by combining the size-processed first image and the second image. The presenting image has a preset resolution that is not less than a sum of the target resolution and a resolution of the second image.

Claims (38)

1. An image presenting method comprising:

obtaining a first image captured by a first image sensor and a second image captured by a second image sensor, an aspect ratio of the first image being different from an aspect ratio of the second image, and both the first image and the second image containing a target object;

recognizing an edge profile of the target object in the first image and an edge profile of the target object in the second image;

calculating a displaying size of the target object in the first image and a displaying size of the target object in the second image, based on the edge profile of the target object in the first image and the edge profile of the target object in the second image;

calculating a ratio of the displaying size of the target object in the first image to the displaying size of the target object in the second image;

size-processing the first image to generate a size-processed first image according to the ratio, a displaying size of a target object in the size-processed first image being equal to a displaying size of the target object in the second image, an aspect ratio of the size-processed first image being different from the aspect ratio of the second image, a field of view (FOV) of the size-processed first image being larger than an FOV of the second image, and both an edge of the target object in the size-processed first image and an edge of the target object in the first image being sharper than an edge of the target object in the second image;

determining a matching region of one of the size-processed first image and the second image that matches a central region of another one of the size-processed first image and the second image;

superimposing the matching region of the one of the size-processed first image and the second image on the central region of the another one of the size-processed first image and the second image; and

generating, at least according to the superimposed matching region, a presenting image by fusing the size-processed first image and the second image.

2. The method of claim 1 , wherein:

an FOV of the first image sensor covers an FOV of the second image sensor.

3. The method of claim 2 , wherein:

a displaying size of the target object in the first image is smaller than or equal to the displaying size of the target object in the second image.

4. The method of claim 1 , further comprising:

aligning the size-processed first image with the second image by aligning the edge profile of the target object in the first image and the edge profile of the target object in the second image; and

obtaining a coordinate mapping relationship between the size-processed first image and the second image;

wherein determining the matching region includes determining the matching region according to the coordinate mapping relationship between the size-processed first image and the second image.

5. The method of claim 1 , wherein:

a superimposed image is generated by superimposing the matching region on the central region; and

generating the presenting image further includes zooming in or out the superimposed image until a resolution of the superimposed image in one of a vertical direction and a horizontal direction is equal to a preset resolution in the one of the vertical direction and the horizontal direction to generate a zoomed image.

6. The method of claim 5 , wherein generating the presenting image further includes:

adding pixels having a fixed value around the zoomed image in another one of the vertical direction and the horizontal direction or cropping the zoomed image in the another one of the vertical direction and the horizontal direction to generate the presenting image having a preset resolution.

7. The method of claim 1 , further comprising:

recognizing edge profiles of a plurality of objects in the first image and edge profiles of the plurality of objects in the second image, each of the edge profiles being an outline of one of the plurality of objects;

selecting one of the plurality of objects as the target object;

aligning the size-processed first image with the second image by aligning an edge profile of the target object in the first image and an edge profile of the target object in the second image; and

obtaining a coordinate mapping relationship between the size-processed first image and the second image based on the aligned target object;

wherein determining the matching region includes determining the matching region according to the coordinate mapping relationship between the size-processed first image and the second image.

8. The method of claim 1 , wherein:

a resolution of the first image is different from a resolution of the second image; and

a resolution of the size-processed first image is different from the resolution of the second image.

9. The method of claim 1 , wherein calculating the ratio includes:

calculating the ratio by dividing one of the displaying size of the target object in the first image and the displaying size of the target object in the second image by another one of the displaying size of the target object in the first image and the displaying size of the target object in the second image.

10. The method of claim 1 , wherein:

calculating the displaying size of the target object in the first image includes calculating the displaying size of the target object in the first image based on pixels within the edge profile of the target object in the first image; and

calculating the displaying size of the target object in the second image includes calculating the displaying size of the target object in the second image based on pixels within the edge profile of the target object in the second image.

11. The method of claim 1 , wherein:

a displaying size of the target object in the first image being smaller than a displaying size of the target object in the second image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 8, 2020
From: WENG, CHAO; CHEN, HONGJING
To: SZ DJI TECHNOLOGY CO., LTD.
Reel/Frame 052612/0539 →
Continuity (2)
Continuation PCTCN2018102493 · Aug 27, 2018
Related Publication 20200275021A1 · Aug 27, 2020
Cited By (1)
US 12,493,931