IP Library Granted Patent US 10,650,494
Granted Patent B2
US 10,650,494 · App. 16/056,747 · Granted May 12, 2020

Image stitching method and device

Inventor: Ren-You Huang (Hsinchu Hsien, TW)
Assignee: XIAMEN SIGMASTAR TECHNOLOGY LTD
G06T3/4038G06T7/30G06T7/55G06T7/73G06T2207/20212
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,650,494
App. No.
16/056,747
Granted
May 12, 2020
Kind
B2
Abstract

An image stitching method and an image stitching device for stitching a first image and a second image are presented. The image stitching method includes: calculating, according to pixel values of the first image and the second image in an overlapping area, a plurality of costs respectively corresponding to a plurality of positions in the overlapping area; calculating, according to the plurality of costs and relative distances between the plurality of positions, a plurality of forward regularized cumulative costs respectively corresponding to the plurality of positions in the overlapping area; determining a seam in the overlapping area according to the plurality of forward regularized cumulative costs, wherein the seam includes a plurality of stitching positions; and stitching the first image and the second image on the basis of the seam to generate a stitched image.

Claims (36)

1. An image stitching method, for stitching a first image and a second image, comprising:

calculating, according to pixel values of the first image and the second image in an overlapping area, a plurality of costs respectively corresponding to a plurality of positions in the overlapping area;

calculating, according to the plurality of costs and relative distances between the plurality of positions, a plurality of forward regularized cumulative costs respectively corresponding to the plurality of positions in the overlapping area;

determining a seam in the overlapping area according to the plurality of forward regularized cumulative costs, wherein the seam comprises a plurality of stitching positions; and

stitching the first image and the second image on the basis of the seam to generate a stitched image.

2. The image stitching method according to claim 1 , wherein a forward regularized cumulative cost of the plurality of forward regularized cumulative costs of a position is associated with a distance component between the position and an adjacent position.

3. The image stitching method according to claim 1 , wherein the step of determining the seam in the overlapping area according to the plurality of forward regularized cumulative costs comprises:

determining a stitching position of the seam according to one line of forward regularized cumulative costs;

calculating one line of backward regularized cumulative costs according to the stitching position;

determining a smallest backward regularized cumulative cost from the line of backward regularized cumulative costs; and

selecting a position corresponding to the smallest backward regularized cumulative cost as a next stitching position of the seam.

4. The image stitching method according to claim 1 , further comprising:

recording a plurality of source positions of the plurality of forward regularized cumulative costs.

5. The image stitching method according to claim 2 , wherein the forward regularized cumulative cost of the position comprises a square of the distance component between the position and the adjacent position.

6. The image stitching method according to claim 2 , wherein the forward regularized cumulative cost of the position comprises an absolute value of the distance component between the position and the adjacent position.

7. The image stitching method according to claim 4 , wherein the step of determining the seam in the overlapping area according to the plurality of forward regularized cumulative costs comprises:

determining a stitching position of the seam according to one line of forward regularized cumulative costs; and

selecting a source position corresponding to the stitching position as a next stitching position of the seam.

8. An image stitching device, for stitching a first image and a second image, comprising:

a cost calculating unit, calculating, according to pixel values of the first image and the second image in an overlapping area, a plurality of costs respectively corresponding to a plurality of positions in the overlapping area;

a forward regularized cumulative cost calculating unit, calculating, according to the plurality of costs and relative distances between the plurality of positions, a plurality of forward regularized cumulative costs respectively corresponding to the plurality of positions in the overlapping area;

a seam determining unit, determining a seam in the overlapping area according to the plurality of forward regularized cumulative costs; and

a stitching unit, stitching the first image and the second image on the basis of the seam to generate a stitched image.

9. The image stitching device according to claim 8 , wherein a forward regularized cumulative cost of the plurality of forward regularized cumulative costs of a position is associated with a distance component between the position and an adjacent position.

10. The image stitching device according to claim 8 , wherein the seam determining unit determines the seam in the overlapping area according to the plurality of forward regularized cumulative costs by:

determining a stitching position of the seam according to one line of forward regularized cumulative costs;

calculating one line of backward regularized cumulative costs according to the stitching position;

determining a smallest backward regularized cumulative cost from the line of backward regularized cumulative costs; and

selecting a position corresponding to the smallest backward regularized cumulative cost as a next stitching position of the seam.

11. The image stitching device according to claim 8 , further comprising:

a recording unit, recording a plurality of source positions of the plurality of forward regularized cumulative costs.

12. The image stitching device according to claim 9 , wherein the forward regularized cumulative cost of the position comprises a square of the distance component between the position and the adjacent position.

13. The image stitching device according to claim 9 , wherein the forward regularized cumulative cost of the position comprises an absolute value of the distance component between the position and the adjacent position.

14. The image stitching device according to claim 11 , wherein the seam determining unit determines the seam in the overlapping area according to the plurality of forward regularized cumulative costs by:

determining a stitching position of the seam according to one line of forward regularized cumulative costs; and

selecting a source position corresponding to the stitching position as a next stitching position of the seam.

Assignments (4)
CHANGE OF NAME Recorded Oct 25, 2021
From: XIAMEN SIGMASTAR TECHNOLOGY LTD.
To: SIGMASTAR TECHNOLOGY LTD.
Reel/Frame 057889/0055 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 12, 2019
From: SIGMASTAR TECHNOLOGY CORP.
To: XIAMEN SIGMASTAR TECHNOLOGY LTD
Reel/Frame 049734/0308 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 4, 2018
From: MSTAR SEMICONDUCTOR, INC.
To: SIGMASTAR TECHNOLOGY CORP.
Reel/Frame 047666/0320 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 7, 2018
From: HUANG, REN-YOU
To: MSTAR SEMICONDUCTOR, INC.
Reel/Frame 046570/0359 →