IP Library Granted Patent US 10,089,954
Granted Patent B2
US 10,089,954 · App. 15/659,449 · Granted Oct 2, 2018

Method for combined transformation of the scale and aspect ratio of a picture

Inventor: Marina Nicolas (Voreppe, FR)
Assignee: STMICROELECTRONICS (GRENOBLE 2) SAS
G09G5/005G06T3/0012G06T3/40G09G2340/0442
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,089,954
App. No.
15/659,449
Granted
Oct 2, 2018
Kind
B2
Abstract

A source image is transformed into a destination image having a target aspect ratio. A reference region in the source image is defined. An extended region of interest of the source image having the target aspect ratio and containing the reference region is defined. A set of candidate image regions of increasing resolutions from the extended region of interest is determined, each having the target aspect ratio and containing the reference region. Candidate image regions are scaled to form a candidate target images. A quality metric is used to select a target image providing the best quality metric value.

Claims (66)

1. A method, comprising:

determining a reference region of a source image;

determining an extended region of interest of the source image, the extended region of interest having a target aspect ratio and containing the reference region;

determining a set of candidate image regions including regions of increasing size from the extended region of interest, the set of candidate image regions comprising a plurality of candidate image regions, each candidate image region of the plurality of candidate image regions having the target aspect ratio and containing the reference region;

scaling candidate image regions to form a set of candidate target images, the set of candidate target regions comprising a plurality of candidate target regions;

determining quality metric values of images of the set of candidate target images;

comparing the determined quality metric values of the images of the set of candidate target images; and

selecting one of the candidate target images of the set of candidate target images as a target image based on the comparing.

2. The method of claim 1 , comprising using a region-of-interest search algorithm to determine the reference region.

3. The method of claim 1 , comprising:

storing a list of unfavorable scaling factors; and

excluding candidate regions producing any of the unfavorable scaling factors from the set of candidate target images.

4. The method of claim 1 , comprising:

determining a default quality metric value for each candidate target image of the set of candidate target images; and

when the determined default quality metric values do not satisfy an image quality criteria, calculating a second quality metric value for each candidate target image of the set of candidate target images.

5. The method of claim 4 wherein the default quality metric is a blur metric based only on a candidate target image, and the second quality metric is a structural similarity factor based on a candidate image region and a corresponding candidate target image.

6. The method of claim 1 wherein the quality metric is a blur metric based only on a candidate target image.

7. The method of claim 1 wherein the quality metric is a structural similarity factor (SSIM) based on a candidate image region and corresponding candidate target image.

8. The method of claim 1 wherein the set of candidate image regions includes the extended region of interest.

9. The method of claim 1 wherein the reference region includes a plurality of regions of interest.

10. The method of claim 1 wherein the determining quality metric values of images of the set of candidate target images includes determining a plurality of quality metric values for images of the set of candidate target images.

11. A device, comprising:

one or more memories; and

image processing circuitry coupled to the one or more memories, wherein the image processing circuitry, in operation,

determines an extended region of interest of a source image, the extended region of interest having a target aspect ratio and containing a reference region of the source image;

determines a set of candidate image regions of the source images, the set of candidate image regions including regions of increasing size from the extended region of interest, the set of candidate image regions comprising a plurality of candidate image regions, each candidate image region of the plurality of candidate image regions having the target aspect ratio and containing the reference region;

scales candidate image regions to form a set of candidate target images, the set of candidate target regions comprising a plurality of candidate target regions;

determines quality metric values of images of the set of candidate target images;

compares the determined quality metric values of the images of the set of candidate target images; and

selects one of the candidate target images of the set of candidate target images as a target image based on the comparing.

12. The device of claim 11 wherein the image processing circuitry, in operation, determines the reference region using a region of interest search algorithm.

13. The device of claim 11 wherein, in operation,

the one or more memories store a list of unfavorable scaling factors; and

candidate regions producing any of the unfavorable scaling factors are excluded from the set of candidate target images.

14. The device of claim 11 wherein, in operation, the image processing circuitry:

determines a default quality metric value for each candidate target image of the set of candidate target images; and

when the determined default quality metric values do not satisfy an image quality criteria, determines a second quality metric value for each candidate target image of the set of candidate target images.

15. The device of claim 14 wherein the default quality metric is a blur metric based only on a candidate target image, and the second quality metric is a structural similarity factor based on a candidate image region and a corresponding candidate target image.

16. The device of claim 11 wherein the quality metric is a blur metric based only on a candidate target image.

17. The device of claim 11 wherein the quality metric is a structural similarity factor (SSIM) based on a candidate image region and corresponding candidate target image.

18. The device of claim 11 wherein the set of candidate image regions includes the extended region of interest.

19. The device of claim 11 wherein the reference region includes a plurality of regions of interest.

20. A system, comprising:

means for determining an extended region of interest of a source image, the extended region of interest having a target aspect ratio and containing a reference region of the source image;

means for determining a set of candidate image regions of the source images, the set of candidate image regions including regions of increasing size from the extended region of interest, the set of candidate image regions comprising a plurality of candidate image regions, each candidate image region of the plurality of candidate image regions having the target aspect ratio and containing the reference region;

means for scaling candidate image regions to form a set of candidate target images, the set of candidate target regions comprising a plurality of candidate target regions;

means for determining quality metric values of images of the set of candidate target images;

means for comparing the determined quality metrix values of the images of the set of candidate target images; and

means for selecting one of the candidate target images of the set of candidate target images as a target image based on the comparing.

21. The system of claim 20 , comprising:

means for determining the reference region.

22. The system of claim 20 , comprising:

means for excluding candidate target regions having one of a set of scaling factors from the set of candidate target images.

23. The system of claim 20 , comprising:

means for selecting a quality metric.

24. A non-transitory computer-readable medium whose contents cause a computing device to perform a method, the method comprising:

determining an extended region of interest of a source image, the extended region of interest having a target aspect ratio and containing a reference region;

determining a set of candidate image regions including regions of increasing size from the extended region of interest, the set of candidate image regions comprising a plurality of candidate image regions, each candidate image region of the plurality of candidate image regions having the target aspect ratio and containing the reference region;

scaling candidate image regions to form a set of candidate target images, the set of candidate target regions comprising a plurality of candidate target regions;

determining quality metric values of images of the set of candidate target images;

comparing the determined quality metric values of the images of the set of candidate target images; and

selecting one of the candidate target images of the set of candidate target images as a target image based on the comparing.

25. The medium of claim 24 wherein the method comprises using a region-of-interest search algorithm to determine the reference region.

26. The medium of claim 24 wherein the method comprises:

determining a default quality metric value for each candidate target image of the set of candidate target images; and

when the determined default quality metric values do not satisfy an image quality criteria, calculating a second quality metric value for each candidate target image of the set of candidate target images.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2022
From: STMICROELECTRONICS (GRENOBLE 2) SAS
To: STMICROELECTRONICS INTERNATIONAL N.V.
Reel/Frame 060475/0759 →
Priority Claims (1)
FR 1400239 · Jan 29, 2014 · national
Continuity (2)
Continuation 14607523 · Jan 28, 2015
Related Publication 20170337896A1 · Nov 23, 2017