IP Library › Granted Patent US 12,322,035
Granted Patent B2
US 12,322,035 · App. 17/963,935 · Granted Jun 3, 2025

Three-dimensional perspective correction

Inventor: Rodrigo Belfiore (Buenos Aires, AR)
Assignee: Scale AI, Inc.
G06T15/205G06T7/50G06T7/62G06T7/70G06T19/20G06T2200/24G06T2207/20092G06T2210/12G06T2219/2016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,322,035
App. No.
17/963,935
Granted
Jun 3, 2025
Kind
B2
Abstract

Embodiments of the present disclosure set forth techniques for three-dimensional perspective correction, where the techniques include receiving a first image that depicts an object from a first perspective along a first axis; determining a location of the object along the first axis; determining, based on the first image and the location of the object along the first axis, at least one dimension of the object; and adjusting, based on the at least one dimension of the object, a second image that depicts the object from a second perspective along a second axis. In some embodiments, adjusting the second image comprises skewing at least a portion of the second image to depict the object from a third perspective along a third axis.

Claims (49)

1. A computer-implemented method, comprising:

receiving a first image that depicts an object from a first perspective along a first axis;

determining a location of the object along the first axis;

determining, based on the first image and the location of the object along the first axis, at least one logical dimension of the object;

receiving a second image that depicts the object from a second perspective along a second axis;

generating a movable bounding shape within the second image based on the location of the object along the first axis and the at least one logical dimension;

receiving one or more modifications to a location of the movable bounding shape within the second image;

determining, based on the first image, the location of the object along the first axis, and the one or more modifications, at least one dimension of the object; and

performing, based on at least one dimension of the object, one or more perspective adjustment operations on a third image that depicts the object from a third perspective.

2. The computer-implemented method of claim 1 , wherein determining the location of the object comprises determining at least one dimension of a bounding shape of the object in the first image.

3. The computer-implemented method of claim 2 , further comprising:

displaying at least one candidate bounding shape of the object in the first image, wherein each candidate bounding shape is based on a different location of the object along an axis; and

receiving user input that indicates a candidate bounding shape of the object, wherein the location of the object is determined based on the candidate bounding shape indicated by the user input.

4. The computer-implemented method of claim 2 , further comprising:

receiving user input that indicates the location of the object along the first axis; and

displaying a bounding shape of the object within the first image based on the location of the object along the first axis.

5. The computer-implemented method of claim 1 , further comprising determining a location of the object in the third image based on a plane that includes the object in the first image.

6. The computer-implemented method of claim 1 , wherein a first perspective adjustment operation comprises adjusting a size of the object in the third image based on the at least one dimension of the object and a location of the object along a third axis.

7. The computer-implemented method of claim 1 , wherein a first perspective adjustment operation comprises skewing at least a portion of the third image to depict the object from a fourth perspective along a third axis.

8. One or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of:

receiving a first image that depicts an object from a first perspective along a first axis;

determining a location of the object along the first axis;

determining, based on the first image and the location of the object along the first axis, at least one logical dimension of the object;

receiving a second image that depicts the object from a second perspective along a second axis;

generating a movable bounding shape within the second image based on the location of the object along the first axis and the at least one logical dimension;

receiving one or more modifications to a location of the movable bounding shape within the second image;

determining, based on the first image, the location of the object along the first axis, and the one or more modifications, at least one dimension of the object; and

performing, based on at least one dimension of the object, one or more perspective adjustment operations on a third image that depicts the object from a third perspective.

9. The one or more non-transitory computer-readable media of claim 8 , wherein determining the location of the object comprises determining at least one dimension of a bounding shape of the object in the first image.

10. The one or more non-transitory computer-readable media of claim 9 , further comprising:

displaying at least one candidate bounding shape of the object in the first image, wherein each candidate bounding shape is based on a different location of the object along an axis; and

receiving user input that indicates a selected candidate bounding shape of the object, wherein the location of the object is determined based on the selected candidate bounding shape.

11. The one or more non-transitory computer-readable media of claim 9 , further comprising:

receiving user input that indicates the location of the object along the first axis; and

displaying a bounding shape of the object within the first image based on the location of the object along the first axis.

12. The one or more non-transitory computer-readable media of claim 8 , wherein a first perspective adjustment operation comprises adjusting a size of the object in the third image based on the at least one dimension of the object and a location of the object along a third axis.

13. The one or more non-transitory computer-readable media of claim 8 , wherein a first perspective adjustment operation comprises skewing at least a portion of the third image to depict the object from a third perspective along a third axis.

14. A system, comprising:

a memory that stores instructions, and

a processor that is coupled to the memory and, when executing the instructions, is configured to perform the steps of:

receiving a first image that depicts an object from a first perspective along a first axis;

determining a location of the object along the first axis;

determining, based on the first image and the location of the object along the first axis, at least one logical dimension of the object;

receiving a second image that depicts the object from a second perspective along a second axis;

generating a movable bounding shape within the second image based on the location of the object along the first axis and the at least one logical dimension;

receiving one or more modifications to a location of the movable bounding shape within the second image;

determining, based on the first image, the location of the object along the first axis, and the one or more modifications, at least one dimension of the object; and

performing, based on at least one dimension of the object, one or more perspective adjustment operations on a third image that depicts the object from a third perspective.

15. The system of claim 14 , wherein a first perspective adjustment operation comprises skewing at least a portion of the third image to depict the object from the third perspective along a third axis.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 14, 2023
From: BELFIORE, RODRIGO
To: SCALE AI, INC.
Reel/Frame 062982/0263 →
Continuity (1)
Related Publication 20240119661A1 · Apr 11, 2024
References Cited (8)
US 10936902B1 · Bagwell et al. · 2021 [cited by applicant]
US 20120328196A1 · Kasahara et al. · 2012 [cited by applicant]
US 20150178943A1 · Li · 2015 [cited by examiner]
US 20160012611A1 · Wexler et al. · 2016 [cited by applicant]
US 20180113596A1 · Ptak · 2018 [cited by examiner]
US 20210314551A1 · Tang et al. · 2021 [cited by applicant]
International Search Report for Application No. PCT/US2023/34848 dated Jan. 11, 2024. [cited by applicant]
International Preliminary Report on Patentability, PCT/US2023/034848, The International Bureau of WIPO, dated Apr. 24, 2025, 7 pages. [cited by applicant]