IP Library › Granted Patent US 12,731,272
Granted Patent B2
US 12,731,272 · App. 18/901,317 · Granted Sep 8, 2026

Three-dimensional stabilized 360-degree composite image capture

Inventors: Bruno Francois (Atlanta, GA); Grant Schindler (Atlanta, GA)
Assignee: Carvana, LLC
G06T7/33G06F3/0484G06T3/4007G06T7/246G06V10/40G06V10/48G06V20/56H04N23/62H04N23/68H04N23/698H04N25/41G06T2200/32G06T2207/30244
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,731,272
App. No.
18/901,317
Filed
Sep 30, 2024
Granted
Sep 8, 2026
Kind
B2
Art Unit
2482
USPC
348/218.1
Abstract

The system may determine a direction of gravity in each image of a sequence of images around an object; estimate a center of mass of the object in each image of the sequence of images using the direction of gravity and dimensions of the object; stabilize each image in the sequence of images using the center of mass; and generate a 360 degree display of the object using each image in the stabilized sequence of images.

Claims (49)

1 . A system comprising:

one or more processors; and

one or more memories coupled to the one or more processors and including instructions that, when executed by the one or more processors, cause the one or more processors to:

fit one or more planes using a set of camera positions for a surround image of a vehicle;

determine a direction of gravity using the one or more planes; and

stabilize one or more images in the surround image of the vehicle using the direction of gravity.

2 . The system of claim 1 , wherein the instructions further cause the one or more processors to:

receive a selection of a feature on the surround image of the vehicle; and

in response to the receiving the selection, rotate the surround image of the vehicle around the feature.

3 . The system of claim 2 , wherein the surround image of the vehicle is rotated about an axis of rotation extending parallel to the direction of gravity.

4 . The system of claim 1 , wherein the stabilizing the one or more images comprises aligning one or more feature points across two or more images of the surround image.

5 . The system of claim 1 further comprising:

a camera coupled to the one or more processors, wherein the camera is configured to capture the one or more images in the surround image; and

a gyroscope sensor coupled to the one or more processors, wherein the gyroscope sensor is configured to provide signals corresponding to the direction of gravity.

6 . The system of claim 1 , wherein the determine the direction of gravity comprises:

generate one or more normal vectors for the one or more planes; and

set at least one of the one or more normal vectors as the direction of gravity.

7 . The system of claim 1 , wherein the surround image of the vehicle comprises a 360 degree composite image.

8 . A method comprising:

fitting, using one or more processors, one or more planes using a set of camera positions for a surround image of a vehicle;

determining, using the one or more processors, a direction of gravity using the one or more planes; and

stabilizing, using the one or more processors, one or more images in the surround image of the vehicle using the direction of gravity.

9 . The method of claim 8 further comprising:

receiving a selection of a feature on the surround image of the vehicle; and

in response to the receiving the selection, rotating the surround image of the vehicle around the feature.

10 . The method of claim 9 , wherein the surround image of the vehicle is rotated about an axis of rotation extending parallel to the direction of gravity.

11 . The method of claim 8 , wherein stabilizing the one or more images comprises aligning one or more feature points across two or more images of the surround image.

12 . The method of claim 8 further comprising:

capturing the one or more images using a camera coupled to the one or more processors; and

receiving signals corresponding to the direction of gravity from a gyroscope sensor.

13 . The method of claim 8 , wherein the determining the direction of gravity comprises:

generating one or more normal vectors for the one or more planes; and

setting at least one of the one or more normal vectors as the direction of gravity.

14 . The method of claim 8 , wherein the surround image of the vehicle comprises a 360 degree composite image.

15 . An article of manufacture including one or more non-transitory, tangible computer readable storage mediums having instructions stored thereon that, in response to execution by one or more processors, cause the one or more processors to perform operations comprising:

fitting one or more planes using a set of camera positions for a surround image of a vehicle;

determining a direction of gravity using the one or more planes; and

stabilizing one or more images in the surround image of the vehicle using the direction of gravity.

16 . The article of manufacture of claim 15 , wherein the operations further comprise:

receiving a selection of a feature on the surround image of the vehicle; and

in response to the receiving the selection, rotating the surround image of the vehicle around the feature.

17 . The article of manufacture of claim 16 , wherein the surround image of the vehicle is rotated about an axis of rotation extending parallel to the direction of gravity.

18 . The article of manufacture of claim 15 , wherein the stabilizing the one or more images comprises aligning one or more feature points across two or more images of the surround image.

19 . The article of manufacture of claim 15 , wherein the operations further comprise:

capturing the one or more images using a camera coupled to the one or more processors; and

receiving signals corresponding to the direction of gravity from a gyroscope sensor.

20 . The article of manufacture of claim 15 , wherein the determining the direction of gravity comprises:

generating one or more normal vectors for the one or more planes; and

setting at least one of the one or more normal vectors as the direction of gravity.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 30, 2024
From: FRANCOIS, BRUNO; SCHINDLER, GRANT
To: CAR360 INC.
Reel/Frame 068737/0557 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 30, 2024
From: CAR360, INC.
To: CARVANA, LLC
Reel/Frame 068737/0622 →
Continuity (7)
Continuation 18126972 · Mar 27, 2023
Continuation 17403064 · Aug 16, 2021
Continuation 16404335 · May 6, 2019
Continuation 15711055 · Sep 21, 2017
Continuation In Part 14947842 · Nov 20, 2015
Provisional Application 62100546 · Jan 7, 2015
Related Publication 20250022150A1 · Jan 16, 2025
References Cited (91)
US 5694533A · Richards et al. · 1997 [cited by applicant]
US 5973733A · Gove · 1999 [cited by applicant]
US 6901384B2 · Lynch et al. · 2005 [cited by applicant]
US 6950807B2 · Brock · 2005 [cited by applicant]
US 7119837B2 · Soupliotis et al. · 2006 [cited by applicant]
US 7149345B2 · Fujiwara · 2006 [cited by applicant]
US 7272255B2 · Ishiyama · 2007 [cited by applicant]
US 7394977B2 · Park et al. · 2008 [cited by applicant]
US 7433497B2 · Chen · 2008 [cited by applicant]
US 7548236B2 · Ikezawa · 2009 [cited by applicant]
US 7548659B2 · Ofek et al. · 2009 [cited by applicant]
US 7557832B2 · Lindenstruth et al. · 2009 [cited by applicant]
US 7558405B2 · Tico et al. · 2009 [cited by applicant]
US 7605845B2 · Batur · 2009 [cited by applicant]
US 7705885B2 · Prieto et al. · 2010 [cited by applicant]
US 7817181B2 · Lee · 2010 [cited by applicant]
US 8054335B2 · Deng et al. · 2011 [cited by applicant]
US 8072496B2 · Antsfeld · 2011 [cited by applicant]
US 8134603B2 · Auberger et al. · 2012 [cited by applicant]
US 8194141B2 · Narasimha et al. · 2012 [cited by applicant]
US 8385732B2 · Zuniga et al. · 2013 [cited by applicant]
US 8488010B2 · Voss et al. · 2013 [cited by applicant]
US 8494058B2 · Chang et al. · 2013 [cited by applicant]
US 8508605B2 · Dolgin et al. · 2013 [cited by applicant]
US 8520084B2 · Tsai et al. · 2013 [cited by applicant]
US 8531535B2 · Kwatra et al. · 2013 [cited by applicant]
US 8553096B2 · Proca et al. · 2013 [cited by applicant]
US 8558903B2 · Liu et al. · 2013 [cited by applicant]
US 8648919B2 · Mantzel et al. · 2014 [cited by applicant]
US 8743222B2 · Hamalainen · 2014 [cited by applicant]
US 8773542B2 · Jiang et al. · 2014 [cited by applicant]
US 8791414B2 · Wang et al. · 2014 [cited by applicant]
US 8797414B2 · Park et al. · 2014 [cited by applicant]
US 8872927B2 · Proca et al. · 2014 [cited by applicant]
US 8890962B2 · Proca et al. · 2014 [cited by applicant]
US 8896713B2 · Corey et al. · 2014 [cited by applicant]
US 8923400B1 · Alvarez et al. · 2014 [cited by applicant]
US 8941743B2 · Petrescu et al. · 2015 [cited by applicant]
US 8947546B2 · Foster et al. · 2015 [cited by applicant]
US 9300871B2 · Zhou et al. · 2016 [cited by applicant]
US 9300873B2 · Zhou et al. · 2016 [cited by applicant]
US 9525821B2 · Chang · 2016 [cited by applicant]
US 9596411B2 · Thivent et al. · 2017 [cited by applicant]
US 9609209B2 · Lee et al. · 2017 [cited by applicant]
US 9998663B1 · François et al. · 2018 [cited by applicant]
US 10192122B2 · Yoshida et al. · 2019 [cited by applicant]
US 10284794B1 · Francois · 2019 [cited by examiner]
US 11095837B2 · Francois · 2021 [cited by examiner]
US 11616919B2 · Francois · 2023 [cited by examiner]
US 12106495B2 · Francois · 2024 [cited by examiner]
US 20020082860A1 · Johnson · 2002 [cited by applicant]
US 20020085219A1 · Ramamoorthy · 2002 [cited by applicant]
US 20020105513A1 · Chen · 2002 [cited by applicant]
US 20070011083A1 · Bird et al. · 2007 [cited by applicant]
US 20070076982A1 · Petrescu · 2007 [cited by applicant]
US 20070171987A1 · Trimeche · 2007 [cited by applicant]
US 20070172216A1 · Lai · 2007 [cited by applicant]
US 20070248167A1 · Park · 2007 [cited by applicant]
US 20080143840A1 · Corkum et al. · 2008 [cited by applicant]
US 20080165280A1 · Deever et al. · 2008 [cited by applicant]
US 20090066800A1 · Wei · 2009 [cited by applicant]
US 20090140887A1 · Breed et al. · 2009 [cited by applicant]
US 20090160930A1 · Ruppert · 2009 [cited by applicant]
US 20090167844A1 · Seki et al. · 2009 [cited by applicant]
US 20090169052A1 · Seki et al. · 2009 [cited by applicant]
US 20100046624A1 · Archibald et al. · 2010 [cited by applicant]
US 20100208086A1 · Kothandaraman et al. · 2010 [cited by applicant]
US 20130033612A1 · Wu et al. · 2013 [cited by applicant]
US 20130215264A1 · Soatto et al. · 2013 [cited by applicant]
US 20130307937A1 · Kim · 2013 [cited by applicant]
US 20130335409A1 · Yamamoto · 2013 [cited by applicant]
US 20130335490A1 · Nagao et al. · 2013 [cited by applicant]
US 20140037136A1 · Ramalingam et al. · 2014 [cited by applicant]
US 20140198852A1 · Incesu et al. · 2014 [cited by applicant]
US 20140201126A1 · Zadeh et al. · 2014 [cited by applicant]
US 20140232748A1 · Kis et al. · 2014 [cited by applicant]
US 20150022677A1 · Guo et al. · 2015 [cited by applicant]
US 20150084951A1 · Boivin et al. · 2015 [cited by applicant]
US 20160028967A1 · Sezer et al. · 2016 [cited by applicant]
US 20160088287A1 · Sadi et al. · 2016 [cited by applicant]
US 20160127641A1 · Gove · 2016 [cited by applicant]
US 20160328827A1 · Ilic et al. · 2016 [cited by applicant]
US 20200082504A1 · Saporta et al. · 2020 [cited by applicant]
JP 2006224927A · 2006 [cited by applicant]
JP 4971615B2 · 2012 [cited by applicant]
WO 2005084405A2 · 2005 [cited by applicant]
In Re Venner et al., No. 6391, LexisNexis; United States Court of Customs and Patent Appeals; Oral argument Nov. 7, 1958, Dec. 19, 1958. [cited by applicant]
Credit Acceptance Corp, Guaranteed Credit Approval, Auto Loan; http://www.insider-car-buying-tips.com/credit_acceptance_corp.html; accessed Dec. 17, 2013. [cited by applicant]
Auto Success; Credit Acceptance's Upgraded Credit Approval Processing System Simplifies Approval Process; vol. 1 Issue 33; http://www.imakenews.com/autosuccess/e_article001075242.cfm?x=bgB6V1j,b7jJcq29,w; accessed Dec. … [cited by applicant]
Credit Acceptance Corp (CACC.OQ) Company Profile I Reuters.com; http://www.reuters.com/finance/stocks/companyProfile?symbol=CACC.OQ; accessed Dec. 17, 2013. [cited by applicant]
Credit Acceptance Corporation—Annual Report; United States Securities and Exchange Commission; Washington D.C. 20549; Form 10-K; Annual Report Pursuant to Section 13 or 15(d) of the Securities Exchange Act of 1934. http… [cited by applicant]