IP Library › Granted Patent US 12,666,163
Granted Patent B2
US 12,666,163 · App. 18/676,299 · Granted Jun 23, 2026

Automated room-specific white balance correction in a building image with visual data showing multiple rooms

Inventors: Zhiqiang Wan (Lynnwood, WA); Jasmine Jayant Bhanushali (Bothell, WA); Haithem Albadawi (Redmond, WA)
Assignee: MFTB Holdco, Inc.
H04N23/88H04N23/61H04N23/698H04N23/71H04N23/76
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,666,163
App. No.
18/676,299
Filed
May 28, 2024
Granted
Jun 23, 2026
Kind
B2
Art Unit
2485
USPC
348/36
Abstract

Techniques are described for using computing devices to perform automated operations involving, for an image acquired at a building and having visual data that shows portions of multiple separate rooms or other spatial regions at the building, automatically analyzing and manipulating visual data of the image to perform white balancing corrections separately for different parts of the image corresponding to the different spatial regions, such as to separately correct for different illumination levels in the different spatial regions. The described techniques may further include using one or more resulting modified images with white balancing corrections in one or more further automated manners, such as to determine one or more types of building information (e.g., a building floor plan) for an as-built multi-room building, and optionally further using the determined building information to provide navigational data for the building.

Claims (42)

1 . A computer-implemented method comprising:

capturing, by a camera device positioned in a first room of a house, a panorama image with a plurality of color pixels having visual data that shows at least a first portion of the first room and at least a second portion of each of one or more second rooms of the house, wherein the first room is separated from the one or more second rooms by one or more inter-room passages that are visible in the visual data and that each is a doorway or a non-doorway wall opening, wherein the at least second portion of each of the one or more second rooms is visible through a respective one of the one or more inter-room passages, wherein each color pixel has multiple color values associated with respective red and green and blue color channels, and wherein each of the first and second rooms has a different illumination source at a time of the capturing;

generating, by one or more computing devices, a modified version of the panorama image with white balance corrections applied separately for different parts of the panorama image corresponding to each of the first and second rooms, including:

analyzing, by the one or more computing devices, the visual data of the panorama image to identify multiple groups of pixels including a first group of pixels associated with the first room and showing the at least portion of the first room, and further including one or more second groups of pixels each associated with a respective one of the one or more second rooms and showing the at least portion of that second room, wherein identifying of the multiple groups of pixels includes identifying each of the one or more inter-room passages in the visual data, and selecting pixels within each identified inter-room passage as one of the one or more second groups of pixels;

determining, by the one or more computing devices and for each of the multiple groups of pixels, a neutral pixel of that group having differences between the multiple color values of the neutral pixel that are below a defined threshold, wherein the determining includes identifying a horizontal midline of the panorama image and selecting the neutral pixel for each of the multiple groups of pixels from above the horizontal midline; and

producing, by the one or more computing devices, the modified version of the panorama image by performing white balance corrections that include, for each of the multiple groups of pixels and using the determined neutral pixel for that group, performing chromatic adjustments on at least some pixels in that group to correspond to the illumination source for the room with which the group is associated by adjusting the red and green and blue channel values for each of the at least some pixels to reflect the differences between the multiple color values of that determined neutral pixel for that group, wherein first chromatic adjustments performed for the first group of pixels associated with the first room are different from each second chromatic adjustment performed for one of the one or more second groups of pixels associated with a respective one second room of the one or more second rooms; and

presenting, by the one or more computing devices, the generated modified version of the panorama image in a displayed graphical user interface.

2 . A computer-implemented method comprising:

obtaining, by one or more computing devices, a panorama image captured by a camera at a building and having visual data from a plurality of color pixels that show at least a portion of each of multiple rooms of the building, wherein each color pixel has multiple color values for multiple respective color channels, wherein the multiple rooms have different levels of illumination at a time of capturing the panorama image, and wherein the multiple rooms are separated by one or more inter-room passages that each includes a doorway or a non-doorway wall opening;

analyzing, by the one or more computing devices, the visual data of the panorama image to identify multiple groups of pixels each associated with a respective one of the multiple rooms and showing the at least portion of that room, the analyzing including identifying and using at least some of each of the one or more inter-room passages that is visible in the visual data;

determining, by the one or more computing devices and for each of the multiple groups of pixels, one or more neutral pixels of that group each having differences between the multiple color values of that neutral pixel below a defined threshold;

generating, by the one or more computing devices, a modified panorama image by performing white balance corrections that include, for each of the multiple groups of pixels, using the determined one or more neutral pixels for that group to perform chromatic adjustments on at least some pixels in that group to correct for the level of illumination in the room with which the group is associated by using the differences between the multiple color values of each of those one or more neutral pixels, wherein first chromatic adjustments performed for a first group of pixels associated with a first room of the multiple rooms are different from second chromatic adjustments performed for a second group of pixels associated with a second room of the multiple rooms; and

providing, by the one or more computing devices, the generated modified panorama image for display.

3 . The computer-implemented method of claim 2 wherein the analyzing of the visual data of the panorama image includes identifying a horizontal midline of the panorama image, and wherein the determining of the one or more neutral pixels of each of the multiple groups of pixels includes selecting the one or more neutral pixels for that group from above the horizontal midline.

4 . A system comprising:

one or more hardware processors of one or more computing devices; and

one or more memories with stored instructions that, when executed by at least one of the one or more hardware processors, cause at least one computing device of the one or more computing devices to perform automated operations including at least:

obtaining an image captured by a camera at a building and having a plurality of color pixels with visual data showing at least a portion of each of multiple rooms of the building, wherein each color pixel has multiple color values associated with multiple respective color channels, and wherein the multiple rooms are separated by one or more inter-room passages that each includes a doorway or a non-doorway wall opening;

analyzing the visual data of the image to identify multiple groups of pixels each associated with a respective one of the multiple rooms and showing the at least portion of that room, the analyzing being based on at least some of each of the one or more inter-room passages that is visible in the visual data;

determining, for each of the multiple groups of pixels, a neutral pixel of that group;

generating a modified image by performing white balance corrections that include, for each of the multiple groups of pixels, using the determined neutral pixel for that group to perform chromatic adjustments on at least some pixels in that group by adjusting the multiple color values of each of the at least some pixels using differences between the multiple color values of the neutral pixel, wherein first chromatic adjustments performed for a first group of pixels associated with a first room of the multiple rooms are different from second chromatic adjustments performed for a second group of pixels associated with a second room of the multiple rooms; and

providing the generated modified image.

5 . The system of claim 4 wherein the image is a panorama image having 360 degrees of horizonal visual coverage around a vertical axis, wherein the determining of the neutral pixel for each of the multiple groups of pixels includes determining one or more neutral pixels for each group based at least in part on differences between the multiple color values of each of the one or more neutral pixels being below a defined threshold, and wherein the analyzing of the visual data includes identifying each of the one or more inter-room passages in the visual data of the panorama image, and includes selecting, for each of the identified one or more inter-room passages, pixels within that identified inter-room passage in the visual data to be one of the multiple groups of pixels.

6 . A non-transitory computer-readable medium having stored contents that cause one or more computing devices to perform automated operations, the automated operations including at least:

obtaining, by the one or more computing devices, a panorama image captured by a camera at a building and having a plurality of color pixels with visual data that shows at least a portion of each of multiple spatial regions at the building separated by one or more inter-region separators, wherein each color pixel has multiple color values associated with multiple respective color channels;

analyzing, by the one or more computing devices, the visual data of the panorama image to identify multiple groups of pixels each associated with a respective one of the multiple spatial regions and showing the at least portion of that spatial region, the analyzing being based on at least some of each of the one or more inter-region separators that is visible in the visual data;

determining, by the one or more computing devices and for each of the multiple groups of pixels, a neutral pixel of that group;

generating, by the one or more computing devices, a modified panorama image by performing white balance corrections that include, for each of the multiple groups of pixels, using the determined neutral pixel for that group to perform chromatic adjustments on of at least some pixels in that group by adjusting the multiple color values of each of the at least some pixels using differences between the multiple color values of the neutral pixel, wherein first chromatic adjustments performed for a first group of pixels associated with a first spatial region of the multiple spatial regions are different from second chromatic adjustments performed for a second group of pixels associated with a second spatial region of the multiple spatial regions; and

providing, by the one or more computing devices, the generated modified panorama image.

7 . The non-transitory computer-readable medium of claim 6 wherein the multiple spatial regions are each a respective one of multiple rooms of the building, wherein the one or more inter-region separators are one or more inter-room passages that each includes a doorway or a non-doorway wall opening, and wherein the analyzing of the visual data includes identifying each of the one or more inter-room passages in the visual data of the panorama image, and includes selecting, for each of the identified one or more inter-room passages, pixels within that identified inter-room passage in the visual data to be one of the multiple groups of pixels.

8 . The non-transitory computer-readable medium of claim 6 wherein the multiple spatial regions are each a separate exterior area outside of the building and having different illumination levels at a time of capturing the panorama image, and wherein the one or more inter-region separators are each a passage between at least two spatial regions of the multiple spatial regions.

9 . The non-transitory computer-readable medium of claim 6 wherein the multiple spatial regions are each a respective subset of a room of the building having different illumination sources at a time of capturing the panorama image, and wherein the one or more inter-region separators are each a visual separator between at least two spatial regions of the multiple spatial regions.

10 . The computer-implemented method of claim 2 wherein the analyzing of the visual data of the panorama image includes identifying a horizontal midline of the panorama image, wherein the determining of the one or more neutral pixels of each of the multiple groups of pixels includes selecting the one or more neutral pixels for that group from above the horizontal midline, and wherein the method further comprises at least one of:

presenting, by the one or more computing devices and using a plurality of panorama images captured in a plurality of rooms of the indicated building, a generated floor plan of the building that includes room shapes of the plurality of rooms positioned relative to each other and having at least relative sizes, including modifying the plurality of panorama images to include white balance corrections, and including analyzing visual data of the modified plurality of panorama images to identify multiple visible doorways and to determine the room shapes of the plurality of rooms, and including generating the floor plan using the analyzed visual data, wherein the plurality of rooms include the multiple rooms and include one or more other rooms; or

filtering, by the one or more computing devices and before the generating of the modified version of the panorama image by performing the white balance corrections, some pixels of the panorama image that are in a CIE XYZ color space format and that have saturated color based at least in part on the multiple color values of that pixel being above a second defined threshold, wherein the panorama image is captured in the CIE XYZ color space format and is converted by the camera to a standard RGB (red-green-blue) color space format using non-linear processing, and wherein the method further comprises reverting, before the filtering, the panorama image to the CIE XYZ color space format; or

performing, by the one or more computing devices, the white balance corrections for each of the multiple groups of pixels by correcting for the level of illumination in the room with which the group is associated using a gray world analysis based on the color pixels in that group having an average color that is substantially a neutral gray; or

performing, by the one or more computing devices, the white balance corrections for each of the multiple groups of pixels by correcting for the level of illumination in the room with which the group is associated using a white patch analysis by selecting the one or more neutral pixels for that group using a lightest patch of pixels in that group; or

performing, by the one or more computing devices, the analyzing of the visual data of the panorama image and the white balance corrections for each of the multiple groups of pixels using a raw image format in which an original version of the panorama image is captured, and converting the panorama image in the raw image format after the performing of the white balance corrections to a standard RGB (red-green-blue) format that is used for displaying the generated modified panorama image as part of the providing of the generated modified panorama image for display; or

performing, by the one or more computing devices, the analyzing of the visual data of the panorama image by identifying a subset of the plurality of color pixels representing one or more ceilings of the building, and selecting the one or more neutral pixels for each of the multiple groups of pixels from the subset of the plurality of color pixels as part of the determining of the one or more neutral pixels for that group of pixels; or

performing, by the one or more computing devices and based at least in part on the visual data further showing at least a portion of an exterior region that is outside of the building and has a level of illumination separate from the different levels of illumination for the multiple rooms and that is separated from the building by at least one interior-exterior separator, the generating of the modified panorama image by using, for an additional group of pixels that are associated with the exterior region and that show the at least portion of the exterior region and that are identified based at least in part on at least some of the interior-exterior separator that is visible in the visual data, one or more additional determined neutral pixels for the additional group of pixels to perform further chromatic adjustments on at least some pixels in the additional group by adjusting the multiple color values of each of the at least some pixels using differences between the multiple color values for the determined one or more additional neutral pixels; or

determining, by the one or more computing devices and for identified pixels of the panorama image that are above a horizon line in the panorama image and that each has a value for a blue color channel above a defined blue threshold and values for red and green color channels below one or more other defined other thresholds, that the panorama image is an interior panorama image based at least in part on an amount of those identified pixels being below a defined quantity threshold; or

performing, by the one or more computing devices, the providing of the generated modified panorama image for display by transmitting the generated modified panorama image over one or more computer networks to a client device for display on the client device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 28, 2024
From: WAN, ZHIQIANG; BHANUSHALI, JASMINE JAYANT; ALBADAWI, HAITHEM
To: MFTB HOLDCO, INC.
Reel/Frame 067544/0094 →
Continuity (1)
Related Publication 20250373952A1 · Dec 4, 2025
References Cited (304)
US 5140352A · Moore et al. · 1992 [cited by applicant]
US 6031540A · Golin et al. · 2000 [cited by applicant]
US 6141034A · McCutchen · 2000 [cited by applicant]
US 6317166B1 · McCutchen · 2001 [cited by applicant]
US 6320584B1 · Golin et al. · 2001 [cited by applicant]
US 6323858B1 · Gilbert et al. · 2001 [cited by applicant]
US 6337683B1 · Gilbert et al. · 2002 [cited by applicant]
US 6654019B2 · Gilbert et al. · 2003 [cited by applicant]
US 6683608B2 · Golin et al. · 2004 [cited by applicant]
US 6690374B2 · Park et al. · 2004 [cited by applicant]
US 6731305B1 · Park et al. · 2004 [cited by applicant]
US 6738073B2 · Park et al. · 2004 [cited by applicant]
US 7050085B1 · Park et al. · 2006 [cited by applicant]
US 7129971B2 · McCutchen · 2006 [cited by applicant]
US 7196722B2 · White et al. · 2007 [cited by applicant]
US 7525567B2 · McCutchen · 2009 [cited by applicant]
US 7620909B2 · Park et al. · 2009 [cited by applicant]
US 7627235B2 · McCutchen et al. · 2009 [cited by applicant]
US 7782319B2 · Ghosh et al. · 2010 [cited by applicant]
US 7791638B2 · McCutchen · 2010 [cited by applicant]
US 7909241B2 · Stone et al. · 2011 [cited by applicant]
US 7973838B2 · McCutchen · 2011 [cited by applicant]
US 8072455B2 · Temesvari et al. · 2011 [cited by applicant]
US 8094182B2 · Park et al. · 2012 [cited by applicant]
US RE43786E · Cooper · 2012 [cited by applicant]
US 8463020B1 · Schuckmann et al. · 2013 [cited by applicant]
US 8517256B2 · Stone et al. · 2013 [cited by applicant]
US 8520060B2 · Zomet et al. · 2013 [cited by applicant]
US 8523066B2 · Stone et al. · 2013 [cited by applicant]
US 8523067B2 · Stone et al. · 2013 [cited by applicant]
US 8528816B2 · Stone et al. · 2013 [cited by applicant]
US 8540153B2 · Stone et al. · 2013 [cited by applicant]
US 8594428B2 · Aharoni et al. · 2013 [cited by applicant]
US 8654180B2 · Zomet et al. · 2014 [cited by applicant]
US 8666815B1 · Chau · 2014 [cited by applicant]
US 8699005B2 · Likholyot · 2014 [cited by applicant]
US 8705892B2 · Aguilera et al. · 2014 [cited by applicant]
US RE44924E · Cooper et al. · 2014 [cited by applicant]
US 8854684B2 · Zomet · 2014 [cited by applicant]
US 8861840B2 · Bell et al. · 2014 [cited by applicant]
US 8861841B2 · Bell et al. · 2014 [cited by applicant]
US 8879828B2 · Bell et al. · 2014 [cited by applicant]
US 8953871B2 · Zomet · 2015 [cited by applicant]
US 8989440B2 · Klusza et al. · 2015 [cited by applicant]
US 8996336B2 · Malka et al. · 2015 [cited by applicant]
US 9021947B2 · Landa · 2015 [cited by applicant]
US 9026947B2 · Lee et al. · 2015 [cited by applicant]
US 9035968B2 · Zomet · 2015 [cited by applicant]
US 9041796B2 · Malka et al. · 2015 [cited by applicant]
US 9071714B2 · Zomet · 2015 [cited by applicant]
US 9129438B2 · Aarts et al. · 2015 [cited by applicant]
US 9151608B2 · Malka et al. · 2015 [cited by applicant]
US 9165410B1 · Bell et al. · 2015 [cited by applicant]
US 9171405B1 · Bell et al. · 2015 [cited by applicant]
US 9324190B2 · Bell et al. · 2016 [cited by applicant]
US 9361717B2 · Zomet · 2016 [cited by applicant]
US 9396586B2 · Bell et al. · 2016 [cited by applicant]
US 9438759B2 · Zomet · 2016 [cited by applicant]
US 9438775B2 · Powers et al. · 2016 [cited by applicant]
US 9489775B1 · Bell et al. · 2016 [cited by applicant]
US 9495783B1 · Samarasekera et al. · 2016 [cited by applicant]
US 9576401B2 · Zomet · 2017 [cited by applicant]
US 9619933B2 · Spinella-Marno et al. · 2017 [cited by applicant]
US 9635252B2 · Accardo et al. · 2017 [cited by applicant]
US 9641702B2 · Bin-Nun et al. · 2017 [cited by applicant]
US 9760994B1 · Bell et al. · 2017 [cited by applicant]
US 9786097B2 · Bell et al. · 2017 [cited by applicant]
US 9787904B2 · Birkler et al. · 2017 [cited by applicant]
US 9836885B1 · Eraker · 2017 [cited by examiner]
US 9852351B2 · Aguilera Perez et al. · 2017 [cited by applicant]
US 9953111B2 · Bell et al. · 2018 [cited by applicant]
US 9953430B1 · Zakhor · 2018 [cited by applicant]
US 9990760B2 · Aguilera Perez et al. · 2018 [cited by applicant]
US 9990767B1 · Sheffield et al. · 2018 [cited by applicant]
US 10026224B2 · Bell et al. · 2018 [cited by applicant]
US 10030979B2 · Bjorke et al. · 2018 [cited by applicant]
US 10055876B2 · Ford et al. · 2018 [cited by applicant]
US 10068344B2 · Jovanovic et al. · 2018 [cited by applicant]
US 10083522B2 · Jovanovic et al. · 2018 [cited by applicant]
US 10102639B2 · Bell et al. · 2018 [cited by applicant]
US 10102673B2 · Eraker et al. · 2018 [cited by applicant]
US 10120397B1 · Zakhor et al. · 2018 [cited by applicant]
US 10122997B1 · Sheffield et al. · 2018 [cited by applicant]
US 10127718B2 · Zakhor et al. · 2018 [cited by applicant]
US 10127722B2 · Shakib et al. · 2018 [cited by applicant]
US 10139985B2 · Mildrew et al. · 2018 [cited by applicant]
US 10163261B2 · Bell et al. · 2018 [cited by applicant]
US 10163271B1 · Powers et al. · 2018 [cited by applicant]
US 10181215B2 · Sedeffow · 2019 [cited by applicant]
US 10192115B1 · Sheffield et al. · 2019 [cited by applicant]
US 10204185B2 · Mrowca et al. · 2019 [cited by applicant]
US 10210285B2 · Wong et al. · 2019 [cited by applicant]
US 10235797B1 · Sheffield et al. · 2019 [cited by applicant]
US 10242400B1 · Eraker et al. · 2019 [cited by applicant]
US 10339716B1 · Powers et al. · 2019 [cited by applicant]
US 10366531B2 · Sheffield · 2019 [cited by applicant]
US 10375306B2 · Shan et al. · 2019 [cited by applicant]
US 10395435B2 · Powers et al. · 2019 [cited by applicant]
US 10530997B2 · Shan et al. · 2020 [cited by applicant]
US 10643386B2 · Li et al. · 2020 [cited by applicant]
US 10708507B1 · Dawson et al. · 2020 [cited by applicant]
US 10809066B2 · Colburn · 2020 [cited by examiner]
US 10825247B1 · Vincent et al. · 2020 [cited by applicant]
US 10834317B2 · Boyadzhiev et al. · 2020 [cited by applicant]
US 11055531B1 · Maestas · 2021 [cited by applicant]
US 11057561B2 · Shan et al. · 2021 [cited by applicant]
US 11164361B2 · Moulon et al. · 2021 [cited by applicant]
US 11164368B2 · Vincent et al. · 2021 [cited by applicant]
US 11165959B2 · Shan et al. · 2021 [cited by applicant]
US 11200421B1 · Chavez et al. · 2021 [cited by applicant]
US 11217019B2 · Li et al. · 2022 [cited by applicant]
US 11238652B2 · Impas et al. · 2022 [cited by applicant]
US 11243656B2 · Li et al. · 2022 [cited by applicant]
US 11252329B1 · Cier et al. · 2022 [cited by applicant]
US 11284006B2 · Dawson et al. · 2022 [cited by applicant]
US 11405549B2 · Cier et al. · 2022 [cited by applicant]
US 11405558B2 · Dawson et al. · 2022 [cited by applicant]
US 11408738B2 · Colburn et al. · 2022 [cited by applicant]
US 11480433B2 · Colburn et al. · 2022 [cited by applicant]
US 11481925B1 · Li et al. · 2022 [cited by applicant]
US 11494973B2 · Boyadzhiev et al. · 2022 [cited by applicant]
US 11501492B1 · Li et al. · 2022 [cited by applicant]
US 11514674B2 · Moulon et al. · 2022 [cited by applicant]
US 11592969B2 · Li et al. · 2023 [cited by applicant]
US 11632516B2 · Boyadzhiev et al. · 2023 [cited by applicant]
US 11632602B2 · Cier et al. · 2023 [cited by applicant]
US 11638069B2 · Guan et al. · 2023 [cited by applicant]
US 11645781B2 · Li et al. · 2023 [cited by applicant]
US 11676344B2 · Li et al. · 2023 [cited by applicant]
US 11790648B2 · Stoeva et al. · 2023 [cited by applicant]
US 11797159B2 · Li et al. · 2023 [cited by applicant]
US 11823325B2 · Vincent et al. · 2023 [cited by applicant]
US 11830135B1 · Khosravan et al. · 2023 [cited by applicant]
US 11836973B2 · Wixson et al. · 2023 [cited by applicant]
US 11842464B2 · Khosravan et al. · 2023 [cited by applicant]
US 20060256109A1 · Acker et al. · 2006 [cited by applicant]
US 20070133071A1 · Noyes · 2007 [cited by examiner]
US 20100208099A1 · Nomura · 2010 [cited by examiner]
US 20100232709A1 · Zhang et al. · 2010 [cited by applicant]
US 20120075414A1 · Park et al. · 2012 [cited by applicant]
US 20120293613A1 · Powers et al. · 2012 [cited by applicant]
US 20130050407A1 · Brinda et al. · 2013 [cited by applicant]
US 20130342533A1 · Bell et al. · 2013 [cited by applicant]
US 20140043436A1 · Bell et al. · 2014 [cited by applicant]
US 20140044343A1 · Bell et al. · 2014 [cited by applicant]
US 20140044344A1 · Bell et al. · 2014 [cited by applicant]
US 20140125658A1 · Bell et al. · 2014 [cited by applicant]
US 20140125767A1 · Bell et al. · 2014 [cited by applicant]
US 20140125768A1 · Bell et al. · 2014 [cited by applicant]
US 20140125769A1 · Bell et al. · 2014 [cited by applicant]
US 20140125770A1 · Bell et al. · 2014 [cited by applicant]
US 20140236482A1 · Dorum et al. · 2014 [cited by applicant]
US 20140267631A1 · Powers et al. · 2014 [cited by applicant]
US 20140307100A1 · Myllykoski et al. · 2014 [cited by applicant]
US 20140320674A1 · Kuang · 2014 [cited by applicant]
US 20150109338A1 · McKinnon et al. · 2015 [cited by applicant]
US 20150116691A1 · Likholyot · 2015 [cited by applicant]
US 20150189165A1 · Milosevski et al. · 2015 [cited by applicant]
US 20150262421A1 · Bell et al. · 2015 [cited by applicant]
US 20150269785A1 · Bell et al. · 2015 [cited by applicant]
US 20150302636A1 · Arnoldus et al. · 2015 [cited by applicant]
US 20150310596A1 · Sheridan et al. · 2015 [cited by applicant]
US 20150326841A1 · Cho · 2015 [cited by examiner]
US 20150332464A1 · O'Keefe et al. · 2015 [cited by applicant]
US 20160055268A1 · Bell et al. · 2016 [cited by applicant]
US 20160134860A1 · Jovanovic et al. · 2016 [cited by applicant]
US 20160140676A1 · Fritze et al. · 2016 [cited by applicant]
US 20160217225A1 · Bell et al. · 2016 [cited by applicant]
US 20160260250A1 · Jovanovic et al. · 2016 [cited by applicant]
US 20160286119A1 · Rondinelli · 2016 [cited by applicant]
US 20160300385A1 · Bell et al. · 2016 [cited by applicant]
US 20170034430A1 · Fu et al. · 2017 [cited by applicant]
US 20170067739A1 · Siercks et al. · 2017 [cited by applicant]
US 20170194768A1 · Powers et al. · 2017 [cited by applicant]
US 20170195654A1 · Powers et al. · 2017 [cited by applicant]
US 20170263050A1 · Ha et al. · 2017 [cited by applicant]
US 20170324941A1 · Birkler · 2017 [cited by applicant]
US 20170330273A1 · Holt et al. · 2017 [cited by applicant]
US 20170337737A1 · Edwards et al. · 2017 [cited by applicant]
US 20180007340A1 · Stachowski · 2018 [cited by applicant]
US 20180025536A1 · Bell et al. · 2018 [cited by applicant]
US 20180075168A1 · Tiwari et al. · 2018 [cited by applicant]
US 20180139431A1 · Simek et al. · 2018 [cited by applicant]
US 20180143023A1 · Bjorke et al. · 2018 [cited by applicant]
US 20180143756A1 · Mildrew et al. · 2018 [cited by applicant]
US 20180144487A1 · Bell et al. · 2018 [cited by applicant]
US 20180144535A1 · Ford et al. · 2018 [cited by applicant]
US 20180144547A1 · Shakib et al. · 2018 [cited by applicant]
US 20180144555A1 · Ford et al. · 2018 [cited by applicant]
US 20180146121A1 · Hensler et al. · 2018 [cited by applicant]
US 20180146193A1 · Safreed et al. · 2018 [cited by applicant]
US 20180146212A1 · Hensler et al. · 2018 [cited by applicant]
US 20180165871A1 · Mrowca · 2018 [cited by applicant]
US 20180203955A1 · Bell et al. · 2018 [cited by applicant]
US 20180241985A1 · O'Keefe et al. · 2018 [cited by applicant]
US 20180293793A1 · Bell et al. · 2018 [cited by applicant]
US 20180300936A1 · Ford et al. · 2018 [cited by applicant]
US 20180306588A1 · Bjorke et al. · 2018 [cited by applicant]
US 20180348854A1 · Powers et al. · 2018 [cited by applicant]
US 20180365496A1 · Hovden et al. · 2018 [cited by applicant]
US 20190012833A1 · Eraker et al. · 2019 [cited by applicant]
US 20190026956A1 · Gausebeck et al. · 2019 [cited by applicant]
US 20190026957A1 · Gausebeck · 2019 [cited by applicant]
US 20190026958A1 · Gausebeck et al. · 2019 [cited by applicant]
US 20190035165A1 · Gausebeck · 2019 [cited by applicant]
US 20190041972A1 · Bae · 2019 [cited by applicant]
US 20190045163A1 · Nikkanen · 2019 [cited by examiner]
US 20190050137A1 · Mildrew et al. · 2019 [cited by applicant]
US 20190051050A1 · Bell et al. · 2019 [cited by applicant]
US 20190051054A1 · Jovanovic et al. · 2019 [cited by applicant]
US 20190087067A1 · Hovden et al. · 2019 [cited by applicant]
US 20190122422A1 · Sheffield et al. · 2019 [cited by applicant]
US 20190164335A1 · Sheffield et al. · 2019 [cited by applicant]
US 20190180104A1 · Sheffield et al. · 2019 [cited by applicant]
US 20190251645A1 · Winans · 2019 [cited by applicant]
US 20190287164A1 · Eraker et al. · 2019 [cited by applicant]
US 20200396434A1 · Romanenko et al. · 2020 [cited by applicant]
US 20210065271A1 · Benkreira et al. · 2021 [cited by applicant]
US 20220076491A1 · Zellner et al. · 2022 [cited by applicant]
US 20220092227A1 · Yin et al. · 2022 [cited by applicant]
US 20220103795A1 · Lee et al. · 2022 [cited by applicant]
US 20220164493A1 · Li et al. · 2022 [cited by applicant]
US 20230071446A1 · Narayana et al. · 2023 [cited by applicant]
US 20230125295A1 · Min et al. · 2023 [cited by applicant]
US 20230138762A1 · Lambert et al. · 2023 [cited by applicant]
US 20230196684A1 · Li et al. · 2023 [cited by applicant]
US 20230206393A1 · Hutchcroft et al. · 2023 [cited by applicant]
US 20240160797A1 · Narayana · 2024 [cited by examiner]
EP 2413097A2 · 2012 [cited by applicant]
EP 2505961A2 · 2012 [cited by applicant]
EP 2506170A2 · 2012 [cited by applicant]
EP 4207069A1 · 2023 [cited by applicant]
JP 2007158997A · 2007 [cited by examiner]
KR 101770648B1 · 2017 [cited by applicant]
KR 101930796B1 · 2018 [cited by applicant]
WO 2005091894A2 · 2005 [cited by applicant]
WO 2016154306A1 · 2016 [cited by applicant]
WO 2018204279A1 · 2018 [cited by applicant]
WO 2019058266A1 · 2019 [cited by applicant]
WO 2019083832A1 · 2019 [cited by applicant]
WO 2019104049A1 · 2019 [cited by applicant]
WO 2019118599A2 · 2019 [cited by applicant]
WO 2020068177A1 · 2020 [cited by applicant]
WO 2022053888A1 · 2022 [cited by applicant]
WO 2022183321A1 · 2022 [cited by applicant]
CubiCasa | From video to floor plan in under 5 minutes, retrieved on Mar. 26, 2019, from https://www.cubi.casa/, 6 pages. [cited by applicant]
CubiCasa FAQ & Manual, retrieved on Mar. 26, 2019, from https://www.cubi.casa/faq/, 5 pages. [cited by applicant]
Cupix Home, retrieved on Mar. 26, 2019, from https://www.cupix.com/, 1 page. [cited by applicant]
Cupix—FAQ, retrieved on Mar. 26, 2019, from https://www.cupix.com/faq.html, 3 pages. [cited by applicant]
IGuide: 3D Virtual Tours, retrieved on Mar. 26, 2019, from https://goiguide.com/, 6 pages. [cited by applicant]
Immoviewer.com | Automated Video Creation & Simple Affordable 3D 360 Tours, retrieved on Mar. 26, 2019, from https://www.immoviewer.com/, 5 pages. [cited by applicant]
MagicPlan | #1 Floor Plan App, Construction & Surveying Samples, retrieved on Mar. 26, 2019, from https://www.magicplan.app/, 9 pages. [cited by applicant]
EyeSpy360 Virtual Tours | Virtual Tour with any 360 camera, retrieved on Mar. 27, 2019, from https://www.eyespy360.com/en-us/, 15 pages. [cited by applicant]
Indoor Reality, retrieved on Mar. 27, 2019, from https://www.indoorreality.com/, 9 pages. [cited by applicant]
InsideMaps, retrieved on Mar. 27, 2019, from https://www.insidemaps.com/, 7 pages. [cited by applicant]
IStaging | Augmented & Virtual Reality Platform for Business, retrieved on Mar. 27, 2019, from https://www.istaging.com/en/, 7 pages. [cited by applicant]
Metareal, retrieved on Mar. 27, 2019, from https://www.metareal.com/, 4 pages. [cited by applicant]
PLNAR—The Ar 3D Measuring / Modeling Platform, retrieved on Mar. 27, 2019, from https://www.plnar. co, 6 pages. [cited by applicant]
YouVR Global, retrieved on Mar. 27, 2019, from https://global.youvr.io/, 9 pages. [cited by applicant]
GeoCV, retrieved on Mar. 28, 2019, from https://geocv.com/, 4 pages. [cited by applicant]
Biersdorfer, J.D., “How to Make A 3-D Model of Your Home Renovation Vision,” in The New York Times, Feb. 13, 2019, retrieved Mar. 28, 2019, 6 pages. [cited by applicant]
Chen et al. “Rise of the indoor crowd: Reconstruction of building interior view via mobile crowdsourcing.” In: Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems. Nov. 4, 2015, 13 pages. [cited by applicant]
Immersive 3D for the Real World, retrieved from https://matterport.com/, on Mar. 27, 2017, 5 pages. [cited by applicant]
Learn About Our Complete 3D System, retrieved from https://matterport.com/how-it-works/, on Mar. 27, 2017, 6 pages. [cited by applicant]
Surefield FAQ, retrieved from https://surefield.com/faq, on Mar. 27, 2017, 1 page. [cited by applicant]
Why Surefield, retrieved from https://surefield.com/why-surefield, on Mar. 27, 2017, 7 pages. [cited by applicant]
Schneider, V., “Create immersive photo experiences with Google Photo Sphere,” retrieved from http://geojoumalism.org/2015/02/create-immersive-photo-experiences-with-google-photo-sphere/, on Mar. 27, 2017, 7 pages. [cited by applicant]
Tango (platform), Wikipedia, retrieved from https://en.wikipedia.org/wiki/Tango_(platform), on Jun. 12, 2018, 5 pages. [cited by applicant]
Zou et al. “LayoutNet: Reconstructing the 3D Room Layout from a Single RGB Image” in arXiv:1803.08999, submitted Mar. 23, 2018, 9 pages. [cited by applicant]
Lee et al. “RoomNet: End-to-End Room Layout Estimation” in arXiv:1703.00241v2, submitted Aug. 7, 2017, 10 pages. [cited by applicant]
Time-of-flight camera, Wikipedia, retrieved from https://en.wikipedia.org/wiki/Time-of-flight_camera, on Aug. 30, 2018, 8 pages. [cited by applicant]
Magicplan—Android Apps on Go . . . , retrieved from https://play.google.com/store/apps/details?id=com.sensopia.magicplan, on Feb. 21, 2018, 5 pages. [cited by applicant]
Pintore et al., “AtlantaNet: Inferring the 3D Indoor Layout from a Single 360 Image beyond the Manhattan World Assumption”, ECCV 2020, 16 pages. [cited by applicant]
Cowles, Jeremy, “Differentiable Rendering”, Aug. 19, 2018, accessed Dec. 7, 2020 at https://towardsdatascience.com/differentiable-rendering-d00a4b0f14be, 3 pages. [cited by applicant]
Yang et al., “DuLa-Net: A Dual-Projection Network for Estimating Room Layouts from a Single RGB Panorama”, in arXiv:1811.11977[cs.v2], submitted Apr. 2, 2019, 14 pages. [cited by applicant]
Sun et al., “HoHoNet: 360 Indoor Holistic Understanding with Latent Horizontal Features”, in arXiv:2011.11498[cs.v2], submitted Nov. 24, 2020, 15 pages. [cited by applicant]
Nguyen-Phuoc et al., “RenderNet: A deep convolutional network for differentiable rendering from 3D shapes”, in arXiv:1806.06575[cs.v3], submitted Apr. 1, 2019, 17 pages. [cited by applicant]
Convolutional neural network, Wikipedia, retrieved from https://en.wikipedia.org/wiki/Convolutional_neural_network, on Dec. 7, 2020, 25 pages. [cited by applicant]
Hamilton et al., “Inductive Representation Learning on Large Graphs”, in 31st Conference on Neural Information Processing Systems (NIPS 2017), 2017, 19 pages. [cited by applicant]
Kipf et al., “Variational Graph Auto-Encoders”, in arXiv:1611.07308v1 [stat.ML], submitted Nov. 21, 2016, 3 pages. [cited by applicant]
Cao et al., “MoIGAN: An Implicit Generative Model for Small Molecular Graphs”, in arXiv1805.11973v1 [stat. ML], submitted May 30, 2018, 11 pages. [cited by applicant]
Chen et al., “Intelligent Home 3D: Automatic 3D-House Design from Linguistic Descriptions Only”, in arXiv:2003.00397v1 [cs.CV], submitted Mar. 1, 2020, 14 pages. [cited by applicant]
Cucurull et al., “Context-Aware Visual Compatibility Prediction”, in arXiv:1902.03646v2 [cs.CV], submitted Feb. 12, 2019, 10 pages. [cited by applicant]
Fan et al., “Labeled Graph Generative Adversarial Networks”, in arXiv:1906.03220v1 [cs.LG], submitted Jun. 7, 2019, 14 pages. [cited by applicant]
Gong et al., “Exploiting Edge Features in Graph Neural Networks”, in arXiv:1809.02709v2 [cs.LG], submitted Jan. 28, 2019, 10 pages. [cited by applicant]
Genghis Goodman, “A Machine Learning Approach to Artificial Floorplan Generation”, University of Kentucky Theses and Dissertations—Computer Science, 2019, accessible at https://uknowledge.uky.edu/cs_etds/89, 40 pages. [cited by applicant]
Grover et al., “node2vec: Scalable Feature Learning for Networks”, in arXiv:1607.00653v1 [cs.SI], submitted Jul. 3, 2016, 10 pages. [cited by applicant]
Nauata et al., “House-GAN: Relational Generative Adversarial Networks for Graph-constrained House Layout Generation”, in arXiv:2003.06988v1 [cs.CV], submitted Mar. 16, 2020, 17 pages. [cited by applicant]
Kang et al., “A Review of Techniques for 3D Reconstruction of Indoor Environments”, in ISPRS International Journal of Geo-Information 2020, May 19, 2020, 31 pages. [cited by applicant]
Kipf et al., “Semi-Supervised Classification With Graph Convolutional Networks”, in arXiv:1609.02907v4 [cs.LG], submitted Feb. 22, 2017, 14 pages. [cited by applicant]
Li et al., “Graph Matching Networks for Learning the Similarity of Graph Structured Objects”, in Proceedings of the 36th International Conference on Machine Learning (PMLR 97), 2019, 18 pages. [cited by applicant]
Liu et al., “Hyperbolic Graph Neural Networks”, in 33rd Conference on Neural Information Processing Systems (NeurIPS 2019), 2019, 12 pages. [cited by applicant]
Merrell et al., “Computer-Generated Residential Building Layouts”, in ACM Transactions on Graphics, Dec. 2010, 13 pages. [cited by applicant]
Adobe, “Adjusting white balance settings to improve photos”, accessed on Apr. 30, 2024 at https://www.adobe.com/creativecloud/photography/discover/white-balance.html, 10 pages. [cited by applicant]
Barnard et al., “Color Constancy for Scenes with Varying Illumination”, Computer Vision and Image Understanding, 65, 2, pp. 311-321 (1997), 30 pages. [cited by applicant]
Cambridge in Colour, “Tutorials: White Balance”, accessed Apr. 30, 2024 at https://www.cambridgeincolour.com/tutorials/white-balance.htm, 8 pages. [cited by applicant]
Freescale Semiconductor, “White Balance and Color Correction in Digital Cameras”, 2000, accessed Apr. 30, 2024 at https://www.nxp.com/docs/en/application-note/AN1904.pdf, 6 pages. [cited by applicant]
Gershon et al., “From [R,G,B] to Surface Reflectance: Computing Color Constant Descriptors in Images”, Proceedings of the 10th International Joint Conference on Artificial Intelligence. Milan, Italy, Aug. 23-28, 1987, 4… [cited by applicant]
ResearchGate, “Computational Color Constancy: Survey and Experiments”, IEEE Transactions on Image Processing, vol. 20, No. 9, Sep. 2011, 16 pages. [cited by applicant]
Edwin H. Land, “The Retinex Theory of Color Vision”, Scientific American, vol. 237, No. 6, pp. 108-128, Dec. 1977, 18 pages. [cited by applicant]
Van de Weijer et al., “Edge-Based Color Constancy”, IEEE Transactions on Image Processing, vol. 16, No. 9, Sep. 2007, 8 pages. [cited by applicant]
Xiong et al., “Automatic White Balancing via Gray Surface Identification”, Proceedings of the Fifteenth IS&T Color Imaging Conference, Nov. 2007, 4 pages. [cited by applicant]
Mahmoud Afifi et al., “Auto White-Balance Correction for Mixed-Illuminant Scenes”, Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2022, accessible at https://openaccess.thecvf.c… [cited by applicant]
Steve Cruz et al., “Zillow Indoor Dataset: Annotated Floor Plans With 360° Panoramas and 3D Room Layouts”, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021, accessible at https://openacce… [cited by applicant]