IP Library › Granted Patent US 12,573,147
Granted Patent B2
US 12,573,147 · App. 18/251,229 · Granted Mar 10, 2026

Landmark data collection method and landmark building modeling method

Inventors: Zhili Chen (Los Angeles, CA); Linjie Luo (Los Angeles, CA); Xiao Yang (Los Angeles, CA); Jianchao Yang (Los Angeles, CA); Jing Liu (Los Angeles, CA); Guohui Wang (Los Angeles, CA)
Assignee: BYTEDANCE INC.
G06T17/10G06T5/92G06T2200/08G06T2207/20208
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,573,147
App. No.
18/251,229
Granted
Mar 10, 2026
Kind
B2
Abstract

A landmark data collection method includes: determining (S 100 ) a first basic collection point (A), a second basic collection point (B), and a third basic collection point (C) sequentially in an observation area of a landmark building; and collecting (S 200 ) photos of the landmark building based on each of the first basic collection point (A), the second basic collection point (B), and the third basic collection point (C) to obtain landmark data of the landmark building. A photo of the landmark building is taken by a camera at the i-th basic collection point; and a collection point is determined at every predetermined distance interval as the camera is moved in a counterclockwise direction and/or a clockwise direction, and the photo of the landmark building is taken by the camera at the collection point, until the camera is moved out of the observation area, where i=1, 2, 3.

Claims (37)

1 . A landmark data collection method, comprising:

determining a first basic collection point, a second basic collection point, and a third basic collection point sequentially in an observation area of a landmark building; and

collecting photos of the landmark building based on each of the first basic collection point, the second basic collection point, and the third basic collection point to obtain landmark data of the landmark building, wherein

when a photo of the landmark building is taken by a camera at the first basic collection point, in a camera picture, at least one of a first ratio, of a size of imaging of the landmark building in a first direction to a size of the camera picture in the first direction, or a second ratio, of a size of the imaging of the landmark building in a second direction to a size of the camera picture in the second direction, is greater than or equal to 85%,

when a photo of the landmark building is taken by the camera at the second basic collection point, in the camera picture, a ratio of a size of imaging of the landmark building in the first direction to the size of the camera picture in the first direction is approximately 45% to 55% of the first ratio, and

the third basic collection point is approximately a midpoint between the first basic collection point and the second basic collection point,

wherein said collecting the photos of the landmark building based on the i-th basic collection point comprises:

taking a photo of the landmark building by the camera at the i-th basic collection point; and

moving the camera in at least one of a counterclockwise direction or a clockwise direction in the observation area, with the i-th basic collection point being a starting point; and determining a collection point at every predetermined distance interval, and taking a photo of the landmark building by the camera at the collection point, until the camera is moved out of the observation area, wherein during the movement of the camera, the camera faces the landmark building, and in the camera picture, a ratio of a size of imaging of the landmark building in the first direction to the size of the camera picture in the first direction remains substantially unchanged, where i=1, 2, 3.

2 . The collection method of claim 1 , wherein when the photo of the landmark building is taken by the camera at each of the first basic collection point, the second basic collection point, and the third basic collection point, the camera faces substantially right to a main identification part of the landmark building, and in the camera picture, the imaging of the landmark building comprises imaging of the main identification part.

3 . The collection method of claim 1 , wherein the first direction is substantially in parallel to a height direction of the imaging of the landmark building in the camera picture, and the second direction is substantially in parallel to a width direction of the imaging of the landmark building in the camera picture.

4 . The collection method of claim 3 , wherein the first direction is a vertical direction of the camera picture, and the second direction is a horizontal direction of the camera picture.

5 . The collection method of claim 1 , wherein the observation area is not a 360-degree observation area, and

said moving the camera in at least one of the counterclockwise direction or the clockwise direction in the observation area, with the i-th basic collection point being the starting point; and determining the collection point at every predetermined distance interval, and taking the photo of the landmark building by the camera at the collection point, until the camera is moved out of the observation area comprises:

moving the camera in each of the counterclockwise direction and the clockwise direction in the observation area, with the i-th basic collection point being the starting point; and determining the collection point at every predetermined distance interval, and taking the photo of the landmark building by the camera at the collection point, until the camera is moved out of the observation area.

6 . The collection method of claim 1 , wherein the observation area is a 360-degree observation area, and

said moving the camera in at least one of the counterclockwise direction or the clockwise direction in the observation area, with the i-th basic collection point being the starting point; and determining the collection point at every predetermined distance interval, and taking the photo of the landmark building by the camera at the collection point, until the camera is moved out of the observation area comprises:

moving the camera in the counterclockwise direction or the clockwise direction in the observation area, with the i-th basic collection point being the starting point; and determining the collection point at every predetermined distance interval, and taking the photo of the landmark building by the camera at the collection point, until the camera is moved back to the i-th basic collection point.

7 . The collection method of claim 1 , wherein in the process of collecting the photos of the landmark building based on the i-th basic collection point, photos collected at two adjacent collection points have at least an 80% overlap area between each other.

8 . The collection method of claim 1 , wherein in the process of collecting the photos of the landmark building based on the i-th basic collection point, in response to that the landmark building is unable to be captured completely in one photo taken by the camera at any collection point, a plurality of photos are taken of the landmark building by rotating the camera at the collection point to capture the landmark building completely, wherein any two consecutive photos in the plurality of photos of the landmark building have at least a 50% overlap area between each other.

9 . The collection method of claim 8 , wherein in the process of collecting the photos of the landmark building based on the i-th basic collection point, in a case where a photo X 1 of the landmark building is collected at one of two adjacent collection points, and a plurality of photos of the landmark building are collected at the other one of the two adjacent collection points, at least one photo X 2 in the plurality of photos of the landmark building collected at the other one of the two adjacent collection points has at least an 80% overlap area with the photo X 1 .

10 . The collection method of claim 8 , wherein in the process of collecting the photos of the landmark building based on the i-th basic collection point, in a case where a plurality of photos of the landmark building are collected at each of two adjacent collection points, at least one photo X 1 in the plurality of photos of the landmark building collected at one of the two adjacent collection points and at least one photo X 2 in the plurality of photos of the landmark building collected at the other one of the two adjacent collection points have at least an 80% overlap area between each other.

11 . The collection method of claim 1 , wherein in the process of collecting the photos of the landmark building based on the i-th basic collection point, the predetermined distance interval is an equal distance interval or an unequal distance interval.

12 . The collection method of claim 1 , wherein in the process of collecting the photos of the landmark building based on the i-th basic collection point, a center point of the landmark building is taken as a vertex O, and an angle ∠POQ formed by any two adjacent collection points P and Q and the vertex O ranges from 1 degree to 1.5 degree.

13 . The collection method of claim 1 , wherein in a case where a ratio of an illuminance of a light of the landmark building itself to an illuminance of sunlight is smaller than 0.5, the photos of the landmark building are collected based on the i-th basic collection point once every predetermined time interval, where i=1, 2, 3.

14 . The collection method of claim 1 , wherein

in a case where a ratio of an illuminance of a light of the landmark building itself to an illuminance of ambient light is greater than 0.8 but smaller than 1.2, the photos of the landmark building are collected based on the i-th basic collection point, where i=1, 2, 3; and

in a case where the ratio of the illuminance of the light of the landmark building itself to the illuminance of the ambient light is greater than 2, the photos of the landmark building are collected based on the i-th basic collection point, where i=1, 2, 3.

15 . The collection method of claim 1 , wherein during the collection of the landmark data of the landmark building, a flash and a live function of the camera are kept off.

16 . The collection method of claim 1 , wherein during the collection of the landmark data of the landmark building, a high dynamic range imaging function of the camera is kept on.

17 . A landmark building modeling method, comprising:

collecting the landmark data of the landmark building using the landmark data collection method according to claim 1 , wherein the landmark data of the landmark building comprise the photos of the landmark building collected based on each of the first basic collection point, the second basic collection point, and the third basic collection point; and

constructing a three-dimensional model of the landmark building based on the landmark data of the landmark building.

18 . The modeling method of claim 17 , wherein said constructing the three-dimensional model of the landmark building based on the landmark data of the landmark building comprises:

processing the photos of the landmark building collected based on the first basic collection point, the photos of the landmark building collected based on the second basic collection point, and the photos of the landmark building collected based on the third basic collection point sequentially using a three-dimensional reconstruction algorithm to construct the three-dimensional model of the landmark building.

19 . The modeling method of claim 18 , wherein said processing the photos of the landmark building collected based on the i-th basic collection point using the three-dimensional reconstruction algorithm comprises:

processing, in an order where the photos of the landmark building are collected based on the i-th basic collection point, the photos of the landmark building collected based on the i-th basic collection point sequentially using the three-dimensional reconstruction algorithm to construct the three-dimensional model of the landmark building.

Priority Claims (1)
CN 202011177220.3 · Oct 29, 2020 · national
Continuity (1)
Related Publication 20230401791A1 · Dec 14, 2023
References Cited (28)
US 11769268B1 · Post · 2023 [cited by examiner]
US 20050177350A1 · Kishikawa · 2005 [cited by applicant]
US 20130060540A1 · Frahm · 2013 [cited by examiner]
US 20170018113A1 · Lattanzi · 2017 [cited by examiner]
US 20170208245A1 · Castillo · 2017 [cited by examiner]
US 20170249751A1 · Indelman · 2017 [cited by examiner]
US 20180107360A1 · Kim · 2018 [cited by examiner]
US 20180335996A1 · Chen · 2018 [cited by examiner]
US 20190051041A1 · Mills · 2019 [cited by examiner]
US 20190174056A1 · Jung · 2019 [cited by examiner]
US 20200111250A1 · Huang et al. · 2020 [cited by applicant]
US 20210004595A1 · Du · 2021 [cited by examiner]
US 20210216786A1 · Machida · 2021 [cited by examiner]
CN 103198524A · 2013 [cited by applicant]
CN 106296821A · 2017 [cited by applicant]
CN 107103641A · 2017 [cited by applicant]
CN 109410327A · 2019 [cited by applicant]
CN 109801365A · 2019 [cited by applicant]
CN 109885630A · 2019 [cited by applicant]
CN 110505463A · 2019 [cited by applicant]
CN 110677828A · 2020 [cited by applicant]
CN 112233229A · 2021 [cited by applicant]
KR 101853490B1 · 2018 [cited by applicant]
KR 102050169B1 · 2019 [cited by applicant]
Notice of Decision of Grant issued Jul. 1, 2023 in Chinese Application No. 202011177220.3, English translation (9 pages). [cited by applicant]
Han., S. et al., “Application of Oblique Photogrammetry in Large Scale Cadastral Mapping in Complex Area,” Journal of Green Science and Technology, Jul. 2020, English Abstract (5 pages). [cited by applicant]
International Search Report issued Oct. 27, 2021 in International Application No. PCT/CN2021/110598, with English translation (8 pages). [cited by applicant]
Written Opinion for International Application No. PCT/CN2021/110598, mailed Oct. 27, 2021, 10 Pages. [cited by applicant]