IP Library Granted Patent US 12704387
Granted Patent B2
US 12704387 · App. 18/644,680 · Granted Aug 11, 2026

Electronic device and method for providing three-dimensional map

Inventor: Youngjun Seo (Suwon-si, KR)
Assignee: Samsung Electronics Co., Ltd.
G01C21/3848G06T7/248G06T7/74G06T17/05G06V10/46G06V20/10G06T2207/30181
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12704387
App. No.
18/644,680
Granted
Aug 11, 2026
Kind
B2
Abstract

An electronic device and a method of operating the same are provided. The electronic device includes a camera module, memory storing one or more computer programs, and one or more processors communicatively coupled to the memory and the camera module, wherein the one or more computer programs include computer-executable instructions that, when executed by the one or more processors, cause the electronic device to acquire an image captured by the camera module, acquire a three-dimensional map, based on location information of the electronic device, identify, in the image, a first object corresponding to a celestial body and a second object corresponding to a new terrain feature that is not included in the three-dimensional map, acquire three-dimensional image data of the new terrain feature for updating the three-dimensional map, based on information related to the second object identified based on a location of the first object, and provide a three-dimensional map updated through reflection of the acquired image data.

Claims (122)

1 . An electronic device comprising:

camera circuitry;

memory storing one or more computer programs; and

one or more processors communicatively coupled to the memory and the camera circuitry,

wherein the one or more computer programs include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:

acquire an image captured by the camera circuitry on a terrain,

acquire location information of the electronic device corresponding to a place at which the electronic device captured the image,

acquire a three-dimensional map based on the location information of the electronic device,

identify, in the image, a first object corresponding to a celestial body and a second object corresponding to a new terrain feature not included in the three-dimensional map,

based on identifying the first object corresponding to the celestial body and the second object corresponding to the new terrain feature not included in the three-dimensional map, acquire three-dimensional image data of the new terrain feature for updating the three-dimensional map based on information related to the second object identified based on a location of the first object corresponding to the celestial body, and

provide an updated three-dimensional map updated through reflection of the three-dimensional image data.

2 . The electronic device of claim 1 , further comprising:

communication circuitry electrically connected to the one or more processors; and

a display electrically connected to the one or more processors,

wherein the one or more computer programs include computer-executable instructions that, when executed by one or more processors individually or collectively, further cause the electronic device to:

transmit, through the communication circuitry to an external electronic device, the three-dimensional image data to update the three-dimensional map by the external electronic device,

receive, through the communication circuitry from the external electronic device, the updated three-dimensional map updated by the external electronic device based on the three-dimensional image data,

store, in the memory, the updated three-dimensional map, and

control the display to display the updated three-dimensional map.

3 . The electronic device of claim 2 ,

wherein the one or more computer programs further include computer-executable instructions that, when executed by one or more processors individually or collectively, further cause the electronic device to:

transmit, through the communication circuitry to the external electronic device, information related to the location of the first object, information related to at least one terrain feature included in the image, and the location information of the electronic device to update the three-dimensional map by the external electronic device, and

receive, through the communication circuitry from the external electronic device, the updated three-dimensional map generated by the external electronic device and reflecting the three-dimensional image data,

wherein the information related to the at least one terrain feature includes identification information of the second object, an image part of the second object, or identification information of a third object corresponding to another terrain feature, and

wherein the location information of the electronic device includes global positioning system (GPS) information and position information.

4 . The electronic device of claim 3 , wherein the one or more computer programs include computer-executable instructions that, when executed by one or more processors individually or collectively, further cause the electronic device to:

identify the location of the first object corresponding to the celestial body based on at least one piece of the location information of the electronic device or information related to the celestial body corresponding to the first object received from the external electronic device.

5 . The electronic device of claim 1 , wherein the one or more computer programs include computer-executable instructions that, when executed by one or more processors individually or collectively, further cause the electronic device to:

identify a third object corresponding to a terrain feature included in the three-dimensional map and the image, and

acquire feature points of the second object and feature points of the third object by analyzing shapes of the second object and the third object.

6 . The electronic device of claim 5 , wherein the one or more computer programs include computer-executable instructions that, when executed by one or more processors individually or collectively, further cause the electronic device to:

designate a location of the electronic device in the three-dimensional map based on the location information of the electronic device,

generate the three-dimensional image data based on distances and angles of the feature points of the second object and distances and angles of the feature points of the third object, the distances and the angles being identified based the location of the first object, and

reflect the three-dimensional image data to update the three-dimensional map.

7 . The electronic device of claim 6 , wherein the one or more computer programs include computer-executable instructions that, when executed by one or more processors individually or collectively, further cause the electronic device to:

identify a second location of the first object based on the first object having moved without movement of the electronic device,

identify an angle change of the feature points of the second object between a first location and the second location of the first object,

identify an angle change of the feature points of the third object between the first location and the second location of the first object,

identify distances between the electronic device and the feature points of the second object based on distances between the electronic device and the feature points of the third object, the angle change of the feature points of the second object, and the angle change of the feature points of the third object,

identify an elevation angle of the first object based on the first object having moved without movement of the electronic device, and

identify the distances of the feature points of the second object further based on the identified elevation angle.

8 . The electronic device of claim 7 , wherein the one or more computer programs include computer-executable instructions that, when executed by one or more processors individually or collectively, further cause the electronic device to:

designate a first location of the electronic device and the location of the first object in the three-dimensional map,

at the first location of the electronic device, identify a first angle between the location of the first object and the feature points of the second object and a first angle between the location of the first object and the feature points of the third object,

identify a second location of the electronic device based on the electronic device having moved without movement of the first object,

at the second location of the electronic device, identify a second angle between the location of the first object and the feature points of the second object and a second angle between the location of the first object and the feature points of the third object,

identify an angle change of the second object based on the first angle and the second angle of the second object and identify an angle change of the third object based on the first angle and the second angle of the third object,

calculate distances between the electronic device and the feature points of the second object based on the distances between the electronic device and the feature points of the third object, the angle change of the second object, and the angle change of the third object,

identify an elevation angle of the first object by a change in a height of the electronic device based on the electronic device having moved without movement of the first object, and

identify the distances between the electronic device and the feature points of the second object further based on the elevation angle.

9 . The electronic device of claim 1 , wherein the identifying of the second object corresponding to the new terrain feature not included in the three-dimensional map includes comparing the image captured by the electronic device and the three-dimensional map acquired by the electronic device.

10 . A method performed by an electronic device, the method comprising:

acquiring an image captured by camera circuitry of the electronic device on a terrain;

acquiring location information of the electronic device corresponding to a place at which the electronic device captured the image;

acquiring a three-dimensional map based on the location information of the electronic device;

identifying, in the image, a first object corresponding to a celestial body and a second object corresponding to a new terrain feature not included in the three-dimensional map;

based on identifying the first object corresponding to the celestial body and the second object corresponding to the new terrain feature not included in the three-dimensional map, acquiring three-dimensional image data of the new terrain feature for updating the three-dimensional map based on information related to the second object identified based on a location of the first object corresponding to the celestial body; and

providing an updated three-dimensional map updated through reflection of the three-dimensional image data.

11 . The method of claim 10 , wherein the providing of the updated three-dimensional map comprises:

updating the three-dimensional map by reflecting the three-dimensional image data generated based on distances and angles of feature points of the second object;

storing the updated three-dimensional map in memory of the electronic device; and

displaying the updated three-dimensional map on a display of the electronic device.

12 . The method of claim 11 , further comprising:

transmitting, through communication circuitry of the electronic device to an external electronic device, the three-dimensional image data to update the three-dimensional map by the external electronic device;

receiving, through the communication circuitry from the external electronic device, the updated three-dimensional map updated by the external electronic device based on the three-dimensional image data; and

storing the updated three-dimensional map in the memory of the electronic device.

13 . The method of claim 12 , further comprising:

transmitting, through the communication circuitry to the external electronic device, information related to the location of the first object, information related to at least one terrain feature included in the image, and the location information of the electronic device to update the three-dimensional map by the external electronic device;

receiving, through the communication circuitry from the external electronic device, the updated three-dimensional map reflecting the three-dimensional image data generated by the external electronic device; and

storing the updated three-dimensional map in the memory of the electronic device,

wherein the information related to the at least one terrain feature comprises a shape image of the second object, a shape image of a third object corresponding to another terrain feature, and identification information of the second object, and

wherein the location information of the electronic device comprises global positioning system (GPS) information and position information.

14 . The method of claim 12 , further comprising:

identifying the location of the first object corresponding to the celestial body based on at least one piece of the location information of the electronic device or information related to the celestial body corresponding to the first object received from the external electronic device.

15 . The method of claim 10 ,

wherein the acquiring of the three-dimensional image data of the new terrain feature comprises:

identifying a third object corresponding to a terrain feature included in the three-dimensional map and the image;

identifying a second location of the first object, object based on the first object having moved without movement of the electronic device;

identifying an angle change of feature points of the second object between a first location and a second location of the first object;

identifying an angle change of feature points of the third object between the first location and the second location of the first object; and

identifying distances between the electronic device and the feature points of the second object based on distances between the electronic device and the feature points of the third object, the angle change of the feature points of the second object, and the angle change of the feature points of the third object,

wherein the acquiring of the three-dimensional image data of the new terrain feature further comprises identifying an elevation angle of the first object based on the first object having moved without movement of the electronic device, and

wherein the distances of the feature points of the second object are identified further based on the elevation angle.

16 . The method of claim 15 , wherein the acquiring of the three-dimensional image data of the new terrain feature comprises:

identifying a third object corresponding to a terrain feature included in the three-dimensional map and the image;

at a first location of the electronic device, identifying a first angle between the location of the first object and the feature points of the second object and a first angle between the location of the first object and the feature points of the third object;

identifying a second location of the electronic device based on the electronic device having moved without movement of the first object;

at the second location of the electronic device, identifying a second angle between the location of the first object and the feature points of the second object and a second angle between the location of the first object and the feature points of the third object;

identifying an angle change of the second object based on the first angle and the second angle of the second object;

identifying an angle change of the third object based on the first angle and the second angle of the third object; and

identifying distances between the electronic device and the feature points of the second object based on the distances between the electronic device and the feature points of the third object, the angle change of the second object, and the angle change of the third object,

wherein the acquiring of the three-dimensional image data of the new terrain feature further comprises identifying an elevation angle of the first object by a change in a height of the electronic device based on the electronic device having moved without movement of the first object, and

wherein the distances of the feature points of the second object are identified further based on the identified elevation angle.

17 . One or more non-transitory computer-readable storage media storing computer-executable instructions that, when executed by one or more processors of an electronic device individually or collectively, cause the electronic device to perform operations, the operations comprising:

acquiring an image captured by camera circuitry of the electronic device on a terrain;

acquiring location information of the electronic device corresponding to a place at which the electronic device captured the image;

acquiring a three-dimensional map based on the location information of the electronic device;

identifying, in the image, a first object corresponding to a celestial body and a second object corresponding to a new terrain feature not included in the three-dimensional map;

based on identifying the first object corresponding to the celestial body and the second object corresponding to the new terrain feature not included in the three-dimensional map, acquiring three-dimensional image data of the new terrain feature for updating the three-dimensional map based on information related to the second object identified based on a location of the first object corresponding to the celestial body; and

providing an updated three-dimensional map updated through reflection of the three-dimensional image data.

18 . The one or more non-transitory computer-readable storage media of claim 16 , wherein the providing of the updated three-dimensional map comprises:

updating the three-dimensional map by reflecting the three-dimensional image data generated based on distances and angles of feature points of the second object;

storing the updated three-dimensional map in memory of the electronic device; and

displaying the updated three-dimensional map on a display of the electronic device.

19 . The one or more non-transitory computer-readable storage media of claim 18 , the operations further comprising:

transmitting, through communication circuitry of the electronic device to an external electronic device, the three-dimensional image data to update the three-dimensional map by the external electronic device;

receiving, through the communication circuitry from the external electronic device, the updated three-dimensional map updated by the external electronic device based on the three-dimensional image data; and

storing the updated three-dimensional map in the memory of the electronic device.

20 . The one or more non-transitory computer-readable storage media of claim 19 , the operations further comprising:

transmitting, through the communication circuitry to the external electronic device, information related to the location of the first object, information related to at least one terrain feature included in the image, and the location information of the electronic device to update the three-dimensional map by the external electronic device;

receiving, through the communication circuitry from the external electronic device, the updated three-dimensional map reflecting the three-dimensional image data generated by the external electronic device; and

storing the updated three-dimensional map in the memory of the electronic device,

wherein the information related to the at least one terrain feature comprises a shape image of the second object, a shape image of a third object corresponding to another terrain feature, and identification information of the second object, and

wherein the location information of the electronic device comprises global positioning system (GPS) information and position information.

21 . The one or more non-transitory computer-readable storage media of claim 17 , wherein the acquiring of the three-dimensional image data of the new terrain feature comprises:

identifying a third object corresponding to a terrain feature included in the three-dimensional map and the image;

identifying a second location of the first object based on the first object having moved without movement of the electronic device;

identifying an angle change of feature points of the second object between a first location and a second location of the first object;

identifying an angle change of feature points of the third object between the first location and the second location of the first object; and

identifying distances between the electronic device and the feature points of the second object based on distances between the electronic device and the feature points of the third object, the angle change of the feature points of the second object, and the angle change of the feature points of the third object,

wherein the acquiring of the three-dimensional image data of the new terrain feature further comprises identifying an elevation angle of the first object based on the first object having moved without movement of the electronic device, and

wherein the distances of the feature points of the second object are identified further based on the elevation angle.