Granted Patent B2

US 12,374,042 · App. 18/188,870 · Granted Jul 29, 2025

Inventor: Sangbeom Nam (Suwon-si, KR)

Assignee: Samsung Electronics Co., Ltd.

G06T17/05G06T7/74G06T19/00G06V10/761G06V20/176G06V20/62G06T2200/24G06T2207/20092G06T2207/30184

Abstract

Claims (68)

1. An electronic device comprising:

a camera module;

a communication circuit;

a memory; and

a processor,

wherein the processor is configured to:

execute a first application using the camera module,

obtain a first image through the camera module while the first application operates,

recognize an object of a specified type in the first image,

obtain location information of where the first image is obtained,

determine a first virtual point corresponding to the location information on a three-dimensional (3D) virtual map,

obtain a second image corresponding to the first image at the first virtual point,

update data of the 3D virtual map on the object based on a comparison between the first image and the second image, and

determine an area where the object is placed on the 3D virtual map, based on the comparison between the first image and the second image.

2. The electronic device of claim 1 , wherein the processor is further configured to:

receive a user input related to consent to use of the first image through an execution screen of the first application, and

update the data by using the first image in response to the user input.

3. The electronic device of claim 1 , wherein the processor is further configured to:

identify a first update condition for an object matched in the first image and the second image, and

update the data when the first update condition is satisfied.

4. The electronic device of claim 3 , wherein the first update condition includes a condition in which a ratio of a number of matched virtual objects in the first image to a number of virtual objects observable at the first virtual point is greater than or equal to a specified first reference value.

5. The electronic device of claim 1 , wherein the processor is further configured to:

recognize a first text in the first image,

extract a second text from the 3D virtual map,

identify a second update condition related to a matching ratio between the first text and the second text, and

update the data when the second update condition is satisfied.

6. The electronic device of claim 1 , wherein the processor is further configured to:

when a shape of the area is not stored in the data of the 3D virtual map, determine the shape of the area by using the first image.

7. The electronic device of claim 1 , wherein the processor is further configured to:

determine the data by comparing a first feature vector of the first image with a second feature vector of the second image.

8. The electronic device of claim 7 , wherein the processor is further configured to:

determine the data such that a similarity between the first feature vector and the second feature vector is maximized.

9. The electronic device of claim 1 ,

wherein the object of the specified type includes a building, and

wherein the data includes a height of the building.

10. The electronic device of claim 1 , wherein the processor is further configured to:

store the data of the 3D virtual map as a text type database in the memory.

11. The electronic device of claim 1 , wherein the processor is further configured to:

display a user interface of requesting an update of the data on at least a portion of an execution screen of the first application.

12. The electronic device of claim 1 , wherein the processor is further configured to:

obtain the second image by disposing a virtual camera having same setting information as setting information of the camera module at the first virtual point.

13. The electronic device of claim 1 , wherein the processor is further configured to:

transmit the location information to an external server, and

receive a text-type database of the 3D virtual map from the external server.

14. A method for updating a three-dimensional (3D) virtual map performed by an electronic device, the method comprising:

executing a first application by using a camera module of the electronic device;

obtaining a first image through the camera module while the first application operates;

recognizing an object of a specified type in the first image;

obtaining location information of where the first image is obtained;

determining a first virtual point corresponding to the location information on a 3D virtual map;

obtaining a second image corresponding to the first image at the first virtual point;

updating data of the 3D virtual map on the object based on a comparison between the first image and the second image; and

determining an area where the object is placed on the 3D virtual map, based on the comparison between the first image and the second image.

15. The method of claim 14 , further comprising:

receiving a user input related to consent to use of the first image through an execution screen of the first application, and

updating the data by using the first image in response to the user input.

16. The method of claim 14 , further comprising:

identifying a first update condition for an object matched in the first image and the second image, and

updating the data when the first update condition is satisfied.

17. The method of claim 14 , further comprising:

recognizing a first text in the first image,

extracting a second text from the 3D virtual map,

identifying a second update condition related to a matching ratio between the first text and the second text, and

updating the data when the second update condition is satisfied.

18. The method of claim 14 , further comprising:

when a shape of the area is not stored in the data of the 3D virtual map, determining the shape of the area by using the first image.

19. The method of claim 14 , wherein the object of the specified type includes a building, and

wherein the data includes a height of the building.

Assignments (1)

Priority Claims (1)

Continuity (2)

References Cited (36)