IP Library › Granted Patent US 12,284,435
Granted Patent B2
US 12,284,435 · App. 18/183,559 · Granted Apr 22, 2025

Electronic device and server for determining user's position-related information

Inventor: Jaemyeon Lee (Suwon-si, KR)
Assignee: Samsung Electronics Co., Ltd.
H04N23/64G01C21/30G06T7/74H04N23/61H04N23/633G06T2207/30184G06T2207/30244
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,284,435
App. No.
18/183,559
Granted
Apr 22, 2025
Kind
B2
Abstract

An electronic device is provided. The electronic device includes a camera, a display, a memory, a location positioning circuitry, and at least one processor operatively coupled to the camera, the display, the memory, and the location positioning circuitry, wherein the at least one processor may determine a first position and a first direction of a user through the location positioning circuitry, obtain surrounding information about the first position from a map database, generate scan request information including a reference target from the map database on the basis of the surrounding information, display a capture guide on the display such that a capture target corresponding to the reference target is captured with the camera by using the scan request information, determine a second position and a second direction by using the capture target and the reference target, and display the second position and the second direction on the display.

Claims (63)

1. An electronic device comprising:

a camera;

a display;

memory storing instructions;

location positioning circuitry configured to measure a location and a direction of the electronic device; and

one or more processors operably connected to the camera, the display, the memory, and the location positioning circuitry,

wherein the instructions, when executed by the one or more processors individually or collectively, cause the electronic device to:

determine a first place and first direction of a user through the location positioning circuitry,

obtain surrounding information about the first place from a map database,

generate scan request information including a reference target from the map database based on the surrounding information,

display a shooting guide on the display by using the scan request information so as to guide a user of the electronic device to photograph a shooting target corresponding to the reference target using the camera,

extract a feature from the shooting target,

determine a relative place and a relative direction from the shooting target,

match the feature to the reference target,

determine a location of the reference target comprising a place and a direction of the reference target from the map database,

determine a modified geographic place and modified geographic direction based on the location of the reference target, the relative place and the relative direction, and

display the modified geographic place and modified geographic direction on the display.

2. The electronic device of claim 1 ,

wherein the surrounding information is information from the map database included in a range set around the first place, and

wherein the range set is determined according to a location positioning technique for determining the first place.

3. The electronic device of claim 1 , wherein the instructions, when executed by the one or more processors individually or collectively, further cause the electronic device to:

determine priorities of plural reference targets included in the scan request information,

display the shooting guide on the display so as to guide a user of the electronic device to photograph the shooting target corresponding to a reference target having the highest priority to be photographed, and

display, in response to a failure of determining the modified geographic place, the shooting guide on the display in sequence according to a priority order.

4. The electronic device of claim 3 , wherein the instructions, when executed by the one or more processors individually or collectively, further cause the electronic device to:

store, as a preferred reference target, a reference target used when the modified geographic place and modified geographic direction are successfully determined in the memory, and

determine, in case that the preferred reference target is included in the plural reference targets, the priority of the preferred reference target to be high.

5. The electronic device of claim 1 , wherein the surrounding information includes information regarding at least one of a building, a road, a signboard, or a landmark included in the first place.

6. The electronic device of claim 5 , wherein the reference target includes at least one of a boundary between a building and a skyline, a layout of a road, a signboard of a building, or a landmark.

7. The electronic device of claim 6 , wherein the instructions, when executed by the one or more processors individually or collectively, further cause the electronic device to:

compare a height of a building included in the first place with a preset criterion by analyzing the surrounding information, and

generate scan request information including the skyline as a reference target based on the comparison.

8. The electronic device of claim 6 , wherein the instructions, when executed by the one or more processors individually or collectively, further cause the electronic device to:

compare a width of a road included in the first place with a preset criterion by analyzing the surrounding information, and

generate scan request information including a layout of the road as a reference target based on the comparison.

9. The electronic device of claim 6 , wherein the instructions, when executed by the one or more processors individually or collectively, further cause the electronic device to:

identify whether there is a landmark included in the first place by analyzing the surrounding information, and

generate scan request information including the landmark as a reference target based on the identification.

10. The electronic device of claim 6 , wherein the instructions, when executed by the one or more processors individually or collectively, further cause the electronic device to:

compare brightness and darkness of a signboard included in the first place with a preset criterion by analyzing the surrounding information, and

generate scan request information including the signboard of the building as a reference target based on the comparison.

11. The electronic device of claim 1 , wherein the instructions, when executed by the one or more processors individually or collectively, further cause the electronic device to:

determine a relative position and relative direction of the electronic device with respect to the shooting target by using internal information of the camera including focal length, principal point, and skew coefficient, and

determine the modified geographic place and modified geographic direction by applying the relative position and relative direction to the reference target.

12. The electronic device of claim 1 , wherein the instructions, when executed by the one or more processors individually or collectively, further cause the electronic device to:

display the shooting guide by comparing an image being captured by the camera and the reference target in real time.

13. A server comprising:

a server memory storing instructions; and

one or more server processors,

wherein the instructions, when executed by the one or more server processors individually or collectively, cause the server to:

receive a first place from an electronic device to obtain surrounding information about the first place from a map database stored in the server memory,

generate scan request information including a reference target from the map database based on the surrounding information,

transmit the scan request information to the electronic device so as to enable the electronic device to photograph a shooting target corresponding to the reference target by use of the scan request information,

receive the shooting target from the electronic device,

extract a feature from the shooting target,

determine a relative place and a relative direction between the electronic device and the shooting target,

match the feature to the reference target,

determine a location of the reference target comprising a place and a direction of the reference target from the map database,

determine a modified geographic place and modified geographic direction based on the location of the reference target, the relative place and the relative direction, and

transmit the modified geographic place and modified geographic direction to the electronic device.

14. The server of claim 13 ,

wherein the surrounding information includes information regarding at least one of a building, a road, a signboard, or a landmark included in the first place,

wherein the reference target includes at least one of a boundary between a building and a skyline, a layout of a road, a signboard of a building, or a landmark.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 14, 2023
From: LEE, JAEMYEON
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 062978/0171 →
Priority Claims (1)
KR 10-2020-0119700 · Sep 17, 2020 · national
Continuity (2)
Continuation PCTKR2021012520 · Sep 14, 2021
Related Publication 20230224577A1 · Jul 13, 2023
References Cited (19)
US 9208389B2 · Sung et al. · 2015 [cited by applicant]
US 10616478B2 · Jung et al. · 2020 [cited by applicant]
US 20050031330A1 · Nonaka · 2005 [cited by examiner]
US 20050185060A1 · Neven, Sr. · 2005 [cited by applicant]
US 20120105474A1 · Cudalbu · 2012 [cited by examiner]
US 20180202814A1 · Kudrynski et al. · 2018 [cited by applicant]
US 20190174056A1 · Jung · 2019 [cited by examiner]
US 20210134003A1 · Hincapie et al. · 2021 [cited by applicant]
US 20210173095A1 · Kang · 2021 [cited by applicant]
KR 1020060056580A · 2006 [cited by applicant]
KR 1020100041926A · 2010 [cited by applicant]
KR 1020130107318A · 2013 [cited by applicant]
KR 1020150082855A · 2015 [cited by applicant]
KR 1020170015754A · 2017 [cited by applicant]
KR 101898665B1 · 2018 [cited by applicant]
KR 1020190064958A · 2019 [cited by applicant]
KR 1020200012379A · 2020 [cited by applicant]
Jun-Hyuck Im et al., 3D LIDAR based Precise Vehicle Localization Using Vertical Structure Landmarks in an Urban Area, Journal of Institute of Control, Robotics and Systems 23(12), 1116-1125, Dec. 2017. [cited by applicant]
International Search Report dated Dec. 16, 2021, issued in International Patent Application No. PCT/KR2021/012520. [cited by applicant]