IP Library › Granted Patent US 12,249,109
Granted Patent B2
US 12,249,109 · App. 17/607,265 · Granted Mar 11, 2025

Electronic device for acquiring location information on basis of image, and method for operating same

Inventors: Shakira Arguelles (Rizal, PH); Mark Andrew Dancel Bautista (Rizal, PH); Justin Adrian Pineda Pelayo (Rizal, PH); Jose Ricardo Iv Ramos Ruiz (Rizal, PH); Kyle Benedict G Sy (Rizal, PH); Angelica Tabang Zalameda (Rizal, PH)
Assignee: Samsung Electronics Co., Ltd
G06V10/462G01C21/3623G06T7/73G06V20/10G06V20/50
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,249,109
App. No.
17/607,265
Granted
Mar 11, 2025
Kind
B2
Abstract

Disclosed is a method, performed by an electronic device, of obtaining location information of the electronic device, the method including obtaining at least one image captured by the electronic device, identifying a plurality of feature points included in the at least one image, obtaining a plurality of distances between the plurality of feature points and the electronic device, obtaining location information of the plurality of feature points, generating a plurality of circles having the obtained distances as radii and having the plurality of feature points as centers, based on the location information of the plurality of feature points, and obtaining location information of the electronic device based on a point where the plurality of circles overlap each other.

Claims (46)

1. A method, performed by an electronic device, of obtaining location information of the electronic device, the method comprising:

capturing, by the electronic device, at least one image;

identifying a plurality of feature points included in the at least one image based on a landmark identified in the at least one image;

obtaining a plurality of distances between feature points of the plurality of feature points and the electronic device based on features of an image sensor for capturing the at least one image, information about the plurality of feature points obtained in the at least one image, and location information of the plurality of feature points based on pre-stored information about the landmark including text information in the landmark;

generating a plurality of circles having the obtained plurality of distances as radii and having the plurality of feature points as centers, respectively; and

obtaining location information of the electronic device based on a point where the plurality of circles overlap each other,

wherein obtaining the plurality of distances between the plurality of feature points and the electronic device further comprises:

selecting at least two feature points from among the plurality of feature points;

obtaining a second distance indicating a distance between the at least two feature points, based on pre-stored information about feature point locations;

obtaining a third distance indicating the distance between the at least two feature points, by analyzing the at least one image; and

determining whether to use the at least two feature points to obtain the location information of the electronic device, based on a difference between the second distance and the third distance.

2. The method of claim 1 , wherein a point where the plurality of circles overlap each other within a preset error range is obtained as the location information of the electronic device.

3. The method of claim 1 , wherein identifying the plurality of feature points comprises:

setting a region of interest based on location information detected by a location sensor of the electronic device;

identifying at least one landmark included in the at least one image from among one or more landmarks included in the region of interest; and

identifying the plurality of feature points in the identified at least one landmark.

4. The method of claim 3 , wherein the region of interest is within a first distance of the location information detected by the location sensor of the electronic device, and

wherein the first distance is determined based on a longest distance among distances between the electronic device and objects included in the at least one image.

5. The method of claim 1 , wherein the plurality of distances between the plurality of feature points and the electronic device are obtained based on at least one of information about a size of an image sensor used to capture the at least one image, information about a focal length of the at least one image, a height of a landmark including at least two feature points of the plurality of feature points, a frame-based height of the landmark, and a frame-based height of the at least one image.

6. The method of claim 1 , wherein obtaining the plurality of distances between the plurality of feature points and the electronic device further comprises:

obtaining distances between the electronic device and the at least two feature points based on the determination of whether to use the at least two feature points to obtain the location information of the electronic device.

7. The method of claim 6 , wherein the at least two feature points are used to obtain the location information of the electronic device when the difference between the second distance and the third distance is less than or equal to a reference value.

8. A non-transitory computer-readable recording medium having recorded thereon a computer program for executing the method of claim 1 .

9. An electronic device for obtaining location information of the electronic device, the electronic device comprising:

a camera configured to capture at least one image;

a memory configured to store data required to obtain location information of the electronic device; and

at least one processor configured to:

identify a plurality of feature points included in the at least one image, based on a landmark identified in the at least one image,

obtain a plurality of distances between feature points of the plurality of feature points and the electronic device based on features of an image sensor for capturing the at least one image, information about the plurality of feature points obtained in the at least one image, and location information of the plurality of feature points based on pre-stored information about the landmark including text information in the landmark,

generate a plurality of circles having the obtained plurality of distances as radii and having the plurality of feature points as centers, respectively,

obtain location information of the electronic device based on a point where the plurality of circles overlap each other,

select at least two feature points from among the plurality of feature points,

obtain a second distance indicating a distance between the at least two feature points, based on pre-stored information about feature point locations,

obtain a third distance indicating the distance between the at least two feature points, by analyzing the at least one image, and

determine whether to use the at least two feature points to obtain the location information of the electronic device, based on a difference between the second distance and the third distance.

10. The electronic device of claim 9 , wherein a point where the plurality of circles overlap each other within a preset error range is obtained as the location information of the electronic device.

11. The electronic device of claim 9 , wherein the at least one processor is further configured to:

set a region of interest based on location information detected by a location sensor of the electronic device;

identify at least one landmark included in the at least one image from among one or more landmarks included in the region of interest; and

identify the plurality of feature points in the identified at least one landmark.

12. The electronic device of claim 11 , wherein the region of interest is within a first distance of the location information detected by the location sensor of the electronic device, and

wherein the first distance is determined based on a longest distance among distances between the electronic device and objects included in the at least one image.

13. The electronic device of claim 9 , wherein the plurality of distances between the plurality of feature points and the electronic device are obtained based on at least one of information about a size of an image sensor used to capture the at least one image, information about a focal length of the at least one image, a height of a landmark including the feature points, a frame-based height of the landmark, and a frame-based height of the at least one image.

14. The electronic device of claim 9 , wherein the at least one processor is further configured to:

obtain distances between the electronic device and the at least two feature points based on the determination of whether to use the at least two feature points to obtain the location information of the electronic device.

15. The electronic device of claim 14 , wherein the at least two feature points are determined to be used to obtain the location information of the electronic device, when the difference between the second distance and third distance is less than or equal to a reference value.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 29, 2021
From: ARGUELLES, SHAKIRA; BAUTISTA, MARK ANDREW DANCEL; PELAYO, JUSTIN ADRIAN PINEDA; RUIZ, JOSE RICARDO IV RAMOS; SY, KYLE BENEDICT G; ZALAMEDA, ANGELICA TABANG
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 057960/0320 →
Priority Claims (1)
PH 1-2019-050076 · May 6, 2019 · national
Continuity (1)
Related Publication 20220187092A1 · Jun 16, 2022
References Cited (79)
US 6133947A · Mikuni · 2000 [cited by applicant]
US 7983691B1 · Wong · 2011 [cited by examiner]
US 9521521B2 · Hillary et al. · 2016 [cited by applicant]
US 9542770B1 · Lininger · 2017 [cited by applicant]
US 11734570B1 · Kurz · 2023 [cited by examiner]
US 20020059207A1 · Shimazu · 2002 [cited by examiner]
US 20050094280A1 · Ahn · 2005 [cited by examiner]
US 20070018974A1 · Fujiwara · 2007 [cited by examiner]
US 20070179705A1 · Asai · 2007 [cited by examiner]
US 20090237269A1 · Okugi · 2009 [cited by examiner]
US 20090303077A1 · Onome et al. · 2009 [cited by applicant]
US 20110123135A1 · Hsieh · 2011 [cited by examiner]
US 20110242311A1 · Miyajima · 2011 [cited by examiner]
US 20110242319A1 · Myajima · 2011 [cited by applicant]
US 20110243455A1 · Miyajima · 2011 [cited by examiner]
US 20110243457A1 · Miyajima · 2011 [cited by examiner]
US 20110246027A1 · Miyajima · 2011 [cited by examiner]
US 20110282988A1 · Wang · 2011 [cited by examiner]
US 20110285842A1 · Davenport · 2011 [cited by examiner]
US 20110299736A1 · Choi · 2011 [cited by examiner]
US 20130322767A1 · Chao · 2013 [cited by examiner]
US 20140037138A1 · Sato · 2014 [cited by examiner]
US 20140104425A1 · Kiyono · 2014 [cited by examiner]
US 20140125588A1 · Wei · 2014 [cited by examiner]
US 20140160249A1 · Ro · 2014 [cited by examiner]
US 20140257688A1 · Chao · 2014 [cited by examiner]
US 20140267775A1 · Lablans · 2014 [cited by examiner]
US 20150158429A1 · Bort · 2015 [cited by examiner]
US 20150181548A1 · Varoglu · 2015 [cited by examiner]
US 20160335385A1 · Ho · 2016 [cited by examiner]
US 20170061527A1 · Vakilian · 2017 [cited by examiner]
US 20170096106A1 · Higuchi et al. · 2017 [cited by applicant]
US 20170264919A1 · Amine · 2017 [cited by examiner]
US 20170345311A1 · Sugiura · 2017 [cited by examiner]
US 20180005073A1 · Kawano · 2018 [cited by examiner]
US 20180057030A1 · Puttagunta et al. · 2018 [cited by applicant]
US 20180061069A1 · Higaki · 2018 [cited by examiner]
US 20180061075A1 · Kawano · 2018 [cited by examiner]
US 20180067187A1 · Oh · 2018 [cited by examiner]
US 20180238691A1 · Cui et al. · 2018 [cited by applicant]
US 20190004282A1 · Park · 2019 [cited by examiner]
US 20190041523A1 · Muramatsu · 2019 [cited by examiner]
US 20190164313A1 · Ma · 2019 [cited by examiner]
US 20190197717A1 · Cho · 2019 [cited by examiner]
US 20190285754A1 · van Diggelen · 2019 [cited by examiner]
US 20190291726A1 · Shalev-Shwartz · 2019 [cited by examiner]
US 20190318498A1 · Yoshikawa · 2019 [cited by examiner]
US 20190356849A1 · Sapienza · 2019 [cited by examiner]
US 20200082170A1 · Kwon · 2020 [cited by examiner]
US 20200250846A1 · Oka · 2020 [cited by examiner]
US 20200279392A1 · Shamir · 2020 [cited by examiner]
US 20210240762A1 · Mayster · 2021 [cited by examiner]
CN 104869585A · 2015 [cited by examiner]
CN 109961458A · 2019 [cited by examiner]
EP 1898291A1 · 2008 [cited by examiner]
EP 2372310A2 · 2011 [cited by examiner]
EP 2372605A2 · 2011 [cited by examiner]
FR 3061288 · 2018 [cited by applicant]
JP 2011227037 · 2011 [cited by applicant]
JP 2013088348A · 2013 [cited by examiner]
KR 1020120116202 · 2012 [cited by applicant]
KR 1020150019085 · 2015 [cited by applicant]
KR 101706627 · 2017 [cited by applicant]
KR 101878685 · 2018 [cited by applicant]
WO WO2012091326 · 2012 [cited by applicant]
WO WO2014092193A1 · 2014 [cited by examiner]
WO WO2015194501A1 · 2015 [cited by examiner]
KR20120116202A.FOR. English.translation.pdf, Kim et al., Method of Location Recognition Using Mobile Terminal Andthereof Apparatus (Year: 2012). [cited by examiner]
PH Examination Report dated Jun. 16, 2020 issued in counterpart application No. 1-2019-050076, 13 pages. [cited by applicant]
Hang Chu et al., “GPS Refinement and Camera Orientation Estimation From a Single Image and a 2D Map”, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops, Jun. 23, 2014, 8 pages. [cited by applicant]
European Search Report dated Apr. 28, 2022 issued in counterpart application No. 20801462.1-1207, 10 pages. [cited by applicant]
What is GNSS?, EU Agency for the Space Programme, HTTPS://www.GSA.EUROPA.EU/EUROPEAN-GNSS/WHAT-GNSS, 2016, 4 pages. [cited by applicant]
gps.gov, “GPS Applications”, https://www.gps.gov/applications/, Nov. 25, 2014, 1 page. [cited by applicant]
gps.gov, “GPS Accuracy”, 2021, https://www.gps.gov/systems/gps/performance/accuracy/#how-accurate, 3 pages. [cited by applicant]
M. Wright, M. Russel, J. Brockhaus, “Myth Busted: Civilian GPS Receivers Actually do Have Access to the L2 Frequency”, 2011, 3 pages. [cited by applicant]
European Global Navigation Satellite Systems Agency, “World's First Dual-frequency GNSS Smartphone hits the Market”, Jun. 4, 2018, 6 pages. [cited by applicant]
Quasi-Zenith Satellite System (QZSS), “List of Positioning Satellites”, https://qzss.go.jp/en/technical/satellites/index.html, Nov. 24, 2021, 9 pages. [cited by applicant]
International Search Report dated May 12, 2020 issued in counterpart application No. PCT/KR2020/001327, 15 pages. [cited by applicant]
European Search Report dated Mar. 13, 2024 issued in counterpart application No. 20801462.1-1207, 4 pages. [cited by applicant]