IP Library Granted Patent US 10,585,938
Granted Patent B2
US 10,585,938 · App. 16/259,618 · Granted Mar 10, 2020

Visual localization method

Inventors: Mohammad Abu-Alqumsan (Munich, DE); Anas Al-Nuaimi (Munich, DE); Robert Huitl (Munich, DE); Georg Schroth (Munich, DE); Florian Schweiger (Rohrbach, DE); Eckehard Steinbach (Munich, DE)
Assignee: NavVis GmbH
G06F16/5854G06F16/29G06F16/51G06F16/583G06K9/6215G06Q30/0623H04W4/025
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,585,938
App. No.
16/259,618
Granted
Mar 10, 2020
Kind
B2
Abstract

There is provided a visual localization method comprising: (a) transmitting data representative of one or more detected visual features from a mobile device to a server; (b) estimating the location of the mobile device at the server based on the visual features received from the mobile device; (c) transmitting reference data associated with the estimated location from the server to the mobile device; and (d) the mobile device determining its location based on the reference data received from the server.

Claims (20)

1. A visual localization method comprising:

(a) maintaining, by a server, reference data that can be associated with a plurality of possible locations of a mobile device;

(b) receiving, by the server, a continuous sequence of query images captured with the mobile device;

(c) determining, by the server based on the received sequence of query images, an approximate position of the mobile device, and a subset of the reference data within a vicinity of said approximate position;

(d) transmitting the subset of the reference data from the server to the mobile device;

(e) storing, by the mobile device, the subset of the reference data;

(f) generating, by the mobile device, visual feature data representative of one or more visual features detected by the mobile device;

(g) determining, by the mobile device, location data representative of a location of the mobile device based on at least the visual feature data and the subset of the reference data.

2. The method of claim 1 , wherein determining the approximate position in step c) is based on information taken from content of the received sequence of query images.

3. The method of claim 2 , wherein said information includes one or more of an exhibit, a store name or a trademark.

4. A mobile device pose estimation method comprising:

(a) maintaining, by a server, reference data in a database providing a distinctive description of recorded objects;

(b) receiving, by the server, information about a context of a mobile device;

(c) determining, by the server, based on the received information, a subset of the reference data;

(d) transmitting the subset of the reference data from the server to the mobile device;

(e) storing, by the mobile device, the subset of the reference data;

(f) generating, by the mobile device, visual feature data representative of one or more visual features detected by the mobile device;

(g) estimating, by the mobile device, the pose of the mobile device based on at least the visual feature data and the subset of the reference data with the aid of visual odometry.

5. The method of claim 4 , wherein said received information includes at least one query image, and determining the subset of the reference data in step c) is based on information taken from content of the at least one query image.

6. The method of claim 5 , wherein said information taken from the content of the at least one query image includes one or more of an exhibit, a store name or a trademark.

Assignments (1)
SECURITY INTEREST Recorded Jun 6, 2025
From: NAVVIS GMBH
To: BANCO SANTANDER S.A.
Reel/Frame 071495/0082 →
Priority Claims (1)
EP 10172403 · Aug 10, 2010 · regional
Continuity (4)
Continuation 15910247 · Mar 2, 2018
Continuation 15473284 · Mar 29, 2017
Continuation 13816093
Related Publication 20190155837A1 · May 23, 2019