IP Library Granted Patent US 10,956,489
Granted Patent B2
US 10,956,489 · App. 16/775,850 · Granted Mar 23, 2021

Visual localization method

Inventors: Mohammad Abu-Alqumsan (Munich, DE); Anas Al-Nuaimi (Munich, DE); Robert Huitl (Munich, DE); Georg Schroth (Munich, DE); Florian Schweiger (Rohrbach, DE); Eckehard Steinbach (Munich, DE)
Assignee: NavVis GmbH
G06F16/5854G06F16/29G06F16/51G06F16/583G06K9/6215G06Q30/0623H04W4/025
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,956,489
App. No.
16/775,850
Granted
Mar 23, 2021
Kind
B2
Abstract

There is provided a visual localization method comprising: (a) transmitting data representative of one or more detected visual features from a mobile device to a server; (b) estimating the location of the mobile device at the server based on the visual features received from the mobile device; (c) transmitting reference data associated with the estimated location from the server to the mobile device; and (d) the mobile device determining its location based on the reference data received from the server.

Claims (20)

1. A visual localization method comprising:

(a) maintaining, by a server, reference data that can be associated with a plurality of possible locations of a mobile device;

(b) receiving, by the server, information about a context of the mobile device;

(c) periodically determining, by the server based on the received information, approximate positions of the mobile device, and adaptive subsets of the reference data within vicinities of said approximate positions;

(d) periodically pushing the adaptive subsets of the reference data from the server to the mobile device;

(e) storing, by the mobile device, at least a portion of the adaptive subsets of the reference data received by the mobile device;

(f) generating, by the mobile device, using interest points tracked over multiple frames recorded by the mobile device, feature data representative of one or more features detected by the mobile device;

(g) determining, by the mobile device, location data representative of a location of the mobile device based on at least the feature data and the stored adaptive subsets of the reference data.

2. The method of claim 1 , wherein said received information includes at least one query image, and determining the adaptive subsets of the reference data in step c) is based on information taken from content of the at least one query image.

3. The method of claim 2 , wherein said information taken from the content of the at least one query image includes one or more of an exhibit, a store name or a trademark.

4. A mobile device pose estimation method comprising:

(a) maintaining, by a server, reference data in a database providing a distinctive description of recorded objects;

(b) receiving, by the server, information about a context of a mobile device;

(c) periodically determining, by the server, based on the received information, adaptive subsets of the reference data;

(d) periodically pushing the adaptive subsets of the reference data from the server to the mobile device;

(e) storing, by the mobile device, at least a portion of the adaptive subsets of the reference data;

(f) generating, by the mobile device, using interest points tracked over multiple frames recorded by the mobile device, feature data representative of one or more features detected by the mobile device;

(g) estimating, by the mobile device, the pose of the mobile device based on at least the feature data and the stored adaptive subsets of the reference data.

5. The method of claim 4 , wherein said received information includes at least one query image, and determining the adaptive subsets of the reference data in step c) is based on information taken from content of the at least one query image.

6. The method of claim 5 , wherein said information taken from the content of the at least one query image includes one or more of an exhibit, a store name or a trademark.

Assignments (1)
SECURITY INTEREST Recorded Jun 6, 2025
From: NAVVIS GMBH
To: BANCO SANTANDER S.A.
Reel/Frame 071495/0082 →
Priority Claims (1)
EP 10172403 · Aug 10, 2010 · regional
Continuity (5)
Continuation 16259618 · Jan 28, 2019
Continuation 15910247 · Mar 2, 2018
Continuation 15473284 · Mar 29, 2017
Continuation 13816093
Related Publication 20200167382A1 · May 28, 2020