IP Library Granted Patent US 10,229,136
Granted Patent B2
US 10,229,136 · App. 15/910,247 · Granted Mar 12, 2019

Visual localization method

Inventors: Mohammad Abu-Alqumsan (Munich, DE); Anas Al-Nuaimi (Munich, DE); Robert Huitl (Munich, DE); Georg Schroth (Munich, DE); Florian Schweiger (Rohrbach, DE); Eckehard Steinbach (Munich, DE)
Assignee: NAVVIS GMBH
G06F17/30259G06F17/3028G06F17/30241G06F17/30247G06K9/6215G06Q30/0623H04W4/025
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,229,136
App. No.
15/910,247
Granted
Mar 12, 2019
Kind
B2
Abstract

There is provided a visual localization method comprising: (a) transmitting data representative of one or more detected visual features from a mobile device to a server; (b) estimating the location of the mobile device at the server based on the visual features received from the mobile device; (c) transmitting reference data associated with the estimated location from the server to the mobile device; and (d) the mobile device determining its location based on the reference data received from the server.

Claims (22)

1. A mobile device pose estimation method comprising:

(a) maintaining, by a server, reference data in a georeferenced database providing a distinctive description of recorded objects;

(b) receiving, by the server, at least one query image captured with a mobile device;

(c) determining, by the server based on the received at least one query image, an approximate position of the mobile device, and a subset of the reference data within a vicinity of said approximate position;

(d) transmitting the subset of the reference data from the server to the mobile device;

(e) storing, by the mobile device, the subset of the reference data;

(f) generating, by the mobile device, visual feature data representative of one or more visual features detected by the mobile device;

(g) estimating, on the mobile device, the pose of the mobile device based on at least the visual feature data and the subset of the reference data;

(h) repeating at least steps (f) and (g) at least twice every time the subset of the reference data is obtained in step (d).

2. The method of claim 1 , wherein determining the approximate position in step c) is based on information taken from content of the at least one query image.

3. The method of claim 2 , wherein said information includes one or more of an exhibit, a store name or a trademark.

4. A mobile device pose estimation method comprising:

(a) maintaining, by a server, reference data in a database providing a distinctive description of recorded objects;

(b) receiving, by the server, information about a context of a mobile device;

(c) determining, by the server based on the received information, a subset of the reference data;

(d) transmitting the subset of the reference data from the server to the mobile device;

(e) storing, by the mobile device, the subset of the reference data;

(f) generating, by the mobile device, visual feature data representative of one or more visual features detected by the mobile device;

(g) estimating, by the mobile device, the pose of the mobile device based on at least the visual feature data and the subset of the reference data;

(h) repeating at least steps (f) and (g) at least twice every time the subset of the reference data is obtained in step (d).

5. The method of claim 4 , wherein said received information includes at least one query image, and determining the subset of the reference data in step c) is based on information taken from content of the at least one query image.

6. The method of claim 5 , wherein said information taken from the content of the at least one query image includes one or more of an exhibit, a store name or a trademark.

Assignments (1)
SECURITY INTEREST Recorded Jun 6, 2025
From: NAVVIS GMBH
To: BANCO SANTANDER S.A.
Reel/Frame 071495/0082 →
Priority Claims (1)
EP 10172403 · Aug 10, 2010 · regional
Continuity (3)
Continuation 15473284 · Mar 29, 2017
Continuation 13816093
Related Publication 20180189327A1 · Jul 5, 2018