IP Library › Granted Patent US 11,474,193
Granted Patent B2
US 11,474,193 · App. 17/116,771 · Granted Oct 18, 2022

Camera calibration for localization

Inventors: Landis Huffman (Chicago, IL); Joshua Michael Finken (Park City, UT); Amey Aroskar (North Aurora, IL); Sumedh Rasal (Chicago, IL)
Assignee: HERE Global B.V.
G01S5/16H04N5/23222H04N5/232939G01C21/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,474,193
App. No.
17/116,771
Granted
Oct 18, 2022
Kind
B2
Abstract

An apparatus and/or method includes localization of a mobile device. The localization technique is calibrated by prompting the mobile device for a collection of static position images for an image-based localization service, sending static position images to the image-based localization service, receiving, for the static position images, a plurality of localization values from the image-based localization service, calculating a correction for the plurality of localization values, and providing a location for the mobile device based on the correction for the plurality of localization values.

Claims (51)

1. A method for localization of a mobile device, the method comprising:

determining an error for an initial set of images collected for an image-based localization service;

prompting the mobile device for a collection of static position images in response to the error for the initial set of images collected for the image-based localization service;

sending the static position images to the image-based localization service;

receiving, for the static position images, a plurality of localization values from the image-based localization service;

calculating a correction for the plurality of localization values; and

providing a location for the mobile device based on the correction for the plurality of localization values.

2. The method of claim 1 , further comprising:

receiving at least two positions for the mobile device in initial localization data; and

comparing the at least two positions for the mobile device, wherein prompting the mobile device is based on the comparison.

3. The method of claim 2 , further comprising:

calculating a difference between the at least two positions for the mobile device; and

comparing the difference between the at least two positions to a threshold, wherein the mobile device is prompted for the collection of static position images based on the comparison.

4. The method of claim 1 , wherein prompting the mobile device for the collection of static position images comprises:

providing an instruction to remain stationary; and

providing an instruction to pan the mobile device for the collection of static position images.

5. The method of claim 1 , wherein prompting the mobile device for the collection of static position images comprises:

providing a leveling indicator for the collection of the static position images.

6. The method of claim 1 , wherein the image-based localization service uses a point cloud for the localization of the mobile device.

7. The method of claim 1 , further comprising:

receiving, for the static position images, a plurality of pose values from the image-based localization service, wherein the correction for the plurality of localization values is based on the plurality of pose values.

8. The method of claim 1 , further comprising:

receiving, for the static position images, a plurality of pose values from the image-based localization service; and

calculating a variation in the plurality of pose values, wherein the correction for the plurality of localization values is based on the variation of the plurality of pose values.

9. The method of claim 1 , further comprising:

fitting a line to the plurality of localization values from the image-based localization service, wherein the correction for the plurality of localization values is based on the line.

10. The method of claim 1 , further comprising:

calculating a radius for the plurality of localization values from the image-based localization service, wherein the correction for the plurality of localization values is based on the radius.

11. The method of claim 1 , wherein the correction for the plurality of localization values is a zoom value associated with the static position images.

12. The method of claim 1 , wherein the correction for the plurality of localization values is a focal length value for the image-based localization service.

13. The method of claim 1 , wherein the mobile device is prompted for the collection of static position images based on a user input.

14. An apparatus for calibration of a localization technique, the apparatus comprising:

a camera configured to collect an initial set of images for localization with a visual positioning service;

a controller configured to identify an error in initial localization data received from the visual positioning service; and

a user interface configured to prompt collection of static position images for the visual positioning service in response to the error,

wherein the controller is configured to determine a correction for a plurality of localization values received from the visual positioning service based on the static position images.

15. The apparatus of claim 14 , further comprising:

position circuitry configured to collect position data associated with the initial set of images, wherein the error identified from a comparison of the initial localization data received from the visual positioning service with the position data.

16. The apparatus of claim 14 , wherein the controller is configured to calculate a location for the apparatus based on the correction for the plurality of localization values.

17. The apparatus of claim 14 , wherein a calibration factor for the static position images is determined based on a variance of the initial localization data for the static position images.

18. The apparatus of claim 14 , wherein a calibration factor for the static position images is determined based on a curve fit to the initial localization data for the static position images.

19. A non-transitory computer readable medium including instructions that when executed are configured to perform:

determining an error for an initial set of images collected for an image-based localization service;

prompting a mobile device for a collection of static position images in response to the error for the initial set of images collected for the image-based localization service;

sending the static position images to the image-based localization service;

receiving, for the static position images, a plurality of localization values from the image-based localization service;

calculating a correction for the plurality of localization values; and

providing a location for the mobile device based on the correction for the plurality of localization values.

20. The non-transitory computer readable medium of claim 19 , wherein prompting the mobile device for the collection of static position images comprises:

providing an instruction to remain stationary; and

providing an instruction to pan the mobile device for the collection of static position images.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 3, 2021
From: HUFFMAN, LANDIS; FINKEN, JOSHUA MICHAEL; AROSKAR, AMEY; RASAL, SUMEDH
To: HERE GLOBAL B.V.
Reel/Frame 055133/0391 →
Continuity (1)
Related Publication 20220179038A1 · Jun 9, 2022