IP Library Granted Patent US 8,994,851
Granted Patent B2
US 8,994,851 · App. 11/890,794 · Granted Mar 31, 2015

Displaying image data and geographic element data

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,994,851
App. No.
11/890,794
Granted
Mar 31, 2015
Kind
B2
Abstract

A mobile computing device includes a housing, a camera, a display, a memory, and a processing circuit. The housing is configured to be carried by a user while in use. The camera is configured to output image data. The memory is configured to store geographic element data representing one or more geographic elements. The processing circuit is configured to receive the geographic element data for the plurality of geographic elements. The processing circuit is configured to determine a camera orientation. The processing circuit is configured to concurrently display the image data and geographic element data for the plurality of geographic elements on the display.

Claims (58)

1. A mobile computing device comprising:

a camera to capture video data;

a display to output the video data;

a position determination circuit to determine a current position of the mobile computing device;

a processing circuit; and

one or more memory resources storing instructions that, when executed by the processing circuit, cause the mobile computing device to:

identify geographic elements in the video data;

based on the current position and an orientation of the camera, determine a field of view of the camera;

superimpose, on the video data, geographic indicators corresponding to the geographic elements; and

reposition the geographical indicators on the video data based on a change in the field of view of the camera by:

partitioning each frame of the video data into a plurality of blocks;

calculating a correlation between a first block in a first frame of the video data with each of a number of neighboring blocks that surround the first block in a subsequent frame of the video data;

identifying the neighboring block having the highest correlation with the first block in the first frame of the video data;

determining a set of motion vectors corresponding to the identified neighboring block to identify, for the subsequent frame of the video data, the change in the field of view of the camera;

creating a new frame of geographical indicators based on the first frame and the set of motion vectors; and

superimposing the new frame on the subsequent frame of the video data.

2. The mobile computing device of claim 1 , wherein the geographic indicators comprise textual data.

3. The mobile computing device of claim 1 , wherein execution of the instructions to superimpose the geographic indicators causes the mobile computing device to display distinguishing indicia which distinguishes at least one geographic element corresponding to a first indicator of the geographic indicators from another geographic element corresponding to a second indicator of the geographic indicators.

4. The mobile computing device of claim 3 , wherein the distinguishing indicia comprises one or more of a distinguishing color, a distinguishing contrast or brightness, or a blinking indicator.

5. The mobile computing device of claim 1 , further comprising a telephony transceiver for telephony communication and an operating system to store personal information management applications and to synchronize personal information management data with a remote server.

6. The mobile computing device of claim 1 , wherein the position determination circuit comprises a global positioning system receiver.

7. The mobile computing device of claim 1 , wherein the geographic indicators each comprise at least one of a name, an address, location information, or coordinates of a corresponding geographic element, and wherein the geographic elements include one or more buildings, streets, points of interest, waypoints, bodies of water, bridges, sculptures, monuments, parks, or paths.

8. A method for operating a mobile computing device, the method performed by one or more processors of the mobile computing device and comprising:

capturing video data through a camera of the mobile computing device;

presenting the video data on a display of the mobile computing device;

determining a current position of the mobile computing device and an orientation of the camera;

identifying geographic elements in the video data;

based on the current position and the orientation of the camera, determining a field of view of the camera;

superimposing, on the video data, geographic indicators corresponding to the geographic elements; and

repositioning the geographical indicators on the video data based on a change in the field of view of the camera by:

partitioning each frame of the video data into a plurality of blocks;

calculating a correlation between a first block in a first frame of the video data with each of a number of neighboring blocks that surround the first block in a subsequent frame of the video data;

identifying the neighboring block having the highest correlation with the first block in the first frame of the video data;

determining a set of motion vectors corresponding to the identified neighboring block to identify, for the subsequent frame of the video data, the change in the field of view of the camera;

creating a new frame of geographical indicators based on the first frame and the set of motion vectors; and

superimposing the new frame on the subsequent frame of the video data.

9. The method of claim 8 , wherein the geographic indicators comprise textual data.

10. The method of claim 8 , wherein superimposing the geographic indicators includes displaying distinguishing indicia which distinguishes at least one geographic element corresponding to a first indicator of the geographic indicators from another geographic element corresponding to a second indicator of the geographic indicators.

11. The method of claim 10 , wherein the distinguishing indicia comprises one or more of a distinguishing color, a distinguishing contrast or brightness, or a blinking indicator.

12. The method of claim 8 , wherein the geographic indicators each comprise at least one of a name, an address, location information, or coordinates of a corresponding geographic element, and wherein the geographic elements include one or more buildings, streets, points of interest, waypoints, bodies of water, bridges, sculptures, monuments, parks, or paths.

13. A non-transitory computer readable medium storing instructions that, when executed by one or more processors of a mobile computing device, cause the mobile computing device to:

capture video data through a camera of the mobile computing device;

present the video data on a display of the mobile computing device;

determine a current position of the mobile computing device and an orientation of the camera;

identify geographic elements in the video data;

based on the current position and the orientation of the camera, determine a field of view of the camera;

superimpose, on the video data, geographic indicators corresponding to the geographic elements; and

reposition the geographical indicators on the video data based on a change in the field of view of the camera by:

partitioning each frame of the video data into a plurality of blocks;

calculating a correlation between a first block in a first frame of the video data with each of a number of neighboring blocks that surround the first block in a subsequent frame of the video data;

identifying the neighboring block having the highest correlation with the first block in the first frame of the video data;

determining a set of motion vectors corresponding to the identified neighboring block to identify, for the subsequent frame of the video data, the change in the field of view of the camera;

creating a new frame of geographical indicators based on the first frame and the set of motion vectors; and

superimposing the new frame on the subsequent frame of the video data.

14. The non-transitory computer readable medium of claim 13 , wherein the geographic indicators comprise textual data.

15. The non-transitory computer readable medium of claim 13 , wherein execution of the instructions to superimpose the geographic indicators causes the mobile computing device to display distinguishing indicia which distinguishes at least one geographic element corresponding to a first indicator of the geographic indicators from another geographic element corresponding to a second indicator of the geographic indicators.

16. The non-transitory computer readable medium of claim 15 , wherein the distinguishing indicia comprises one or more of a distinguishing color, a distinguishing contrast or brightness, or a blinking indicator.

17. The non-transitory computer readable medium of claim 13 , wherein the geographic indicators each comprise at least one of a name, an address, location information, or coordinates of a corresponding geographic element, and wherein the geographic elements include one or more buildings streets, points of interest, waypoints, bodies of water, bridges, sculptures, monuments, parks, or paths.

Assignments (8)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 28, 2014
From: HEWLETT-PACKARD COMPANY; HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.; PALM, INC.
To: QUALCOMM INCORPORATED
Reel/Frame 032132/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2013
From: PALM, INC.
To: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
Reel/Frame 031837/0239 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2013
From: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
To: PALM, INC.
Reel/Frame 031837/0544 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2013
From: PALM, INC.
To: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
Reel/Frame 031837/0659 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 3, 2013
From: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
To: PALM, INC.
Reel/Frame 030341/0459 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2010
From: PALM, INC.
To: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
Reel/Frame 025204/0809 →
RELEASE OF SECURITY INTEREST Recorded Jul 6, 2010
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: PALM, INC.
Reel/Frame 024630/0474 →
SECURITY AGREEMENT Recorded Jan 4, 2008
From: PALM, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 020319/0568 →