IP Library Granted Patent US 9,916,673
Granted Patent B2
US 9,916,673 · App. 15/295,749 · Granted Mar 13, 2018

Method and apparatus for rendering a perspective view of objects and content related thereto for location-based services on mobile device

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,916,673
App. No.
15/295,749
Granted
Mar 13, 2018
Kind
B2
Abstract

A method including causing, at least in part, rendering of a perspective view showing one or more objects in a field of view. The method further including retrieving content associated with an object of the one or more objects in the field of view, and causing, at least in part, rendering of a graphic representation relating to the content on a surface of the object visible in the perspective view in a user interface for a location-based service of a mobile device.

Claims (76)

1. A method comprising:

rendering a perspective view showing one or more objects in a field of view;

rendering a plan view of a map showing at least the one or more objects in the field of view, wherein the perspective and plan views are rendered simultaneously;

retrieving content associated with an object of the one or more objects in the field of view;

rendering a graphic representation relating to the content on a surface of the object visible in the perspective view in a user interface for a location-based service of a mobile device;

determining a perspective of the rendering of the perspective view in relation to the one or more objects;

determining whether a rendering of a distant object is obstructed by a rendering of another object in the perspective view;

omitting a graphic representation relating to content associated with the distant object from the perspective view when the distant object is obstructed by the rendering of another object in the perspective view;

determining an optimal image of the one or more objects for the perspective view from real-time images and pre-stored images; and

rendering of the perspective view and the plan view of the map simultaneously in the user interface using the optimal image,

wherein the one or more objects in the perspective view corresponds to the one or more objects in the plan view of the map, and the perspective view and the plan view of the map are switchable while simultaneously rendered in the user interface.

2. The method of claim 1 , wherein the rendering of the graphic representation includes orienting the graphic representation with respect to the surface of the object visible in the perspective view and the distant object and the another object are points of interests.

3. The method of claim 1 , further comprising:

receiving an input for selecting the graphic representation via the user interface; and

displaying of the content associated with the object on the user interface.

4. The method of claim 1 , further comprising:

receiving real-time images captured by the mobile device of the one or more objects in the field of view,

wherein the perspective view shows the real-time images with the graphic representation overlaid onto the surface of the object of the one or more objects in the field of view.

5. The method of claim 1 , further comprising:

receiving pre-stored images of the one or more objects in the field of view,

wherein the perspective view shows the pre-stored images with the graphic representation overlaid onto the surface of an object of the one or more objects in the field of view.

6. The method of claim 1 , further comprising:

receiving real-time images captured by the mobile device of the one or more objects in the field of view; and

receiving pre-stored images of the one or more objects in the field of view,

wherein the perspective view shows a mix of the real-time images and the pre-stored images with the graphic representation overlaid onto the surface of an object of the one or more objects in the field of view.

7. The method of claim 1 , further comprising:

receiving real-time images captured by the mobile device of the one or more objects in the field of view; and

receiving pre-stored images of the one or more objects in the field of view,

wherein the perspective view transitions between the real-time images, the pre-stored images, and a mix of the real-time images and the pre-stored images with the graphic representation overlaid onto the surface of an object of the one or more objects in the field of view.

8. An apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs,

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following:

rendering a perspective view showing one or more objects in a field of view;

rendering a plan view of a map showing at least the one or more objects in the field of view, wherein the perspective and plan views are rendered simultaneously;

retrieving content associated with an object of the one or more objects in the field of view;

rendering a graphic representation relating to the content on a surface of the object visible in the perspective view in a user interface for a location-based service of a mobile device;

determining a perspective of the rendering of the perspective view in relation to the one or more objects;

determining whether a rendering of a distant object is obstructed by a rendering of another object in the perspective view;

omitting a graphic representation relating to content associated with the distant object from the perspective view when the distant object is obstructed by the rendering of another object in the perspective view;

determining an optimal image of the one or more objects for the perspective view from real-time images and pre-stored images; and

rendering of the perspective view and the plan view of the map simultaneously in the user interface using the optimal image,

wherein the one or more objects in the perspective view corresponds to the one or more objects in the plan view of the map, and the perspective view and the plan view of the map are switchable while simultaneously rendered in the user interface.

9. The apparatus of claim 8 , wherein the rendering of the graphic representation includes orienting the graphic representation with respect to the surface of the object visible in the perspective view and the distant object and the another object are points of interests.

10. The method of claim 8 , wherein the apparatus is further caused to:

receiving an input for selecting the graphic representation via the user interface; and

displaying of the content associated with the object on the user interface.

11. The method of claim 8 , wherein the apparatus is further caused to:

receiving real-time images captured by the mobile device of the one or more objects in the field of view,

wherein the perspective view shows the real-time images with the graphic representation overlaid onto the surface of the object of the one or more objects in the field of view.

12. The method of claim 8 , wherein the apparatus is further caused to:

receiving pre-stored images of the one or more objects in the field of view,

wherein the perspective view shows the pre-stored images with the graphic representation overlaid onto the surface of an object of the one or more objects in the field of view.

13. The method of claim 8 , wherein the apparatus is further caused to:

receiving real-time images captured by the mobile device of the one or more objects in the field of view; and

receiving pre-stored images of the one or more objects in the field of view,

wherein the perspective view shows a mix of the real-time images and the pre-stored images with the graphic representation overlaid onto the surface of an object of the one or more objects in the field of view.

14. The method of claim 8 , wherein the apparatus is further caused to:

receiving real-time images captured by the mobile device of the one or more objects in the field of view; and

receiving pre-stored images of the one or more objects in the field of view,

wherein the perspective view transitions between the real-time images, the pre-stored images, and a mix of the real-time images and the pre-stored images with the graphic representation overlaid onto the surface of an object of the one or more objects in the field of view.

15. A non-transitory computer program product including one or more sequences of one or more instructions which, when executed by one or more processors, cause an apparatus to at least perform the steps:

rendering a perspective view showing one or more objects in a field of view;

rendering a plan view of a map showing at least the one or more objects in the field of view, wherein the perspective and plan views are rendered simultaneously;

retrieving content associated with an object of the one or more objects in the field of view;

rendering a graphic representation relating to the content on a surface of the object visible in the perspective view in a user interface for a location-based service of a mobile device;

determining a perspective of the rendering of the perspective view in relation to the one or more objects;

determining whether a rendering of a distant object is obstructed by a rendering of another object in the perspective view;

omitting a graphic representation relating to content associated with the distant object from the perspective view when the distant object is obstructed by the rendering of another object in the perspective view;

determining an optimal image of the one or more objects for the perspective view from real-time images and pre-stored images; and

rendering of the perspective view and the plan view of the map simultaneously in the user interface using the optimal image,

wherein the one or more objects in the perspective view corresponds to the one or more objects in the plan view of the map, and the perspective view and the plan view of the map are switchable while simultaneously rendered in the user interface.

16. The non-transitory computer program product of claim 15 , wherein the rendering of the graphic representation includes orienting the graphic representation with respect to the surface of the object visible in the perspective view and the distant object and the another object are points of interests.

17. The non-transitory computer program product of claim 15 , wherein the apparatus is caused, at least in part, to further perform:

receiving an input for selecting the graphic representation via the user interface; and

displaying of the content associated with the object on the user interface.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 4, 2016
From: CASTRO, BRENDA; VAITTINEN, TUOMAS; MURPHY, DAVID JOSEPH
To: NOKIA CORPORATION
Reel/Frame 040231/0375 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 4, 2016
From: NOKIA CORPORATION
To: NOKIA TECHNOLOGIES OY
Reel/Frame 040231/0378 →