IP Library Granted Patent US 9,817,848
Granted Patent B2
US 9,817,848 · App. 15/406,146 · Granted Nov 14, 2017

Wide area augmented reality location-based services

Inventors: David McKinnon (Culver City, CA); Kamil Wnuk (Playa Del Rey, CA); Jeremi Sudol (Los Angeles, CA); Matheen Siddiqui (Culver City, CA); John Wiacek (Culver City, CA); Bing Song (La Canada, CA); Nicholas J. Witchey (Laguna Hills, CA)
Assignee: Nant Holdings IP, LLC
G06F17/30268G06F17/30241G06F17/30259G06F17/30867G06T15/20G06T19/003G06T19/006G06T2219/024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,817,848
App. No.
15/406,146
Granted
Nov 14, 2017
Kind
B2
Abstract

Apparatus, methods and systems of providing AR content are disclosed. Embodiments of the inventive subject matter can obtain an initial map of an area, derive views of interest, obtain AR content objects associated with the views of interest, establish experience clusters and generate a tile map tessellated based on the experience clusters. A user device could be configured to obtain and instantiate at least some of the AR content objects based on at least one of a location and a recognition.

Claims (40)

1. A mobile augmented reality (AR) device, the device comprising:

at least one sensor, including a location sensor;

a display;

a non-transitory, computer readable memory storing software instructions; and

a processor coupled with the computer readable memory, the at least one sensor, and the display; and, upon execution of the software instructions, is configurable to:

obtain sensor data from the at least one sensor wherein the sensor data includes a device location obtained from the location sensor;

access a map of an area of interest from an area database based on at least the device location within the sensor data;

identify a tile from a set of tiles that tessellates at least a portion of the map of the area of interest, where the tile is identified based at least in part on the device location relative to locations of tiles in the set of tiles;

obtain access to at least one AR content object that is associated with a type of area of the area of interest and that is bound to the tile; and

render AR content instantiated from the at least one AR content object on the display based on a point of view of the device.

2. The device of claim 1 , wherein the location sensor comprises a global positioning system (GPS) sensor.

3. The device of claim 1 , wherein the device location includes at least one of the following: a global positioning system (GPS) location, a wireless signal location, a depth of field location, and an image-based simultaneous location and mapping (SLAM) location.

4. The device of claim 1 , wherein the at least one sensor further includes one or more of the following: a camera, an accelerometer, and a gyroscope.

5. The device of claim 1 , wherein the sensor data further includes at least one of device position data and device orientation data.

6. The device of claim 5 , wherein the AR content is rendered based on the point of view derived from at least one of the device position data and the device orientation data.

7. The device of claim 5 , wherein a virtual item is provided to a user when the user executes a navigation event with respect to the area of interest.

8. The device of claim 7 , wherein the navigation event comprises at least one of: the user being located in the area of interest at any time, the user being located in the area of interest for a predetermined minimum amount of time, the user being located in the area of interest at predetermined time, or the user being located in the area of interest and capturing an image viewable from the area of interest.

9. The device of claim 5 , wherein a virtual item is provided to a first user and a second user when the first user and the second user execute a navigation event with respect to the area of interest.

10. The device of claim 9 , wherein the navigation event comprises the first user and the second user each performing at least one of the following: being located in the area of interest at any time, being located in the area of interest for a predetermined minimum amount of time, being located in the area of interest at predetermined time, or being located in the area of interest and capturing an image viewable from the area of interest.

11. The device of claim 1 , wherein the AR content is rendered as an overlay on real-world imagery.

12. The device of claim 1 , wherein the area of interest comprises one of the following: a landmark, user-defined boundaries, state-defined boundaries, natural boundaries, a city, a country, a business, a shopping center, a warehouse, a stadium, a wilderness area, a road, a garden, a zoo, an amusement park, a beach and a building.

13. The device of claim 1 , wherein the area of interest comprises a restaurant.

14. The device of claim 1 , wherein the area of interest comprises a coffee shop.

15. The device of claim 1 , wherein the area of interest comprises an outdoor setting.

16. The device of claim 1 , wherein the device communicatively couples with the area database over a network.

17. The device of claim 1 , wherein the at least one AR content object is obtained from an AR content database.

18. The device of claim 17 , wherein the device is communicatively coupled with the AR content database over a network.

19. The device of claim 1 , wherein the AR content is rendered relative to a recognized object.

20. The device of claim 19 , wherein the recognized object represents an attachment point for the AR content.

21. The device of claim 19 , wherein the attachment points include at least one of the following: a billboard, a wall, a floor, a plant, a sign, a logo, a landmark, and a car.

22. The device of claim 1 , wherein the at least one AR content object comprises a game object.

23. The device of claim 22 , wherein the AR content comprises an interactive game experience instantiated from the game object.

24. The device of claim 1 , wherein the at least one AR content object comprises at least one of the following: a virtual object, a digital image, a digital video, audio data, an application, a script, a promotion, an advertisement, a graphic, a sprite, and an animation.

25. The device of claim 1 , wherein the at least one AR content object comprises an exclusive content object bound to the tile.

26. The device of claim 25 , wherein the exclusive content object bound to the tile is rendered based on a paid fee.

27. The device of claim 1 , wherein the memory, processor, the at least one sensor, and the display comprise at least one of the following: a smart phone, augmented reality goggles, a watch, a tablet, a drone, a vehicle, and a robot.

28. The device of claim 1 , wherein the AR content is instantiated based on the device's movement relative to the area of interest.

29. The device of claim 28 , wherein the at least one AR content object is auto-populated in the memory and rendered based on the movement relative to the area of interest.

30. The device of claim 1 , wherein the tile or the at least one AR content object is identified based on time.

31. The device of claim 1 , wherein modification of the AR content by a first user is viewable by a subset of users.

Assignments (10)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 4, 2017
From: MCKINNON, DAVID
To: NANT VISION, INC.
Reel/Frame 042247/0273 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2017
From: NANTMOBILE, LLC
To: NANT HOLDINGS IP, LLC
Reel/Frame 041001/0962 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2017
From: NANT VISION, INC.
To: NANT HOLDINGS IP, LLC
Reel/Frame 041001/0994 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2017
From: WITCHEY, NICHOLAS J.
To: NANTWORKS, LLC
Reel/Frame 041002/0008 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2017
From: SONG, BING
To: NANTWORKS, LLC
Reel/Frame 041002/0019 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2017
From: NANTWORKS, LLC
To: NANT HOLDINGS IP, LLC
Reel/Frame 041001/0956 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2017
From: SIDDIQUI, MATHEEN
To: NANT VISION, INC.
Reel/Frame 041002/0031 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2017
From: SUDOL, JEREMI
To: NANT VISION, INC.
Reel/Frame 041002/0041 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2017
From: WNUK, KAMIL
To: NANT VISION, INC.
Reel/Frame 041002/0044 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2017
From: WIACEK, JOHN
To: NANTMOBILE, LLC
Reel/Frame 041002/0022 →
Continuity (3)
Continuation 14517728 · Oct 17, 2014
Provisional Application 61892238 · Oct 17, 2013
Related Publication 20170132253A1 · May 11, 2017