IP Library Granted Patent US 11,010,975
Granted Patent B1
US 11,010,975 · App. 16/294,536 · Granted May 18, 2021

Remote camera augmented reality system

Inventors: Daniel Doptis (Troy, NY); Jan-Erik Steel (Old Chatham, NY); Edward Tumbusch (Latham, NY); Karthik Bala (Menands, NY)
Assignee: Velan Studios, Inc.
G06T19/006A63F13/217A63F13/803G06T7/74
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,010,975
App. No.
16/294,536
Granted
May 18, 2021
Kind
B1
Abstract

There is disclosed a system for remote tracking of augmented reality media through a real-world environment. The system may use an augmented reality platform incorporating a camera and motion sensors to move about a physical space while an augmented reality object or characters are superimposed within that physical space. The augmented reality platform may move intelligently to keep the augmented reality media within frame as it moves or is adjusted. The augmented reality platform may present a basis upon which to build upon for superimposing augmented reality elements onto augmented reality media and the augmented reality platform as they move about within a space together. The platform may be used, for example, in a racing or platforming style game or experience.

Claims (53)

1. A system for remote camera tracking comprising:

a moveable augmented reality platform including:

a camera for capturing image data of an area in front of a camera lens on the moveable augmented reality platform,

a communications interface for transmitting the image data to a remote computing device and for receiving instructions from the remote computing device,

a locomotive system for moving the movable augmented reality platform from one physical location to another; and

the remote computing device, including a processor and non-volatile memory, separate from the moveable augmented reality platform, further including:

the processor which is programmed to:

aggregate the image data received over a series of control instructions or a period of time while the movable augmented reality platform moves through a physical space to define a course;

use image processing to identify visual landmarks within the image data at predetermined points within the physical space;

define the course, comprising a route made up of a traversal along the predetermined points by the movable augmented reality platform within the physical space, through which an event involving the movable augmented reality platform is to take place based upon the visual landmarks;

a display for displaying the image data on the remote computing device in conjunction with augmented reality media superimposed over the image data;

a user interface for receiving control input from a user for control of the locomotive system to move the moveable augmented realty platform from one physical location to another; and

a second communications interface for receiving the image data and for transmitting control instructions based upon the control input to the moveable augmented reality platform.

2. The system of claim 1 wherein the remote computing device:

identifies at least one visual landmark within the image data; and

defines a condition of a competitive game based upon identification of the at least one visual landmark within the image data.

3. The system of claim 2 wherein the visual landmark is a machine-readable element.

4. The system of claim 1 wherein:

the movable augmented reality platform further includes at least one motion sensor for generating motion data based upon motion of the moveable augmented reality platform;

the second communications interface is further for receiving the motion data; and

the remote computing device tracks the movement of the movable augmented reality platform through the course to a victory condition using the visual landmarks.

5. The system of claim 4 wherein the remote computing device defines the course using at least one of the motion data and the control instructions.

6. The system of claim 1 wherein the image processing to identify the visual landmarks is reliant upon the image data from the movable augmented reality platform and from at least one other movable augmented reality platform operating within the physical space along the course.

7. The system of claim 1 wherein the augmented reality media includes an on-screen character, generated by the remote computing device, overlaid over and appearing to operate the movable augmented reality platform with actions corresponding the control instructions.

8. The system of claim 1 wherein:

the movable augmented reality platform further includes at least one motion sensor for generating motion data based upon motion of the moveable augmented reality platform;

the second communications interface is further for receiving the motion data; and

the augmented reality media on the display is altered based, at least in part, upon the motion data.

9. A method of remote camera tracking comprising:

capturing image data of an area in front of a camera lens using a camera on a moveable augmented reality platform including a locomotive system for moving the movable augmented reality platform from one physical location to another;

transmitting the image data to a remote computing device;

aggregating the image data received over a series of control instructions or a period of time while the movable augmented reality platform moves through a physical space to define a course;

using image processing to identify visual landmarks within the image data at predetermined points within the physical space;

defining the course, comprising a route made up of a traversal along the predetermined points by the movable augmented reality platform within the physical space, through which an event involving the movable augmented reality platform is to take place based upon the visual landmarks

displaying on a display of the remote computing device, distinct from the augmented reality platform, the image data in conjunction with augmented reality media superimposed over the image data;

receiving control input on the mobile computing device from a user for control to move the moveable augmented realty platform;

transmitting the control input to the augmented reality platform; and

moving the movable augmented reality platform using the locomotive system from one physical location to another in response to the control input.

10. The method of claim 9 further comprising:

identifying at least one visual landmark within the image data; and

defining a condition of a competitive game based upon identification of the at least one visual landmark within the image data.

11. The method of claim 10 wherein the visual landmark is a machine-readable element.

12. The method of claim 9 further comprising:

generating motion data by at least one motion sensor based upon motion of the moveable augmented reality platform;

receiving the motion data at the mobile computing device; and

tracking movement of the movable augmented reality platform through the course to a victory condition using the visual landmarks.

13. The method of claim 12 wherein the remote computing device defines the course using at least one of the motion data and the control instructions.

14. The method of claim 9 wherein the image processing to identify the visual landmarks is reliant upon the image data from the movable augmented reality platform and from at least one other movable augmented reality platform operating within the physical space along the course.

15. The method of claim 9 wherein the augmented reality media includes an on-screen character, generated by the remote computing device, overlaid over and appearing to operate the movable augmented reality platform with actions corresponding the control instructions.

16. The method of claim 9 further comprising:

generating motion data by at least one motion sensor based upon motion of the moveable augmented reality platform;

receiving the motion data at the mobile computing device; and

altering the augmented reality media shown on the display based, at least in part, upon the motion data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 8, 2019
From: DOPTIS, DANIEL; STEEL, JAN-ERIK; TUMBUSCH, EDWARD; BALA, KARTHIK
To: VELAN STUDIOS, INC.
Reel/Frame 048552/0158 →
Continuity (5)
Provisional Application 62639397 · Mar 6, 2018
Provisional Application 62639398 · Mar 6, 2018
Provisional Application 62639400 · Mar 6, 2018
Provisional Application 62639402 · Mar 6, 2018
Provisional Application 62639404 · Mar 6, 2018
Cited By (5)
US 12,283,002 US 12,315,092 US 12,361,505 US 12,400,409 US 12,629,834