IP Library › Granted Patent US 11,244,469
Granted Patent B2
US 11,244,469 · App. 16/742,831 · Granted Feb 8, 2022

Tracking position of device inside-out for augmented reality interactivity

Inventors: George Weising (Culver City, CA); Thomas Miller (Los Angeles, CA)
Assignee: Sony Interactive Entertainment LLC
G06T7/70A63F3/02A63F9/24A63F13/00A63F13/40A63F13/50G06F3/011G06F3/012G06F3/017G06F3/0304G06F3/0346G06F3/04815G06T7/20G06T19/006G09G5/08H04N5/23258A63F2009/2457G06T2207/10028G09G2320/0261
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,244,469
App. No.
16/742,831
Filed
Jan 14, 2020
Granted
Feb 8, 2022
Kind
B2
Art Unit
2628
USPC
345/158
Abstract

Methods, systems, and computer programs are provided for generating an interactive space. One method includes identifying a reference point in a three-dimensional (3D) space using a portable device. The reference point is calibrated to an origin point of the portable device. The method includes determining by the device a position and an orientation of the portable device at the origin point. The position and orientation is determined using data from an inertial sensor of the portable device and data from the camera. The method includes generating by the portable device an augmented reality (AR) space using the reference point. The AR space includes virtual objects imposed over or in the 3D space.

Claims (23)

1. A method, comprising:

identifying a reference point in a three-dimensional (3D) space using a portable device, the reference point is calibrated to an origin point at which the portable device is placed within the 3D space, and said calibration to the origin point is initiated responsive to input received from the portable device when placed and held at the reference point;

determining by the portable device a position and an orientation of the portable device when placed at the origin point and other points in the 3D space relative to the origin point, the position and orientation is determined using data from an inertial sensor of the portable device and data from the camera, wherein said calibration resets the inertial sensor to identify the position and orientation of the portable device relative to the origin point when placed and held at the reference point; and

generating by the portable device an augmented reality (AR) space using the reference point, wherein the AR space includes virtual objects imposed over the 3D space and the portable device updates views into the AR space based on changes in the position and orientation of the portable device.

2. The method of claim 1 , wherein the AR space has a second coordinate system that is referenced from a first coordinate system of the 3D space.

3. The method of claim 1 , wherein the portable device uses a connection to a network to obtain data for the generating of the virtual objects of the AR space.

4. The method of claim 1 , further comprising,

tracking movement of the portable device in the 3D space, wherein movement changes the position and orientation of the portable device which provides for said updates to views presented into the AR space.

5. The method of claim 4 , wherein the view presented into the AR space includes real-world objects in the 3D space and one or more of said virtual objects, wherein said virtual objects in the view are oriented in the AR space in relation to one or more real-world objects.

6. The method of claim 4 , wherein the view of the of the AR space provides views of one or more of the virtual objects from one or more view perspectives based on changes to the position and orientation of the portable device as the portable device moves and is tracked for movement, wherein the tracking of the movement is facilitated by one or both of the inertial sensor of the portable device and one or more images taken by the camera of the portable device.

7. The method of claim 1 , wherein movements of the portable device closer to or further from virtual object provides for different views of the virtual object, and the movements closer and further are tracked using one or both of the inertial sensor and the camera of the portable device, the different views being shown on a display of the portable device.

8. The method of claim 1 , wherein the portable device is one of,

a portable gaming device;

a handheld portable gaming device;

a game controller;

a cell phone;

a head mounted display;

a notebook;

a tablet;

a netbook; or

a PDA.

9. The method of claim 1 , wherein said input for identifying the reference point via said calibration includes one of tapping the portable device, or holding the portable device at the reference point, or providing an input to a user interface of the portable device, or engaging an actuator.

10. The method of claim 1 , wherein the portable device is tracked using one or both of the inertial sensor and the camera, and the inertial sensor includes one or both of a 3-axis accelerometer or a 3 axis gyroscope, and the camera includes depth sensing.

Continuity (7)
Continuation 15371151 · Dec 6, 2016
Continuation 14260208 · Apr 23, 2014
Continuation 14017208 · Sep 3, 2013
Continuation 12973827 · Dec 20, 2010
Provisional Application 61311251 · Mar 5, 2010
Provisional Application 61323762 · Apr 13, 2010
Related Publication 20200151900A1 · May 14, 2020
Cited By (1)
US 12,422,921