IP Library Granted Patent US 9,779,550
Granted Patent B2
US 9,779,550 · App. 14/428,698 · Granted Oct 3, 2017

Augmented reality system

Inventor: Hiroaki Tobita (Paris, FR)
Assignee: SONY CORPORATION
G06T19/006G06T7/74G06T19/20G06T2207/30204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,779,550
App. No.
14/428,698
Granted
Oct 3, 2017
Kind
B2
Abstract

An augmented reality system including an unmanned moving object and an augmented reality marker arranged on or within the unmanned moving object. The augmented reality system further includes a visual rendering unit that is configured to augment virtual information corresponding to the augmented reality marker and to map the virtual information on the unmanned moving object.

Claims (27)

1. Augmented reality system, comprising:

an unmanned moving object;

an augmented reality marker arranged on or within said unmanned moving object, the augmented reality marker being used for identifying an image associated with the augmented reality marker;

processing circuitry configured to

receive an image of a real environment including the unmanned moving object;

detect the augmented reality marker arranged on or within said unmanned moving object based on the received image;

identify the image associated with the augmented reality marker based on the detected augmented reality marker;

map the determined image associated with the augmented reality marker on the unmanned moving object;

generate an overlaid image by overlaying the mapped image on the unmanned moving object in the received image of the real environment; and

output the generated overlaid image to a display, wherein

the unmanned moving object is an unmanned flying object,

the unmanned flying object is a blimp comprising a gas-filled envelope,

the gas-filled envelope has an outer surface, and

the processing circuitry is configured to map said image associated with the augmented reality marker on the entire outer surface of the gas-filled envelope.

2. The augmented reality system according to claim 1 , wherein the processing circuitry is configured to use texture mapping to virtually overlay said image associated with the augmented reality marker on the outer surface of the unmanned moving object.

3. The augmented reality system according to claim 1 , further comprising at least one actuator to change a position of the unmanned moving object.

4. The augmented reality system according to claim 3 , further comprising:

at least one ultrasonic sensor that is arranged on or within the unmanned moving object and detects obstacles in the surrounding of the unmanned moving object and generates a corresponding detection signal; and

movement control circuitry configured to control an operation of the at least one actuator in dependence of the detection signal.

5. The augmented reality system according to claim 1 , further comprising at least one light source arranged on or within the blimp that projects the augmented reality marker on the envelope of the blimp.

6. The augmented reality system according to claim 5 , further comprising lighting control circuitry that controls the at least one light source in order to project a plurality of different augmented reality markers on the envelope of the blimp in response to user input.

7. The augmented reality system according to claim 1 , further comprising a projector that is arranged within the gas-filled envelope of the blimp and configured to project a projection image on the envelope.

8. The augmented reality system according to claim 1 , wherein the unmanned moving object comprises at least one touch sensor, wherein the image associated with the augmented reality marker mapped on the unmanned moving object is changed by touching the at least one touch sensor.

9. The augmented reality system according to claim 8 , wherein the at least one touch sensor comprises conductive threads arranged over the entire outer surface of the unmanned moving object.

10. The augmented reality system according to claim 1 , wherein the processing circuitry is configured to:

detect a motion, a spatial orientation and a distance of the augmented reality marker arranged on or within said unmanned moving object relative to an observer; and

adapt a size, orientation and position of the image associated with the augmented reality marker mapped on the unmanned moving object according to the detected motion, the spatial orientation and the distance of the augmented reality marker arranged on or within said unmanned moving object relative to the observer.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 17, 2015
From: TOBITA, HIROAKI
To: SONY CORPORATION
Reel/Frame 035179/0425 →
Priority Claims (1)
EP 12186931 · Oct 2, 2012 · regional
Continuity (1)
Related Publication 20150235423A1 · Aug 20, 2015