IP Library Granted Patent US 9,684,173
Granted Patent B2
US 9,684,173 · App. 15/061,163 · Granted Jun 20, 2017

Image processing device, image processing method, and image processing system

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,684,173
App. No.
15/061,163
Granted
Jun 20, 2017
Kind
B2
Abstract

An image acquisition unit acquires an image captured by a first imaging device provided in a HMD for presenting an image observed when a three-dimensional image in a virtual three-dimensional space is projected onto a real-world setting, the first imaging device being configured to visualize an area including a field of view of a user wearing the HMD. A marker detection unit detects a marker included in the image captured by the first imaging device and acquired by the image acquisition unit. The image acquisition unit acquires an image captured by a second imaging device having an angle of view that at least partially overlaps an angle of view of the first imaging device. If the marker is not captured in the image captured by the first imaging device, the marker detection unit detects the marker in an image captured by the second imaging device.

Claims (21)

1. An image processing device comprising:

circuitry configured to:

acquire an image captured by a first imaging device provided in an optical head-mounted display (HMD) for presenting an augmented real-world image,

wherein a three-dimensional image in a virtual three-dimensional space is projected onto a real-world setting in the augmented real-world image,

wherein the image captured by the first imaging device includes an area including a field of view of a user wearing the HMD;

acquire an image captured by a second imaging device configured at a predetermined stationary angle of view in a general direction towards the user and the HMD;

detect a feature of the image captured by the first imaging device; and

detect a feature of the image captured by the second imaging device when the feature of the image captured by the first imaging device is not detected,

wherein the predetermined stationary angle of view at least partially overlaps an angle of view of the first imaging device.

2. The image processing device of claim 1 , wherein the circuitry is configured to generate an augmented real-world image based on the detected feature.

3. A method for presenting an augmented real-world image comprising:

acquiring an image captured by a first imaging device provided in an optical head-mounted display (HMD) for presenting the augmented real-world image,

wherein a three-dimensional image in a virtual three-dimensional space is projected onto a real-world setting in the augmented real-world image,

wherein the image captured by the first imaging device includes an area including a field of view of a user wearing the HMD;

acquiring an image captured by a second imaging device configured at a predetermined stationary angle of view in a general direction towards (or “for capturing an image including”) the user and the HMD;

detecting a feature of the image captured by the first imaging device; and

detecting a feature of the image captured by the second imaging device when the feature of the image captured by the first imaging device is not detected,

wherein the predetermined stationary angle of view at least partially overlaps an angle of view of the first imaging device.

4. The method of claim 3 , further comprising:

generating an augmented real-world image based on the detected feature.

5. The method of claim 3 , wherein the augmented real-world image is not generated when the feature of the image captured by the first imaging device and the feature of the image captured by the second imaging device are not detected.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 6, 2017
From: SONY CORPORATION
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 043761/0975 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2017
From: SONY INTERACTIVE ENTERTAINMENT INC.
To: SONY CORPORATION
Reel/Frame 042320/0925 →
CHANGE OF NAME Recorded Aug 9, 2016
From: SONY COMPUTER ENTERTAINMENT INC.
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 039386/0697 →