IP Library Granted Patent US 9,311,754
Granted Patent B2
US 9,311,754 · App. 14/804,870 · Granted Apr 12, 2016

Image processing device, image processing method, and image processing system

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,311,754
App. No.
14/804,870
Granted
Apr 12, 2016
Kind
B2
Abstract

An image acquisition unit acquires an image captured by a first imaging device provided in a HMD for presenting an image observed when a three-dimensional image in a virtual three-dimensional space is projected onto a real-world setting, the first imaging device being configured to visualize an area including a field of view of a user wearing the HMD. A marker detection unit detects a marker included in the image captured by the first imaging device and acquired by the image acquisition unit. The image acquisition unit acquires an image captured by a second imaging device having an angle of view that at least partially overlaps an angle of view of the first imaging device. If the marker is not captured in the image captured by the first imaging device, the marker detection unit detects the marker in an image captured by the second imaging device.

Claims (20)

1. An image processing device comprising:

circuitry configured to:

acquire a first image captured by a first imaging device in an optical head-mounted display (HMD),

wherein the HMD presents a three-dimensional image, and

wherein the first image captured by the first imaging device includes a part of an area including a field of view of a user wearing the HMD;

acquire a second image captured by a second imaging device having an angle of view that at least partially overlaps an angle of view of the first imaging device; and

detect a feature of the three-dimensional image based on the first image and the second image.

2. The image processing device of claim 1 , wherein the circuitry is configured to detect the feature in the second image if the feature is not detected in the first image.

3. The image processing device of claim 1 , wherein the circuitry is configured to generate an augmented real-world image based on the detected feature.

4. The image processing device of claim 3 , wherein if the feature is not detected in the first image and the second image, the augmented real-world image is not generated.

5. The image processing device of claim 3 , wherein if the feature is detected in the second image but not the first image, the augmented real-world image is generated using the feature detected in the second image.

6. An image processing method comprising:

acquiring a first image captured by a first imaging device in an optical head-mounted display (HMD),

wherein the HMD presents a three-dimensional image, and

wherein the first image captured by the first imaging device includes a part of an area including a field of view of a user wearing the HMD;

acquiring a second image captured by a second imaging device having an angle of view that at least partially overlaps an angle of view of the first imaging device; and

detecting a feature of the three-dimensional image based on the first image and the second image.

7. The method of claim 6 , wherein the feature is detected in the second image if the feature is not detected in the first image.

8. The method of claim 6 , further comprising:

generating an augmented real-world image based on the detected feature.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 6, 2017
From: SONY CORPORATION
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 043761/0975 →
CHANGE OF NAME Recorded May 24, 2017
From: SONY COMPUTER ENTERTAINMENT INC.
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 042488/0172 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 26, 2016
From: SONY COMPUTER ENTERTAINMENT INC.
To: SONY CORPORATION
Reel/Frame 037583/0307 →