IP Library Granted Patent US 9,123,158
Granted Patent B2
US 9,123,158 · App. 14/542,921 · Granted Sep 1, 2015

Image processing device, image processing method, and image processing system

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,123,158
App. No.
14/542,921
Granted
Sep 1, 2015
Kind
B2
Abstract

An image acquisition unit acquires an image captured by a first imaging device provided in a HMD for presenting an image observed when a three-dimensional image in a virtual three-dimensional space is projected onto a real-world setting, the first imaging device being configured to visualize an area including a field of view of a user wearing the HMD. A marker detection unit detects a marker included in the image captured by the first imaging device and acquired by the image acquisition unit. The image acquisition unit acquires an image captured by a second imaging device having an angle of view that at least partially overlaps an angle of view of the first imaging device. If the marker is not captured in the image captured by the first imaging device, the marker detection unit detects the marker in an image captured by the second imaging device.

Claims (27)

1. An image processing device comprising:

a circuit configured to:

acquire an image captured by a first imaging device provided in an optical head-mounted display (HMD) for presenting an augmented real-world image,

wherein a three-dimensional image in a virtual three-dimensional space is projected onto a real-world setting in the augmented real-world image,

wherein the image captured by the first imaging device includes an area including a field of view of a user wearing the HMD;

detect a feature of the image captured by the first imaging device;

acquire an image captured by a second imaging device having an angle of view that at least partially overlaps an angle of view of the first imaging device; and

detect a feature of the image captured by the second imaging device when the feature of the image captured by the first imaging device is not detected.

2. The image processing device according to claim 1 , the circuit further configured to:

generate the augmented reality (AR) image according to the detected feature of the image captured by the second imaging device.

3. The image processing device according to claim 2 , the circuit further configured to:

detect the feature of the image captured by the second imaging device when the feature of the image captured by the first imaging device is detected; and

generate the AR image according to the detected feature of the image captured by second image and the detected feature of the image captured by first image.

4. The image processing device according to claim 1 , wherein the feature of the image captured by the first imaging device or the feature of the image captured by the second imaging device is a marker.

5. A method for presenting an augmented real-world image comprising:

acquiring an image captured by a first imaging device provided in an optical head-mounted display (HMD) for presenting the augmented real-world image,

wherein a three-dimensional image in a virtual three-dimensional space is projected onto a real-world setting in the augmented real-world image,

wherein the image captured by the first imaging device includes an area including a field of view of a user wearing the HMD;

detecting a feature of the image captured by the first imaging device;

acquiring an image captured by a second imaging device having an angle of view that at least partially overlaps an angle of view of the first imaging device; and

detecting a feature of the image captured by the second imaging device when the feature of the image captured by the first imaging device is not detected.

6. The method according to claim 5 , further comprising:

generating the augmented reality (AR) image according to the detected feature of the image captured by the second imaging device.

7. The method according to claim 6 , further comprising:

detecting the feature of the image captured by the second imaging device when the feature of the image captured by the first imaging device is detected; and

generating the AR image according to the detected feature of the image captured by second image and the detected feature of the image captured by first image.

8. The method according to claim 5 , wherein the feature of the image captured by the first imaging device or the feature of the image captured by the second imaging device is a marker.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 6, 2017
From: SONY CORPORATION
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 043761/0975 →
CHANGE OF NAME Recorded May 24, 2017
From: SONY COMPUTER ENTERTAINMENT INC.
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 042487/0962 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 16, 2015
From: SONY COMPUTER ENTERTAINMENT INC.
To: SONY CORPORATION
Reel/Frame 035846/0805 →