IP Library Granted Patent US 9,979,946
Granted Patent B2
US 9,979,946 · App. 14/767,742 · Granted May 22, 2018

I/O device, I/O program, and I/O method

Inventors: Johannes Lundberg (Tokyo, JP); Shinya Yamamoto (Los Altos, CA); Yusuke Kajii Kajii (Tokyo, JP); Yoshihiko Sugimoto (Osaka, JP)
Assignee: MIRAMA SERVICE INC
H04N13/0022G02B27/017G02B27/2214G06F3/005G06F3/017H04N13/0239H04N13/0253H04N13/044G02B2027/014G02B2027/0127G02B2027/0134G02B2027/0178H04N2013/0081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,979,946
App. No.
14/767,742
Granted
May 22, 2018
Kind
B2
Abstract

Provided are an I/O device, an I/O program, and an I/O method that enable visual recognition with such a sense of distance as if a target object that is a real image were in contact with a stereoscopic image that is a virtual image. The I/O device according to the present invention includes: a display device that can generate a stereoscopic image; and a depth level sensor that measures a distance to a target object. A stereoscopic region of the stereoscopic image generated by the display device and a depth level detection region of the depth level sensor overlap with each other to thereby have a common region therebetween. As a result, the visual recognition with such a sense of distance as if the target object that is a real image were in contact with the stereoscopic image that is a virtual image is possible.

Claims (29)

1. An I/O device comprising:

a display device that can generate a stereoscopic image; and

a depth level sensor that measures a distance to a target object, wherein

a stereoscopic region of the stereoscopic image generated by the display device and a depth level detection region of the depth level sensor have a common region therebetween, wherein

the common region is formed by a space having a shape with an arch-like curved surface that is convex toward the stereoscopic region from a position at which the stereoscopic image is visually recognizable, the space being a space in which both hands move horizontally with joints of both shoulders being a center of rotation and both hands move vertically with joints of both shoulders being a center of rotation, and

based on an output of the depth level sensor, a stereoscopic image which is generated in the common region is manipulated.

2. The I/O device according to claim 1 , wherein the common region is formed by a space having a thickness in a depth level direction.

3. The I/O device according to claim 1 , wherein the common region is provided between the display device and the depth level sensor.

4. The I/O device according to claim 1 , wherein the display device is provided to part of the depth level detection region of the depth level sensor.

5. The I/O device according to claim 1 , wherein a direction from the display device to the stereoscopic region is the same as a direction from the depth level sensor to the depth level detection region.

6. The I/O device according to claim 1 , wherein the common region includes a manipulation region for manipulating the stereoscopic image generated by the display device.

7. The I/O device according to claim 6 , wherein the number of the manipulation regions is one or more.

8. The I/O device according to claim 1 , wherein the display device is a head-mounted display.

9. An I/O system comprising:

a memory to store computer executable instructions; and

a processor to execute the computer executable instructions to perform processes, comprising:

a display process of generating a stereoscopic image;

a depth level detection process of measuring a distance to a target object; and

a common region process of overlapping a stereoscopic region in which the stereoscopic image is generated in the display process, with a depth level detection region for the depth level detection process, to thereby generate a common region, wherein

the common region process is formed by a process of setting a space having a shape with an arch-like curved surface that is convex toward the stereoscopic region from a position at which the stereoscopic image is visually recognizable, the space being a space in which both hands move horizontally with joints of both shoulders being a center of rotation and both hands move vertically with joints of both shoulders being a center of rotation, and

based on an output of the depth level detection process, a stereoscopic image which is generated in the common region is manipulated.

10. The I/O system according to claim 9 , further comprising a manipulation process of manipulating the stereoscopic image generated in the display process, in the common region.

11. An I/O method comprising:

a display step of generating a stereoscopic image;

a depth level detection step of measuring a distance to a target object; and

a common region processing step of overlapping a stereoscopic region in which the stereoscopic image is generated in the display step, with a depth level detection region in which a depth level is detected in the depth level detection step, to thereby generate a common region, wherein

the common region processing step is formed by a process of setting a space having a shape with an arch-like curved surface that is convex toward the stereoscopic region from a position at which the stereoscopic image is visually recognizable, the space being a space in which both hands move horizontally with joints of both shoulders being a center of rotation and both hands move vertically with joints of both shoulders being a center of rotation, and

based on an output of the depth level detection step, a stereoscopic image which is generated in the common region is manipulated.

12. The I/O method according to claim 11 , further comprising a manipulation step of manipulating the stereoscopic image generated in the display step, in the common region.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 12, 2021
From: MIRAMA SERVICE INC.
To: MINAMI, CHIKARA
Reel/Frame 055245/0302 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 24, 2017
From: BRILLIANTSERVICE CO., LTD.
To: MIRAMA SERVICE INC.
Reel/Frame 041810/0773 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 13, 2015
From: LUNDBERG, JOHANNES; YAMAMOTO, SHINYA; KAJII, YUSUKE; SUGIMOTO, YOSHIHIKO
To: BRILLIANTSERVICE CO., LTD
Reel/Frame 036320/0876 →
Continuity (1)
Related Publication 20160021353A1 · Jan 21, 2016