IP Library Granted Patent US 8,508,578
Granted Patent B2
US 8,508,578 · App. 13/078,127 · Granted Aug 13, 2013

Image processor, image processing method, recording medium, computer program and semiconductor device

Inventors: Akio Ohba (Kanagawa, JP); Akira Suzuki (Tokyo, JP); Tomokazu Kake (Tokyo, JP)
Assignees: Sony Corporation; Sony Computer Entertainment Inc.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,508,578
App. No.
13/078,127
Granted
Aug 13, 2013
Kind
B2
Abstract

To provide an image processing technique for easy initial settings when a video image feature is used as an input interface. This is an image processor having an image combining section for combining a mirrored video image feature that includes an image of an operator as a portion thereof and an object image of an object that is associated with a predetermined event, to generate a combined image, and being adapted to provide production of the combined image on a display device. This image processor has a detection section for detecting the position of an image of an operator included in the mirrored video image feature. The image combining section is adapted to combine the object image and the mirrored video image feature in such a manner that the object image is displayed in a range that an image of a hand of the operator can reach, depending on the position of the image of the operator detected by the detection section.

Claims (42)

1. An image processor, comprising:

object image generating means for generating an object image of an object for direct manipulation by an operator by being associated with a predetermined event,

image combining means for superimposing said object image on top of a mirrored video image feature that includes an image of an operator as a portion thereof to generate a combined image to provide production of the combined image on a predetermined display device, and

detection means for detecting a position of a predetermined portion of the operator and a size of the predetermined portion in the image of said operator included in said mirrored video image feature to select an area of the predetermined portion based on the position of the predetermined portion detected

wherein said image combining means is adapted to combine said object image and said mirrored video image feature in such a manner that said object image is displayed in a position for the direct manipulation by the operator and corresponding to the area of said predetermined portion of said operator selected by said detection means and a size of the object image is changed in order to correspond to the size of said predetermined portion, and

wherein said image combining means is adapted to combine said object image and said mirrored video image feature in such a manner that said object image is displayed in a selected presentation candidate area with the size suitable to the size of the selected presentation candidate area, wherein the selected presentation candidate area is selected from multiple presentation candidate areas, wherein positions of the individual presentation candidate areas are determined depending on positions suitable to the area of said predetermined portion of said operator selected by said detection means and sizes of the individual presentation candidate areas are determined depending on the size of said predetermined portion.

2. The image processor as claimed in claim 1 , wherein

said image combining means is adapted to combine an image representing a marker that encloses the position of said predetermined portion of said operator detected by said detection means with a rectangle,

said detection means being adapted to select an area of said predetermined portion based on an image representing said marker.

3. The image processor as claimed in claim 1 , further comprising:

means for generating a motion image map, the motion image map being obtained by layering images of difference that represent the difference in images between frames of said mirrored video image feature,

said image combining means being adapted to select an area where said object image is to be displayed in said multiple presentation candidate areas, depending on the motion of the image of said operator determined on a basis of the motion image map.

4. The image processor as claimed in claim 1 , comprising:

means for detecting change in color of each area between frames of said mirrored video image feature,

said image combining means being adapted to select an area where said object image is to be displayed in said multiple presentation candidate areas, depending on the motion of the image of said operator determined on a basis of a change in color.

5. The image processor as claimed in claim 1 , further comprising:

image acquisition means for acquiring a video image feature that includes an image of said operator as a portion thereof captured with a predetermined image capturing device, from the image capturing device; and

image reversing means that mirrors the acquired video image feature to generate said mirrored video image feature.

6. An image processing method to be carried out by an image processor comprising image combining means for generating a combined image including a mirrored video image feature that includes an image of an operator as a portion thereof and object image of an object for direct manipulation by an operator by being associated with a predetermined event, and detection means for detecting a position of a predetermined portion of the operator and a size of the predetermined portion in the image of said operator included in said mirrored video image feature to select an area of the predetermined portion based on the position of the predetermined portion detected, the image processor being adapted to provide production of the resulting combined image on a predetermined display device,

said image combining means combining said object image and said mirrored video image feature in such a manner that: (i) said object image is displayed in a position for the direct manipulation by the operator and corresponding to the area of said predetermined portion selected by said detection means, and (ii) the size of the object image is changed to correspond to the size of said predetermined portion,

wherein said image combining means combining said object image and said mirrored video image feature in such a manner that said object image is displayed in a selected presentation candidate area with the size suitable to the size of the selected presentation candidate area, wherein the selected presentation candidate area is selected from multiple presentation candidate areas, wherein positions of the individual presentation candidate areas are determined depending on positions suitable to the area of said predetermined portion of said operator selected by said detection means and sizes of the individual presentation candidate areas are determined depending on the size of said predetermined portion.

7. A computer, to which a display device is connected, the computer operating under the control of a computer program that causes the computer to form:

object image generating means for generating an object image of an object for direct manipulation by an operator by being associated with a predetermined event;

image combining means for superimposing said object image on top of a mirrored video image feature that includes an image of an operator as a portion thereof to generate a combined image;

display control means for providing production of the resulting combined image on said display device; and

detection means for detecting the position of a predetermined portion of the operator and the size of the predetermined portion in the image of said operator included in said mirrored video image feature to select an area of the predetermined portion based on the position of the predetermined portion detected,

wherein said image combining means is directed to provide a function of combining said object image and said mirrored video image feature in such a manner that said object image is displayed in a position for the direct manipulation by the operator and corresponding to the area of said predetermined portion selected by said detection means and a size of the object image is changed to correspond to the size of said predetermined portion, and

wherein said image combining means is adapted to combine said object image and said mirrored video image feature in such a manner that said object image is displayed in a selected presentation candidate area with the size suitable to the size of the selected presentation candidate area, wherein the selected presentation candidate area is selected from multiple presentation candidate areas, wherein positions of the individual presentation candidate areas are determined depending on positions suitable to the area of said predetermined portion of said operator selected by said detection means and sizes of the individual presentation candidate areas are determined depending on the size of said predetermined portion.

8. A non-transitory, computer readable recording medium in which a computer program is stored, the computer program causing a computer, to which a display device is connected, to function as:

object image generating means for generating an object image of an object for direct manipulation by an operator by being associated with a predetermined event;

image combining means for superimposing said object image on top of a mirrored video image feature that includes an image of an operator as a portion thereof to generate a combined image;

display control means for providing production of the resulting combined image on said display device; and

detection means for detecting the position of a predetermined portion of the operator and the size of the predetermined portion in the image of said operator included in said mirrored video image feature to select an area of the predetermined portion based on the position of the predetermined portion detected,

wherein said image combining means is directed to provide a function of combining said object image and said mirrored video image feature in such a manner that said object image is displayed in a position for the direct manipulation by the operator and corresponding to the area of said predetermined portion selected by said detection means and a size of the object image is changed to correspond to the size of said predetermined portion, and

wherein said image combining means is adapted to combine said object image and said mirrored video image feature in such a manner that said object image is displayed in a selected presentation candidate area with the size suitable to the size of the selected presentation candidate area, wherein the selected presentation candidate area is selected from multiple presentation candidate areas, wherein positions of the individual presentation candidate areas are determined depending on positions suitable to the area of said predetermined portion of said operator selected by said detection means and sizes of the individual presentation candidate areas are determined depending on the size of said predetermined portion.

9. A semiconductor device integrated in a device mounted on a computer to which a display device is connected, thereby with the semiconductor device, said computer is directed to form:

object image generating means for generating an object image of an object for direct manipulation by an operator by being associated with a predetermined event;

image combining means for superimposing said object image on top of a mirrored video image feature that includes an image of an operator as a portion thereof to generate a combined image;

display control means for providing production of the resulting combined image on said display device; and

detection means for detecting a position of a predetermined portion of the operator and a size of the predetermined portion in the image of said operator included in said mirrored video image feature to select an area of the predetermined portion based on the position of the predetermined portion detected;

wherein said image combining means is directed to provide a function of combining said object image and said mirrored video image feature in such a manner that said object image is displayed in a position for the direct manipulation by the operator and corresponding to the area of said predetermined portion selected by said detection means and a size of the object image is changed to correspond to the size of said predetermined portion, and

wherein said image combining means is adapted to combine said object image and said mirrored video image feature in such a manner that said object image is displayed in a selected presentation candidate area with the size suitable to the size of the selected presentation candidate area, wherein the selected presentation candidate area is selected from multiple presentation candidate areas, wherein positions of the individual presentation candidate areas are determined depending on positions suitable to the area of said predetermined portion of said operator selected by said detection means and sizes of the individual presentation candidate areas are determined depending on the size of said predetermined portion.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 24, 2014
From: SONY CORPORATION
To: SONY COMPUTER ENTERTAINMENT INC.
Reel/Frame 032747/0830 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 13, 2013
From: SONY COMPUTER ENTERTAINMENT INC.
To: SONY CORPORATION
Reel/Frame 030403/0886 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2011
From: SONY NETWORK ENTERTAINMENT PLATFORM INC.
To: SONY COMPUTER ENTERTAINMENT INC.
Reel/Frame 027449/0546 →
CHANGE OF NAME Recorded Dec 26, 2011
From: SONY COMPUTER ENTERTAINMENT INC.
To: SONY NETWORK ENTERTAINMENT PLATFORM INC.
Reel/Frame 027448/0794 →
Priority Claims (1)
JP 2004-023013 · Jan 30, 2004 · national
Continuity (2)
Continuation 10587172
Related Publication 20110181621A1 · Jul 28, 2011