IP Library Granted Patent US 11,797,131
Granted Patent B2
US 11,797,131 · App. 17/095,852 · Granted Oct 24, 2023

Apparatus and method for image output using hand gestures

Inventors: Hiroyuki Mizunuma (Tokyo, JP); Ikuo Yamano (Tokyo, JP); Shunichi Kasahara (Kanagawa, JP); Ken Miyashita (Tokyo, JP); Kazuyuki Yamamoto (Kanagawa, JP)
G06F3/0425G03B17/54G06F3/0482G06F3/0486G06F3/04817G06F3/04886H04N9/3185H04N9/3194H05K999/99G06F2203/04808
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,797,131
App. No.
17/095,852
Granted
Oct 24, 2023
Kind
B2
Abstract

According to an illustrative embodiment, an information processing apparatus is provided. The apparatus is used for processing a first image projected toward a target. The apparatus includes a processing unit for detecting that an object exists between a projector unit and the target, wherein when an object exists between the projector unit and the target, the apparatus determines an area of the object and generates a modified first image, based on the area of the object, for projection toward the target.

Claims (33)

1. An information processing apparatus comprising:

a processor configured to:

output of a first image in a three-dimensional space, the first image including a plurality of selectable items;

acquire, in response to detection of a user's hand performing a first gesture corresponding to selection of an item from the plurality of selectable items, a user selection result corresponding to the selected item; and

output a second image in the three-dimensional space corresponding to the selected item, wherein a position of the second image is associated with a position of the user's hand,

wherein the processor is further configured to superimpose the second image over the user's hand.

2. The information processing apparatus of claim 1 , wherein the processor is further configured to superimpose the second image and the first image in the three-dimensional space by projection of the second image.

3. The information processing apparatus of claim 1 , wherein the first gesture is a tapping gesture.

4. The information processing apparatus of claim 3 , wherein the tapping gesture is a tapping gesture of an index finger of the user's hand.

5. The information processing apparatus of claim 1 , wherein the processor is further configured to perform hand detection processing for detection of the user's hand performing the first gesture and detection of the position of the user's hand.

6. The information processing apparatus of claim 1 , wherein the processor is further configured to control an outputted position of the second image to follow the detected position of the user's hand in the three-dimensional space.

7. The information processing apparatus of claim 1 , wherein the first image includes a color palette.

8. The information processing apparatus of claim 7 , wherein the plurality of selectable items of the first image are a plurality of selectable colors.

9. The information processing apparatus of claim 8 , wherein a color of the second image corresponds to a color of the selected item.

10. The information processing apparatus of claim 1 , wherein the processor is further configured to, in response to detection of a user's hand performing a second gesture while the second image is being outputted, output a third image in the three-dimensional space.

11. The information processing apparatus of claim 10 , wherein the second image is a color box, and wherein the third image is a line having a same color as the color box.

12. The information processing apparatus of claim 11 , wherein the second gesture is a dragging gesture.

13. The information processing apparatus of claim 10 , wherein the processor is further configured to simultaneously output both the second image and the third image in the three-dimensional space.

14. The information processing apparatus of claim 10 , wherein the processor is configured to:

control an outputted position of the second image to follow the detected position of the user's hand in the three-dimensional space; and

control an outputted position of the third image to remain stationary in the three-dimensional space as the user's hand moves.

15. A method comprising:

outputting, by a processor, a first image in a three-dimensional space, the first image including a plurality of selectable items;

acquiring, by the processor, in response to detection of a user's hand performing a first gesture corresponding to selection of an item from the plurality of selectable items, a user selection result corresponding to the selected item; and

outputting, by the processor, a second image in the three-dimensional space corresponding to the selected item, wherein a position of the second image is associated with a position of the user's hand, and wherein the second image is superimposed over the user's hand.

16. The method of claim 15 , wherein outputting the second image comprises controlling an outputted position of the second image to follow the detected position of the user's hand in the three-dimensional space.

17. The method of claim 15 , further comprising outputting, by the processor, a third image in the three-dimensional space in response to detection of a user's hand performing a second gesture while the second image is being outputted.

18. The method of claim 17 , wherein outputting the second image comprises controlling an outputted position of the second image to follow the detected position of the user's hand in the three-dimensional space, and wherein outputting the third image comprises controlling an outputted position of the third image to remain stationary in the three-dimensional space as the user's hand moves.

19. A non-transitory computer-readable medium having stored thereon a computer-readable program to:

output of a first image in a three-dimensional space, the first image including a plurality of selectable items;

acquire, in response to detection of a user's hand performing a first gesture corresponding to selection of an item from the plurality of selectable items, a user selection result corresponding to the selected item; and

output a second image in the three-dimensional space corresponding to the selected item, wherein a position of the second image is associated with a position of the user's hand,

wherein the processor is further configured to superimpose the second image over the user's hand.

Assignments (2)
CHANGE OF NAME Recorded Aug 17, 2021
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 057207/0835 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 13, 2020
From: MIZUNUMA, HIROYUKI; YAMANO, IKUO; KASAHARA, SHUNICHI; MIYASHITA, KEN; YAMAMOTO, KAZUYUKI
To: SONY CORPORATION
Reel/Frame 054357/0382 →
Priority Claims (1)
JP 2011-075998 · Mar 30, 2011 · national
Continuity (6)
Continuation 16578530 · Sep 23, 2019
Continuation 16146132 · Sep 28, 2018
Continuation 15629059 · Jun 21, 2017
Continuation 14940254 · Nov 13, 2015
Continuation 13428414 · Mar 23, 2012
Related Publication 20210064182A1 · Mar 4, 2021