IP Library Granted Patent US 11,380,021
Granted Patent B2
US 11,380,021 · App. 16/900,110 · Granted Jul 5, 2022

Image processing apparatus, content processing system, and image processing method

Inventor: Masashi Nakata (Kanagawa, JP)
Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
G06T11/00G06V40/28G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,380,021
App. No.
16/900,110
Granted
Jul 5, 2022
Kind
B2
Abstract

Disclosed herein is an image processing apparatus including a hand recognizing section configured to recognize a state of a hand of a user, an item image superimposing section configured to superimpose images of items as selection targets attached to the fingers of the hand that are assigned to the items on either an image of the hand being displayed or an image representing the hand being displayed, and a selecting operation detecting section configured to detect that one of the items is selected on the basis of a hand motion performed on the images of the items before performing processing corresponding to the detected selection.

Claims (38)

1. An image processing apparatus comprising:

a hand recognizing section configured to recognize a state of a hand of a user;

an item image superimposing section configured to superimpose images of merchandise items as selection targets attached to the fingers of the hand that are assigned to the merchandise items on either an image of the hand being displayed or an image representing the hand being displayed; and

a selecting operation detecting section configured to detect that one of the merchandise items is selected on a basis of a hand motion performed on the images of the merchandise items before performing processing corresponding to the detected selection,

wherein the processing includes purchase of the selected merchandise item by the user, and

wherein the selecting operation detecting section detects that an operation is performed to either increase or decrease a number of merchandise items to be purchased in accordance with a predetermined hand motion performed on the image of the selected item.

2. The image processing apparatus according to claim 1 , wherein

the item image superimposing section attaches the images of the merchandise items to at least some of the fingers except for the thumb, and

the selecting operation detecting section detects that one of the merchandise items is selected in accordance with a motion of the thumb designating the image of the selected merchandise item.

3. The image processing apparatus according to claim 1 , wherein

the selecting operation detecting section detects that one of the merchandise items is being selected in accordance with a motion to detach the image of the selected merchandise item from a finger of the user and attach the image of the selected merchandise to the palm of the hand.

4. The image processing apparatus according to claim 3 , wherein

the selecting operation detecting section detects that the purchase of the merchandise item is finalized in accordance with a motion to grip the image of the selected merchandise item attached to the palm of the hand.

5. The image processing apparatus according to claim 1 , wherein

the item image superimposing section determines a start and end of display of the images of the merchandise items in accordance with a predetermined hand motion.

6. The image processing apparatus according to claim 1 , wherein

the item image superimposing section replaces all of the images of the merchandise items being displayed with images of other merchandise items in accordance with a predetermined hand motion.

7. The image processing apparatus according to claim 6 , wherein

the predetermined hand motion is a motion by an other hand of the user to swipe the images of the merchandise items attached to the fingers.

8. The image processing apparatus according to claim 1 , wherein

the selecting operation detecting section changes the number in accordance with a direction in which a tip of a finger with no item assigned thereto is moved to draw a circle on the image of the selected merchandise item and with the number of times the circle is drawn.

9. A content processing system comprising:

an image processing apparatus including

a hand recognizing section configured to recognize a state of a hand of a user,

an item image superimposing section configured to superimpose images of merchandise items as selection targets attached to the fingers of the hand that are assigned to the merchandise items on either an image of the hand being displayed or an image representing the hand being displayed, and

a selecting operation detecting section configured to detect that one of the merchandise items is selected on a basis of a hand motion performed on the images of the merchandise items before performing processing corresponding to the detected selection,

wherein the processing includes purchase of the selected merchandise item by the user, and

wherein the selecting operation detecting section detects that an operation is performed to either increase or decrease a number of merchandise items to be purchased in accordance with a predetermined hand motion performed on the image of the selected item; and

a server configured to transmit data of the images of the merchandise items to the image processing apparatus and to acquire information regarding the merchandise item selected by the image processing apparatus, thereby accepting purchase of the item.

10. The content processing system according to claim 9 , wherein

the server transmits data of a moving image of content to the image processing apparatus, and

the item image superimposing section in the image processing apparatus superimposes either the image of the hand fitted with the images of the merchandise items or the image representing the hand fitted likewise on the moving image of the content.

11. An image processing method comprising:

recognizing a state of a hand of a user;

superimposing images of merchandise items as selection targets attached to the fingers of the hand that are assigned to the merchandise items on either an image of the hand being displayed or an image representing the hand being displayed; and

detecting that one of the merchandise items is selected on a basis of a hand motion performed on the images of the merchandise items before performing processing corresponding to the detected selection,

wherein the processing includes purchase of the selected merchandise item by the user; and

detecting that an operation is performed to either increase or decrease a number of merchandise items to be purchased in accordance with a predeteremined hand motion performed on the image of the selected item.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 12, 2020
From: NAKATA, MASASHI
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 052927/0874 →
Priority Claims (1)
JP JP2019-116603 · Jun 24, 2019 · national
Continuity (1)
Related Publication 20200402265A1 · Dec 24, 2020
Cited By (12)
US 12,210,691 US 12,218,944 US 12,229,344 US 12,266,061 US 12,277,301 US 12,346,396 US 12,353,632 US 12,357,911 US 12,507,942 US 12,525,139 US 12,547,237 US 12,632,120