Information processing apparatus and method, and program
The present technology relates to information processing apparatus and method, and a program, which are capable of presenting an operation input unit in a position in which a user easily performs an input operation. An imaging unit captures an image of a vicinity of a display unit. A hand recognition unit recognizes a hand by extracting a hand image obtained by capturing a hand, based on feature information of the hand, from the image captured by the imaging unit. The hand position detection unit specifies a real position on a display unit from information on a position in an image in which the hand image is present. A display control unit for an operation input unit displays an operation input unit in a position on the display unit which is specified based on the position of the hand detected by the hand position detection unit.
1. An information processing apparatus comprising:
circuitry configured to
present various pieces of information on a display surface,
initiate a capturing of a plurality of images,
recognize a hand image including images of a hand, based on the captured plurality of images,
initiate a storing of hand shapes including shapes of a plurality of hands as hand shape patterns,
calculate a hand shape matching degree between the recognized hand shape image and the stored hand shape patterns,
detect a position and an angle of each part of a plurality of parts of the hand with respect to the display surface based on a position of the recognized hand image and a matching hand shape pattern of the stored hand shape patterns having a maximum calculated hand shape matching degree,
present, when the maximum calculated hand shape matching degree is greater than a predetermined value, an operation input interface for each part of the hand including one or more operation buttons for each respective part of the hand at a plurality of positions along a respective angle on the display surface according to the detected position and the detected angle of the respective part of the hand, and
present, when the maximum calculated hand shape matching degree is not greater than the predetermined value, an operation input interface for a selected part of the hand.
2. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to
extract a candidate hand shape pattern having a size substantially equal to a size of the recognized hand image from the plurality of captured images, from among the stored hand shape patterns,
move the extracted candidate hand shape pattern while changing a position of the extracted candidate hand shape pattern at a predetermined interval, and
rotate the extracted candidate hand shape pattern by a predetermined angle,
wherein the hand shape matching degree between the extracted candidate hand shape pattern and the hand shape region among the plurality of captured hand images is calculated while changing the hand shape pattern and rotating the extracted candidate hand shape pattern.
3. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to
initiate a storing of part shape patterns including shapes of the plurality of parts of the hand based on the recognized hand image,
calculate a part shape matching degree between each part of the plurality of parts of the hand based on the recognized hand image, among images of the part of the hand which are recognized as the image of the part of the hand from the images, and the stored part shape pattern, and
detect a position of each part of the hand based on a stored part shape pattern having a maximum calculated part shape matching degree.
4. The information processing apparatus according to claim 3 ,
wherein, if the maximum calculated part shape matching degree in the position of the detected part shape is greater than a predetermined value, the circuitry presents the operation input interface for operating with the selected part of the hand having the maximum calculated part shape matching degree among the plurality of parts of the hand, according to the detected position of the selected part of the hand.
5. The information processing apparatus according to claim 4 , wherein the circuitry is further configured to
extract a candidate part shape pattern having a size substantially equal to a size of the part of the hand recognized as the image of a part of the hand from the plurality of captured images, among the stored part shape patterns,
move the extracted candidate part shape pattern while changing a position of the extracted candidate part shape pattern at a predetermined interval,
rotate the extracted candidate part shape pattern by a predetermined angle, and
calculate the part shape matching degree between the extracted candidate part shape pattern and the part shape region, while changing the part shape pattern through moving and rotating the extracted candidate part shape pattern.
6. The information processing apparatus according to claim 3 ,
wherein the part of the hand includes at least one of a thumb, an index finger, a middle finger, a ring finger, and a little finger.
7. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to
recognize a gesture of the hand,
wherein the operation input interface is presented based on the recognized gesture, and according to the position of the hand detected by throughout the recognized gesture.
8. The information processing apparatus according to claim 4 ,
wherein the part of the hand includes at least one of a thumb, an index finger, a middle finger, a ring finger, and a little finger.
9. The information processing apparatus according to claim 1 , wherein the circuitry presents the operation interface for the selected part of the hand according to a detected size and position of the selected part of the hand.
10. An information processing method, performed via at least one processor, the method comprising:
initiating a capturing of a plurality of images,
recognizing a hand image including images of a hand, based on the captured plurality of images,
initiating a storing of hand shapes including shapes of a plurality of hands as hand shape patterns,
calculating a hand shape matching degree between the recognized hand shape image and the stored hand shape patterns,
detecting a position and an angle of each part of a plurality of parts of the hand with respect to a display surface based on a position of the recognized hand image and a matching hand shape pattern of the stored hand shape patterns having a maximum calculated hand shape matching degree;
presenting, when the maximum calculated hand shape matching degree is greater than a predetermined value, an operation input interface for each part of the hand including one or more operation buttons for each respective part of the hand at a plurality of positions along a respective angle on the display surface according to the detected position and the detected angle of the respective part of the hand; and
presenting, when the maximum calculated hand shape matching degree is not greater than the predetermined value, an operation input interface for a selected part of the hand.
11. A non-transitory computer-readable storage medium having embodied thereon a program, which when executed by a computer causes the computer to execute a process, the process comprising:
initiating a capturing of a plurality of images,
recognizing a hand image including images of a hand, based on the captured plurality of images,
initiating a storing of hand shapes including shapes of a plurality of hands as hand shape patterns,
calculating a hand shape matching degree between the recognized hand shape image and the stored hand shape patterns,
detecting a position and an angle of each part of a plurality of parts of the hand with respect to a display surface based on a position of the recognized hand image and a matching hand shape pattern of the stored hand shape patterns having a maximum calculated hand shape matching degree;
presenting, when the maximum calculated hand shape matching degree is greater than a predetermined value, an operation input interface for each part of the hand including one or more operation buttons for each respective part of the hand at a plurality of positions along a respective angle on the display surface according to the detected position and the detected angle of the respective part of the hand; and
presenting, when the maximum calculated hand shape matching degree is not greater than the predetermined value, an operation input interface for a selected part of the hand.