Information processing system and computer system implemented method of processing information
An information processing system includes an image obtaining circuit and a display control circuit. The image obtaining circuit is configured to obtain observation images of a first keyboard of a first keyboard instrument. The display control circuit is configured to display, on a display device, the observation images and reference images. The reference images include moving images of at least one hand and one or more fingers of a reference performer who is playing a second keyboard of a second keyboard instrument. The at least one hand and the one or more fingers of the reference performer are displayed overlapping the first keyboard included in the observation images.
1. An information processing system comprising:
an image obtaining circuit configured to obtain observation images of a first keyboard of a first keyboard instrument; and
a display control circuit configured to display, on a display device, the observation images and reference images, the reference images including moving images of at least one hand and one or more fingers of a reference performer who is playing a second keyboard of a second keyboard instrument,
wherein the at least one hand and the one or more fingers of the reference performer are displayed overlapping the first keyboard included in the observation images.
2. The information processing system according to claim 1 , wherein the display device is mounted on a head of a user of the information processing system.
3. The information processing system according to claim 1 ,
wherein the reference images include the second keyboard played by the reference performer, and
wherein the display control circuit is configured to display the reference images on the display device such that the second keyboard overlaps the first keyboard shown in the observation images.
4. The information processing system according to claim 1 , further comprising a reference identification circuit analyze the observation images to identify a reference position relative to the first keyboard instrument included in the observation images,
wherein the display control circuit is configured to display the reference images at a position corresponding to the reference position.
5. The information processing system according to claim 4 , wherein the reference identification circuit is further configured to detect an end portion of the first keyboard included in the observation images and determine a position of the end portion as the reference position.
6. The information processing system according to claim 4 , wherein the reference identification circuit is further configured to detect a mark on the first keyboard instrument included in the observation images and determine a position of the mark as the reference position.
7. The information processing system according to claim 4 , wherein the reference identification circuit is further configured to detect an operated key from among a plurality of keys of the first keyboard shown in the observation images, and determine a position of the operated key as the reference position.
8. The information processing system according to claim 1 , wherein the display control circuit is further configured to control a numerical value of a transmission parameter of the reference images.
9. The information processing system according to claim 8 , further comprising a performance analysis circuit configured to determine whether the first keyboard instrument is being played,
wherein in a case where it is determined that the first keyboard instrument is not being played, the display control circuit is further configured to set the transmission parameter to a first value, and
wherein in a case where it is determined that the first keyboard instrument is being played, the display control circuit is further configured to set the transmission parameter to a second value that is higher in transmission degree than the first value.
10. The information processing system according to claim 8 ,
wherein in a first motion mode, the display control circuit is further configured to set the transmission parameter to a first value, and
wherein in a second motion mode, the display control circuit is further configured to set the transmission parameter to a second value that is higher in transmission degree than the first value.
11. The information processing system according to claim 1 , further comprising a performance analysis circuit configured to identify an operation position on the first keyboard of the first keyboard instrument,
wherein the display control circuit is further configured to display the reference images in an area of the first keyboard that is higher or lower in sound than a predetermined area of the keyboard, the predetermined area including the operation position.
12. The information processing system according to claim 1 , further comprising a performance analysis circuit configured to identify a performance point in a musical piece,
wherein the display control circuit is further configured to display, on the display device, a performance-point part of the reference images that correspond to the performance point in the musical piece.
13. The information processing system according to claim 12 ,
wherein the performance analysis circuit is further configured to identify a performance speed, and
wherein the display control circuit is further configured to control a reproduction speed of the reference images based on the performance speed.
14. The information processing system according to claim 1 , further comprising a reception control circuit configured to receive, using a communication device, moving image data indicating a motion made by the reference performer,
wherein the display control circuit is configured to display, on the display device, the reference image indicated by the moving image data.
15. The information processing system according to claim 1 , wherein the observation images are obtained from an image pickup device.
16. The information processing system according to claim 15 , wherein the image pickup device is mounted on a head of a user of the information processing system.
17. A computer system implemented method of processing information, the method comprising:
obtaining observation images of a first keyboard of a first keyboard instrument; and
displaying, on a display device, the observation images and reference images, the reference images including a moving image of at least one hand and one or more fingers of a reference performer who is playing a second keyboard of a second keyboard instrument, such that the at least one hand and the one or more fingers of the reference performer are displayed overlapping the first keyboard included in the observation images.
18. The method according to claim 17 , wherein the observation images are obtained from an image pickup device.
19. The method according to claim 18 , wherein the image pickup device is mounted on a head of a user of an information processing system.
20. The method according to claim 17 ,
wherein the reference images include the second keyboard played by the reference performer, and
wherein the reference images are displayed on the display device such that the second keyboard overlaps the first keyboard shown in the observation images.