IP Library Granted Patent US 9,208,763
Granted Patent B2
US 9,208,763 · App. 14/268,324 · Granted Dec 8, 2015

Method, apparatus and software for providing user feedback

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,208,763
App. No.
14/268,324
Granted
Dec 8, 2015
Kind
B2
Abstract

A device for providing feedback to a user of a string instrument is described. The device comprises receiving circuitry operable in use to communicate with at least one finger sensor capable of detecting the force of a finger on a string, a camera operable in use to capture an image and a display operable in use to display data, wherein the receiving circuitry, camera and display are connected to processing circuitry which is operable to: detect, from the receiving circuitry, the force of a user's finger on at least one string at a given time; detect, from the camera, the position of the user's finger on the at least one string at the given time; compare the detected force of the user's finger and the position of the user's finger on the at least one string at the given time with a predetermined value of force and position at the given time; and generate, on the basis of the said comparison, feedback to display on the display.

Claims (50)

1. A method of providing feedback to a user of a string instrument, comprising:

detecting a force of a user's finger on at least one string at a given time;

detecting a position of the user's finger on the at least one string at the given time;

comparing the detected force of the user's finger and the position of the user's finger on the at least one string at the given time with at least two predetermined values of force and position at the given time; and

generating feedback to display to the user on the basis of the said comparison.

2. The method according to claim 1 , further comprising:

detecting a frequency of vibration on the user's finger at the given time;

calculating a frequency spectrum of the vibration at the given time; and

determining a number of strings played by the user at the given time.

3. The method according to claim 1 , further comprising:

receiving an image of the string instrument and

determining the position of the user's finger on the string instrument from the received image.

4. The method according to claim 3 , wherein the position of the user's finger is determined by performing edge detection on the received image.

5. The method according to claim 3 , further comprising:

performing image detection on the received image, wherein the position of the user's finger is determined by detecting a colored finger sensor in the received image.

6. The method according to claim 1 , further comprising:

determining a difference between the detected force and at least one of the predetermined values of force at the given time; and

determining an error based on the determined differences over a predetermined time.

7. The method according to claim 1 , further comprising:

determining a difference between the detected force and at least one of the predetermined values of force at the given time; and

determining when the difference exceeds a threshold over a predetermined period of time.

8. A device for providing feedback to a user of a string instrument, comprising:

receiving circuitry configured to communicate with at least one finger sensor capable of detecting a force of a finger on a string, a camera configured to capture an image and a display configured to display data, wherein the receiving circuitry, camera and display are connected to processing circuitry which is configured to:

detect, from the receiving circuitry, the force of a user's finger on at least one string at a given time;

detect, from the camera, a position of the user's finger on the at least one string at the given time;

compare the detected force of the user's finger and the position of the user's finger on the at least one string at the given time with at least two predetermined values of force and position at the given time; and

generate, on the basis of the said comparison, feedback to display on the display.

9. The device according to claim 8 , wherein the processing circuitry is further configured to

detect, from the receiving circuitry, a frequency of vibration on the user's finger at the given time;

calculate a frequency spectrum of the vibration at the given time; and

determine a number of strings played by the user at the given time.

10. The device according to claim 8 , wherein the processing circuitry is further configured to

receive an image of the string instrument from the camera; and

determine the position of the user's finger on the string instrument from the received image.

11. The device according to claim 10 , wherein the position of the user's finger is determined by performing edge detection on the received image.

12. The device according to claim 10 , wherein the processing circuitry is further configured to perform image detection on the received image, and the position of the user's finger is determined by detecting a colored finger sensor in the received image.

13. The device according to claim 8 , wherein the processing circuitry is further configured to

determine a difference between the detected force and at least one of the predetermined values of force at the given time; and

determine an error based on the determined differences over a predetermined time.

14. The device according to claim 8 , wherein the processing circuitry is further configured to

determine a difference between the detected force and at least one of the predetermined values of force at the given time; and

determine when the difference exceeds a threshold over a predetermined period of time.

15. A tablet device for providing feedback to a user of a string instrument, comprising:

receiving circuitry configured to communicate with at least one finger sensor capable of detecting a force of a finger on a string, a camera configured to operable in use to capture an image and a display configured to display data, wherein the receiving circuitry, camera and display are connected to processing circuitry which is configured to:

detect, from the receiving circuitry, the force of a user's finger on at least one string at a given time;

detect, from the camera, a position of the user's finger on the at least one string at the given time;

compare the detected force of the user's finger and the position of the user's finger on the at least one string at the given time with at least two predetermined values of force and position at the given time; and

generate, on the basis of the said comparison, feedback to display on the display.

16. Computer software comprising computer readable code which when loaded onto a computer configures the computer to perform the method according to claim 1 .

17. A non-transitory storage medium configured to store the computer software of claim 16 thereon or therein.

Assignments (2)
MERGER Recorded Mar 13, 2020
From: SONY EUROPE LIMITED
To: SONY EUROPE B.V.
Reel/Frame 052162/0623 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2014
From: AVITABILE, ANTONIO; CHEN, XIAOMING
To: SONY CORPORATION; SONY EUROPE LIMITED
Reel/Frame 032812/0584 →