IP Library › Granted Patent US 9,690,473
Granted Patent B2
US 9,690,473 · App. 15/057,092 · Granted Jun 27, 2017

System and method for changing the state of user interface element marked on physical objects

Inventors: Zheng Shi (Beijing, CN); Xingyi Gong (Beijing, CN)
G06F3/0488G06F3/044
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,690,473
App. No.
15/057,092
Granted
Jun 27, 2017
Kind
B2
Abstract

The present invention discloses a system and method for changing the state of a user interface (UI) element of a computer program visually marked on a physical object, through a touch action upon the object, among a plurality of objects on the interactive surface, each comprising a capacitance tab and a unique identification code. During runtime execution of the computer program, and in response to a touch action upon an object by an end-user, the interactive surface is configured to detect such touch action upon the object through an embedded capacitance sensor positioned under the object, and direct a sensory accessory to indicate a new state of the UI element marked on an object by exhibiting a new sensory pattern. The present invention offers enhanced interactivity between an end-user and a computer program mediated by physical objects.

Claims (34)

1. A system for changing the state of a user interface (UI) element visually marked on physical objects, comprising:

a plurality of physical objects, each comprising a unique identification code (UID) and each visually marked with a UI element of a computer program;

an interactive surface that has no display screen, and is configured to detect the UID of an object, to derive the location and orientation of the object, and to measure capacitance change caused by the object and subsequently by a touch action upon the object, upon the object being placed on the interactive surface;

a sensory accessory that is operatively controlled by the interactive surface, and indicates the current state of the UI element by exhibiting a sensory pattern;

wherein, during runtime execution of the computer program, and in response to a touch action upon a first object, the interactive surface is configured to detect the touch action and direct the sensory accessory to indicate a new state of the UI element of a second object that is different from the first object by exhibiting a new sensory pattern for the second object.

2. The system of claim 1 , wherein the UI element is selected from a group comprising start, stop, save, delete, okay, cancel, play, replay, record, complete, copy, duplicate, export, import, a letter of an alphabet, a word of a language, and an icon representing a musical symbol.

3. The system of claim 1 , wherein the state of a UI element is selected from a group comprising active, non-active, in use, not in use, enabled, not enabled, selected, not-selected, not-executing, executing, completed, correct, incorrect, succeeded, and failed.

4. The system of claim 1 , wherein the touch action is selected from a group comprising touching an object once, touching an object more than once in rapid succession, touching an object once but for a duration of time, changing the orientation of an object with finger touch, and changing the location of an object with finger touch.

5. The system of claim 1 , further comprising a computer system that is operatively linked to the interactive surface and is configured to execute the computer program.

6. The system of claim 5 , wherein the computer system stores the current state and a range of valid states of the UI element of the computer program marked on an object, and the relationship between a touch action and a change of the state of the UI element.

7. The system of claim 5 , wherein the interactive surface notifies the computer system of the touch action and receives an instruction according to the computer program regarding changing the current state of the UI element marked on an object.

8. The system of claim 1 , wherein an object is selected from a group comprising a card, a button, a block, an icon, a sheet, and a figurine.

9. The system of claim 1 , wherein the sensory accessory is selected from a group comprising an LED light, an audio device, a video device, and a vibration generator device.

10. A method for changing the state of a user interface (UI) element visually marked on physical objects, comprising:

placing, during runtime execution of a computer program, a plurality of objects on an interactive surface,

wherein each object comprises a unique identification code (UID) and is visually marked with a UI element of the computer program, and

wherein the interactive surface has no display screen, and is configured to detect the UID of the object, derive the location and orientation of the object, and measure capacitance change caused by the object and subsequently by a touch action acted upon the object, upon the object being placed on the interactive surface,

indicating, by exhibiting a sensory pattern, the current state of the UI element marked on a first object, by a sensory accessory that is operatively controlled by the interactive surface,

acting upon the first object by a touch action,

detecting the touch action by the interactive surface,

directing, by the interactive surface, the sensory accessory to indicate a new state of the UI element marked on a second object that is different from the first object by exhibiting a new sensory pattern for the second object.

11. The method of claim 10 , wherein the UI element is selected from a group comprising start, stop, save, delete, okay, cancel, play, replay, record, complete, copy, duplicate, export, import, a letter of an alphabet, a word of a language, and an icon representing a musical symbol.

12. The method of claim 10 , wherein the state of a UI element is selected from a group comprising active, non-active, in use, not in use, enabled, not enabled, selected, not-selected, not-executing, executing, completed, correct, incorrect, succeeded, failed.

13. The method of claim 10 , wherein the touch action is selected from a group comprising touching an object once, touching an object more than once in rapid succession, touching an object once but for a short duration of time, changing the orientation of an object with finger touch, and changing the location of an object with finger touch.

14. The method of claim 10 , further comprising executing the computer program by a computer system that is operatively linked to the interactive surface.

15. The method of claim 14 , further comprising, storing the current state and a range of valid states of the UI element of the computer program marked on an object, and the relationship between a touch action and a change in the state of the UI element, by the computer system.

16. The method of claim 14 , further comprising notifying the computer system of the touch action by the interactive surface and receiving an instruction according to the computer program regarding changing the current state of the UI element marked on an object.

17. The method of claim 10 , wherein an object is selected from a group comprising a card, a button, a block, an icon, a sheet, and a figurine.

18. The method of claim 10 , wherein the sensory accessory is selected from a group comprising an LED light, an audio device, a video device, and a vibration generator device.

19. A system for changing the state of a user interface (UI) element visually marked on physical objects, comprising:

a plurality of physical objects, each comprising a unique identification code (UID) and each visually marked with a UI element of a computer program;

an interactive surface that has no display screen, and is configured to detect the UID of an object, to derive the location and orientation of the object, and to measure capacitance change caused by the object and subsequently by a touch action upon the object, upon the object being placed on the interactive surface;

a sensory accessory that is operatively controlled by the interactive surface, and indicates the current state of the UI element by exhibiting a sensory pattern;

wherein, during runtime execution of the computer program, and in response to a touch action upon an object, with the touch action selected from a group consisting of touching an object more than once in rapid succession, touching an object once but for a duration of time, changing the orientation of an object with finger touch, and changing the location of an object with finger touch, the interactive surface is configured to detect the touch action and direct the sensory accessory to indicate a new state of the UI element of the object by exhibiting a new sensory pattern for the object.

Continuity (7)
Continuation In Part PCTCN2014091918 · Nov 21, 2014
Continuation In Part PCTCN2014090890 · Nov 12, 2014
Continuation In Part PCTCN2014080495 · Jun 23, 2014
Continuation In Part PCTCN2014079892 · Jun 13, 2014
Continuation In Part PCTCN2014086745 · Sep 17, 2014
Continuation In Part PCTCN2014091143 · Nov 14, 2014
Related Publication 20160179333A1 · Jun 23, 2016