IP Library Granted Patent US 7,233,904
Granted Patent B2
US 7,233,904 · App. 11/403,716 · Granted Jun 19, 2007

Menu-driven voice control of characters in a game environment

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,233,904
App. No.
11/403,716
Granted
Jun 19, 2007
Kind
B2
Abstract

In a gaming system, a user controls actions of characters in the game environment using speech commands. In a learning mode, available speech commands are displayed in a command menu on a display device. In a non-learning mode, the available speech commands are not displayed. A speaker-independent context-sensitive speech recognition module contains a vocabulary of available speech commands. Use of speech commands is combined with input from a controller device to control actions of a character or characters in the game environment.

Claims (41)

1. A method for voice control of at least one character in a visually dynamic and interactive game environment, comprising:

receiving a complete and uninterrupted command from a user, the complete and uninterrupted command comprising a plurality of vocal utterances;

determining whether a first vocal utterance from the plurality of vocal utterances corresponds to a first command item from a first-command level in a vocabulary of command items;

if the first vocal utterance corresponds to a first command item from the first command level in the vocabulary of command items, determining whether the first command item from the first command level is associated with a subsequent command item from a subsequent command level in the vocabulary of command items; and

if the first command item from the first command level is associated with a subsequent command item from a subsequent command level in the vocabulary of command items, determining whether a subsequent vocal utterance from the plurality of vocal utterances corresponds to the associated subsequent command item from the subsequent command level in the vocabulary of command items, wherein if the subsequent vocal utterance corresponds to the associated subsequent command item from the subsequent command level in the vocabulary of command items, performing an action that corresponds to the complete and uninterrupted command.

2. The method of claim 1 , wherein determining whether the first vocal utterance from the plurality of vocal utterances corresponds to a first command item from a first command level in a vocabulary of command items comprises evaluating a context of the utterance.

3. The method of claim 1 , wherein the complete and uninterrupted command comprises an actor and an associated action.

4. The method of claim 1 , wherein the complete and uninterrupted command is a sentence-type command.

5. The method of claim 1 , wherein at least one vocal utterance from the plurality of vocal utterances comprises at least two words.

6. The method of claim 1 , wherein a command item from a command level in the vocabulary of command items is a single-word command.

7. The method of claim 1 , wherein a command item from a command level in the vocabulary of command items is a multiple-word command.

8. The method of claim 1 , further comprising providing an acknowledgment of the complete and uninterrupted command prior to performing the action that corresponds to the complete and uninterrupted command.

9. The method of claim 1 , wherein the complete and uninterrupted command is received in conjunction with at least one command from a controller device.

10. The method of claim 9 , wherein the at least one command from the controller device comprises actuation of voice control of the at least one character in the visually dynamic and interactive game environment.

11. The method of claim 9 , wherein the action that corresponds to the complete and uninterrupted command is performed in conjunction with an action that corresponds to the at least one command from the controller device.

12. The method of claim 1 , further comprising displaying a menu of available subsequent command items from the subsequent command level in the vocabulary of command items.

13. The method of claim 12 , wherein the menu of available command items is no longer displayed upon determining that a subsequent vocal utterance from the plurality of vocal utterances corresponds to a subsequent command item from the subsequent command level in the vocabulary of command items.

14. The method of claim 13 , wherein the subsequent command item from the subsequent command level in the vocabulary of command items that corresponds to the subsequent vocal utterance from the plurality of vocal utterances continues to be displayed.

15. The method of claim 12 , wherein the menu is a branching menu.

16. The method of claim 1 , wherein if the subsequent vocal utterance corresponds to the associated subsequent command item from the subsequent command level in the vocabulary of command items, determining whether the subsequent command item from the subsequent command level is associated with another command item from another command level in the vocabulary of command items; and

if the subsequent command item from the subsequent command level is associated with another command item from another command level in the vocabulary of command items, determining whether another vocal utterance from the plurality of vocal utterances corresponds to the associated another command item from the another command level in the vocabulary of command items.

17. The method of claim 16 , wherein if the another vocal utterance corresponds to the associated another command item from the another command level in the vocabulary of command items, performing an action that corresponds to the complete and uninterrupted command.

18. A machine-readable medium having embodied thereon a program, the program being executable by a machine to perform a method for controlling at least one character in a visually dynamic and interactive game environment, the method comprising:

receiving a complete and uninterrupted command from a user, the complete and uninterrupted command comprising a plurality of vocal utterances;

determining whether a first vocal utterance from the plurality of vocal utterances corresponds to a first command item from a first command level in a vocabulary of command items;

if the first vocal utterance corresponds to a first command item from the first command level in the vocabulary of command items, determining whether the first command item from the first command level is associated with a subsequent command item from a subsequent command level in the vocabulary of command items; and

if the first command item from the first command level is associated with a subsequent command item from a subsequent command level in the vocabulary of command items, determining whether a subsequent vocal utterance from the plurality of vocal utterances corresponds to the associated subsequent command item from the subsequent command level in the vocabulary of command items, wherein if the subsequent vocal utterance corresponds to the associated subsequent command item from the subsequent command level in the vocabulary of command items, performing an action that corresponds to the complete and uninterrupted command.

19. The machine-readable medium of claim 18 , further comprising displaying a menu of available subsequent command items from the subsequent command level in the vocabulary of command items.

20. The method of claim 19 , wherein the menu of available command items is no longer displayed upon determining that a subsequent vocal utterance from the plurality of vocal utterances corresponds to a subsequent command item from the subsequent command level in the vocabulary of command items.

21. The method of claim 20 , wherein the subsequent command item from the subsequent command level in the vocabulary of command items that corresponds to the subsequent vocal utterance from the plurality of vocal utterances continues to be displayed.

22. A system for controlling at least one character in a visually dynamic and interactive game environment, the system comprising:

a microphone configured to receive a complete and uninterrupted command from a user, the complete and uninterrupted command comprising a plurality of vocal utterances;

a speech recognition module coupled to the microphone, the speech recognition module the speech recognition module configured to:

determine whether a first vocal utterance from the plurality of vocal utterances corresponds to a first command item from a first command level in a vocabulary of command items;

if the first vocal utterance corresponds to a first command item from the first command level in the vocabulary of command items, determine whether the first command item from the first command level is associated with a subsequent command item from a subsequent command level in the vocabulary of command items;

if the first command item from the first command level is associated with a subsequent command item from a subsequent command level in the vocabulary of command items, determine whether a subsequent vocal utterance from the plurality of vocal utterances corresponds to the associated subsequent command item from the subsequent command level in the vocabulary of command items; and

if the subsequent vocal utterance corresponds to the associated subsequent command item from the subsequent command level in the vocabulary of command items, generate a notification for game software corresponding to the visually dynamic and interactive game environment to provide instructions causing the at least one character to perform an action that corresponds to the complete and uninterrupted command.

23. The system of claim 22 , further comprising a controller device configured to provide instructions for controlling an action of the at least one character, the action corresponding to the instruction.

24. The system of claim 22 , further comprising a graphics processing unit configured to generate a menu of available subsequent command items from the subsequent command level in the vocabulary of command items.

25. The system of claim 24 , wherein the menu of available command items is no longer displayed upon determining that a subsequent vocal utterance from the plurality of vocal utterances corresponds to a subsequent command item from the subsequent command level in the vocabulary of command items.

26. The system of claim 25 , wherein the subsequent command item from the subsequent command level in the vocabulary of command items that corresponds to the subsequent vocal utterance from the plurality of vocal utterances continues to be displayed.

Assignments (4)
MERGER Recorded Mar 30, 2020
From: SONY INTERACTIVE ENTERTAINMENT AMERICA LLC
To: SONY INTERACTIVE ENTERTAINMENT LLC
Reel/Frame 053323/0567 →
CHANGE OF NAME Recorded May 4, 2016
From: SONY COMPUTER ENTERTAINMENT AMERICA LLC
To: SONY INTERACTIVE ENTERTAINMENT AMERICA LLC
Reel/Frame 038611/0846 →
MERGER Recorded Nov 9, 2010
From: SONY COMPUTER ENTERTAINMENT AMERICA INC.
To: SONY COMPUTER ENTERTAINMENT AMERICA LLC
Reel/Frame 025406/0506 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 13, 2006
From: LUISI, SETH C. H.
To: SONY COMPUTER ENTERTAINMENT AMERICA INC.
Reel/Frame 017792/0104 →