IP Library Patent Application 14012920
Patent Application
App. No. 14/012,920

VOICE AND VIDEO CONTROL OF INTERACTIVE ELECTRONICALLY SIMULATED ENVIRONMENT

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
14/012,920
Abstract

A method of moving objects in a graphical user interface, includes obtaining a video image of a user of the interface; displaying the video image on a display such that the video image is superposed with one or more objects displayed on the display; and moving one or more objects displayed on the display based on recognition of motions of the video image of the user. Recognition of motions of the video image may include recognition of motions of an image of the user's hand.

Claims (33)

1 . A graphical user interface, comprising:

a processor configured to:

obtain a video image of a user of the interface with an image capture device that the user faces while facing a display;

display a mirror image of the video image on the display such that the video image is superposed with one or more objects displayed on the display; and

move one or more objects displayed on the display based on recognition of motions of the mirror image of the video image of the user, wherein moving the one or more objects includes, determining whether the user's arm crosses the user's chest, and positioning one or more objects differently depending on whether the user's arm crosses the user's chest.

2 . The graphical user interface of claim 1 , wherein the one or more objects include a medium icon array arranged in a first direction, and including a plurality of user selectable medium icons; and

a contents icon array arranged in a second direction, and including a plurality of user selectable contents icons.

3 . The graphical user interface of claim 1 , wherein the plurality of user selectable contents icons is accessed from a database divided into a plurality of entries, each entry configured to be fixed in size and including at least data for each contents icon of the plurality of user selectable contents icons, such that the contents icons can be quickly accessed and scrolled in the graphical user interface at a relatively high speed.

4 . The graphical user interface of claim 3 , wherein the medium icon array and the contents icon array are configured in a cross shape with an intersecting area.

5 . The graphical user interface of claim 3 , further comprising a cache configured to store data from the database.

6 . The graphical user interface of claim 5 , wherein the cache is configured to be overwritten without updating to the database unless changes have been made to the cache.

7 . The graphical user interface of claim 3 , wherein the graphical user interface is configured to receive a voice command and select one or more contents icons from the contents icon array in response to the voice command.

8 . The graphical user interface of claim 7 , wherein graphical user interface is configured to cause a list of selected content icons to be displayed on a display based on a keyword in the voice command.

9 . The graphical user interface of claim 3 , wherein one contents icons in the contents icon array includes a one or more images representative of corresponding data in a contents file.

10 . The graphical user interface of claim 1 , wherein the database is stored in a multimedia processing apparatus.

11 . The graphical user interface of claim 1 , wherein the graphical user interface is implemented in a multimedia processing apparatus.

12 . The graphical user interface of claim 11 , wherein the multimedia processing apparatus is a game console, television, digital video recorder (DVR), cable set-top-box, home media server or consumer electronic device.

13 . The graphical user interface of claim 1 wherein recognition of motions of the video image includes recognition of motions of an image of the user's hand.

14 . The graphical user interface of claim 13 wherein recognition of motions of an image of the user's hand include recognition of a change in aspect ratio of the image of the user's hand.

15 . The graphical user interface of claim 1 wherein the graphical user interface is configured to recognize whether a user is using his left or right hand.

16 . The graphical user interface of claim 15 , wherein recognizing whether a user is using his left or right hand includes determining a relative location of an image of the user's hand relative to an image of the user's head.

17 . The graphical user interface of claim 16 wherein determining a relative location of the user's hand relative to an image of the user's head includes determining whether a user's arm crosses a user's chest.

18 . A method of scrolling in a graphical user interface, comprising:

receiving a voice command to scroll a plurality of contents icons displayed in the graphical user interface; and

retrieving an appropriate number of additional contents icons from a contents icon database to provide a scrolled display in the graphical user interface,

wherein the contents icon database is divided into a plurality of entries, each entry of the plurality of entries including at least data for a contents icon of the plurality of contents icons and a link to a contents file, wherein the data in each entry of the database is configured to be fixed in size so that the data for the contents icon can be quickly accessed, and the contents icon can be scrolled in the graphical user interface at a relatively high speed.

19 . A multimedia processing apparatus, comprising:

an audio signal capture device;

a memory configured as a contents icon database, including

a plurality of entries including data for a plurality of contents icons and links to multimedia contents,

wherein the data in each entry of said plurality of entries is fixed in size such that the plurality of contents icons can be quickly accessed to allow the contents icons to be scrolled in a graphical user interface at a relatively high speed; and

a processor coupled to the audio signal capture device, the processor being configured to load the plurality of contents icons to allow a user to scroll and select a particular contents icon from the plurality of contents icons based on one or more voice commands from a user.

20 . The multimedia processing apparatus of claim 19 , wherein the multimedia processing apparatus is a game console, television, digital video recorder (DVR), cable set-top-box, home media server or consumer electronic device.

Assignments (2)
CHANGE OF NAME Recorded Jul 1, 2016
From: SONY COMPUTER ENTERTAINMENT INC.
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 039239/0343 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 29, 2013
From: MARKS, RICHARD L.; CHEN, RUXIN
To: SONY COMPUTER ENTERTAINMENT INC.
Reel/Frame 031114/0185 →