IP Library Granted Patent US 9,880,713
Granted Patent B2
US 9,880,713 · App. 14/343,987 · Granted Jan 30, 2018

Display control apparatus, display control method, and program

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,880,713
App. No.
14/343,987
Granted
Jan 30, 2018
Kind
B2
Abstract

An information processing system that acquires captured image data corresponding to a user interface displayed on a first display, the user interface including a plurality of graphic representations each corresponding to a respective function; and controls a second display to display a representation of the user interface based on a recognition process performed on the user interface, the representation of the user interface indicating whether a function corresponding the plurality of the graphic representations is capable of being accessed.

Claims (65)

1. An information processing system, comprising:

a first information processing apparatus including a first display and first circuitry, the first circuitry configured to:

acquire captured image data corresponding to a user interface displayed on a second display of a second information processing apparatus, the user interface including a plurality of graphic representations each corresponding to respective functions;

receive configuration information and authority information corresponding to the user interface from the second information processing apparatus, the authority information indicating whether the second information processing apparatus permits or restricts an execution of a command transmitted from the first circuitry to the second information processing apparatus;

recognize a screen and items included in the captured image data;

control the first display to display, when the authority information indicates that execution of the command is permitted, a first representation of the user interface based on the captured image data, the first representation of the user interface indicating that functions corresponding to the plurality of the graphic representations are capable of being accessed;

control the first display to display, when the authority information indicates that execution of the command is not permitted, a second representation of the user interface based on the captured image data, the second representation of the user interface including a restriction display image superimposed on at least one of the plurality of graphic representations corresponding to a function that is not capable of being accessed;

convert coordinates of the items according to the configuration information, the authority information, and the screen and the items included in the captured image;

transmit the converted coordinates and the command to the second information processing apparatus; and

the second information processing apparatus including second circuitry configured to:

transmit the configuration information and the authority information to the first information processing apparatus;

receive the converted coordinates and the command from the first information processing apparatus;

determine whether the converted coordinates correspond to items within the user interface;

determine, when the converted coordinates correspond to the items within the user interface, whether the command is authorized according to the authority information; and

execute the command when the command is authorized according to the authority information.

2. The information processing system of claim 1 , wherein the first circuitry is further configured to capture the image data corresponding to the user interface displayed on the second display.

3. The information processing system of claim 1 , wherein the configuration information indicates a position at which each of the plurality of graphic representations are displayed on the second display.

4. The information processing system of claim 1 , wherein the first circuitry is further configured to generate the first representation of the user interface or the second representation of the user interface based on the acquired configuration information.

5. The information processing system of claim 1 , wherein the first circuitry is further configured to control the first display to display the second representation of the user interface such that a predetermined visual effect is applied to at least one of the plurality of graphic representations corresponding to a function that is not capable of being accessed.

6. The information processing system of claim 1 , wherein the first circuitry is further configured to control the first display to display the second representation of the user interface such that at least one of the plurality of graphic representations corresponding to a function that is not capable of being accessed is omitted.

7. The information processing system of claim 1 , wherein the first information processing apparatus further comprises a user interface that receives a selection of one of the plurality of graphic representations.

8. The information processing system of claim 7 , wherein

the first information processing apparatus further comprises a communication interface, and

the first circuitry is further configured to control the communication interface to transmit information corresponding to the selection of the one of the plurality of graphic representations to the second information processing apparatus.

9. The information processing system of claim 7 , wherein

the first information processing apparatus further comprises a communication interface, and

the first circuitry is further configured to control the communication interface to transmit command identification information corresponding to the selection of the one of the plurality of graphic representations to the second information processing apparatus.

10. The information processing system of claim 7 , wherein one of the plurality of graphic representations corresponds to an photo browsing application.

11. The information processing system of claim 10 , wherein

the first information processing apparatus further comprises:

a user interface that receives a selection of the graphic representation corresponding to the photo browsing application displayed on the display; and

a communication interface,

the first circuitry is further configured to control the communication interface to transmit information corresponding to the selection of the graphic representation corresponding to the photo browsing application to the second information processing apparatus, and

the second information processing apparatus executes the photo browsing application in response to receiving the information.

12. The information processing system of claim 1 , wherein the captured image data is still image data.

13. The information processing system of claim 1 , wherein the first information processing apparatus further comprises a user interface that receives authentication information corresponding to a function that is not capable of being accessed.

14. The information processing system of claim 13 , wherein the first circuitry is further configured to control the first display to change the representation of the user interface to indicate that a function is capable of being accessed based on the received authentication information.

15. The information processing apparatus of claim 13 , wherein the user interface displays a screen to input the authentication information when a graphic representation corresponding to a function that is not capable of being accessed is selected at the first display.

16. An information processing method performed by an information processing system including a first information processing apparatus and a second information processing apparatus, the method comprising:

acquiring, by first circuitry of the first information processing apparatus, captured image data corresponding to a user interface displayed on a second display of the second information processing apparatus, the user interface including a plurality of graphic representations each corresponding to respective functions;

receiving, by the first circuitry, configuration information and authority information corresponding to the user interface displayed on the display from the second information processing apparatus, the authority information indicating whether the second information processing apparatus permits or restricts an execution of a command transmitted from the first circuitry to the second information processing apparatus;

recognizing, by the first circuitry, a screen and items included in the captured image data;

displaying, by a first display of the fist information processing apparatus when the authority information indicates that execution of the command is permitted, a first representation of the user interface based on the captured image data, the first representation of the user interface indicating that functions corresponding to the plurality of the graphic representations are capable of being accessed;

displaying, by the first display when the authority information indicates that execution of the command is not permitted, a second representation of the user interface based on the captured image data, the second representation of the user interface including a restriction display image superimposed on at least one of the plurality of graphic representations corresponding to a function that is not capable of being accessed;

converting, by the first circuitry, coordinates of the items according to the configuration information, the authority information, and the screen and the items included in the captured image;

transmitting, by the first circuitry, the converted coordinates and the command to the second information processing apparatus;

transmitting, by second circuitry of the second information processing apparatus, the configuration information and the authority information to the first information processing apparatus;

receiving, by the second circuitry, the converted coordinates and the command from the first information processing apparatus;

determining, by the second circuitry, whether the converted coordinates correspond to items within the user interface;

determining, by the second circuitry when the converted coordinates correspond to the items within the user interface, whether the command is authorized according to the authority information; and

executing, by the second circuitry when the command is authorized, the command according to the authority information.

17. An information processing system, comprising:

a first information processing apparatus including a first display and first circuitry, the first circuitry configured to:

acquire captured image data corresponding to a user interface displayed on a second display of a second information processing apparatus, the user interface including a plurality of graphic representations each corresponding to respective functions;

receive configuration information and authority information corresponding to the user interface from the second information processing apparatus, the authority information indicating whether the second information processing apparatus permits or restricts an execution of a command transmitted from the first circuitry to the second information processing apparatus;

recognize a screen and items included in the captured image data;

control the first display to display, when the authority information indicates that execution of the command is permitted, a first representation of the user interface based on the captured image data, the first representation of the user interface indicating that functions corresponding to the plurality of the graphic representations are capable of being accessed;

control the first display to display, when the authority information indicates that execution of the command is not permitted, a second representation of the user interface based on the captured image data, the second representation of the user interface including a restriction display image superimposed on at least one of the plurality of graphic representations corresponding to a function that is not capable of being accessed;

convert coordinates of the items according to the configuration information, the authority information, and the screen and the items included in the captured image; and

transmit the converted coordinates and the command to the second information processing apparatus, wherein

the second information processing apparatus is configured to

receive the converted coordinates and the command from the first information processing apparatus;

determine whether the converted coordinates correspond to items within the user interface;

determine, when the converted coordinates correspond to the items within the user interface, whether the command is authorized according to the authority information; and

execute the command when the command is authorized according to the authority information.

Assignments (2)
CHANGE OF NAME Recorded Dec 17, 2025
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 073986/0571 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 10, 2014
From: KASAHARA, SHUNICHI
To: SONY CORPORATION
Reel/Frame 032395/0413 →