Granted Patent B2

US 12,724,580 · App. 19/078,640 · Granted Sep 1, 2026

Inventors: Hitoshi Akiyama (Kyoto, JP); Nobukazu Kondo (Kyoto, JP); Yoshinori Okada (Kyoto, JP)

Assignee: MAXELL, LTD.

G06F3/14G06F3/012G06F3/013G06T5/50G06V10/24G06T2207/20221G06V2201/07

Abstract

Claims (94)

1 . An information processing device, comprising:

a camera;

a display screen for displaying a captured image captured by the camera;

a communication unit configured to provide communication with an image display device that is separate from the information processing device; and

a processor connected to the camera, the display screen, and the communication unit, respectively,

the processor being configured to:

receive gaze detection information indicative of whether a line-of-sight destination of the user is in the display screen via the communication unit from the image display device while the camera is capturing an image;

if the gaze detection information shows the line-of-sight destination of the user is not in the display screen, transfer the captured image being displayed on the display screen to the image display device via the communication unit; and

transmit, to the image display device, a display start signal for causing the image display device to display the captured image as transferred.

2 . The information processing device according to claim 1 , further comprising a storage in which the captured image is recorded, wherein

the display screen includes a shutter button for inputting an instruction of image recording to the storage, and an image display area in which the captured image is to be displayed,

the processor is connected to the storage, and

while transferring the captured image to the image display device, the processor carries out control to stop displaying the captured image and the shutter button on the display screen, and also display an extended shutter button for inputting the instruction of image recording to the storage in an area larger than an area of the shutter button within the image display area.

3 . The information processing device according to claim 2 , wherein

the processor carries out control to display the extended shutter button in an area inside a margin area predefined from an edge of the image display area.

4 . The information processing device according to claim 1 , wherein

upon receiving the gaze detection information indicative of whether the line-of-sight destination of the user is in the display screen while transferring the captured image to the image display device, the processor stops transferring the captured image to the image display device, and transmits, to the image display device, a display stop signal for causing the image display device to stop displaying the captured image that has been transferred.

5 . The information processing device according to claim 1 , further comprising a posture sensor configured to detect a tilt of the information processing device and output posture information, wherein

the processor is connected to the posture sensor, and

the processor is configured to:

based on the posture information, correct a tilt of a subject captured in the captured image in a direction that cancels the tilt of the information processing device to generate a corrected captured image; and

transmit the corrected captured image and the display start signal to the image display device.

6 . The information processing device according to claim 1 , further comprising a touch panel laminated on the display screen, wherein

the touch panel is configured to detect a touch operation on the touch panel and output touch information,

the processor is connected to the touch panel, and

upon acquiring the touch information while the camera is capturing an image and the captured image is being displayed on the display screen, the processor transmits the captured image and the display start signal to the image display device.

7 . The information processing device according to claim 1 , further comprising a depth sensor configured to detect a distance from the information processing device to an object and output distance information, wherein

the processor is further connected to the depth sensor, and

the processor is configured to:

while the camera is capturing an image and the captured image is being displayed on the display screen, detect an interval between the information processing device and the image display device based on the distance information; and

upon determining that the interval as detected is equal to or more than a predetermined distance threshold, transmit the captured image and the display start signal to the image display device.

8 . An image display device, comprising:

a display screen;

a line-of-sight sensor configured to detect a line of sight of a user and output line-of-sight information indicating a line-of-sight direction of the user;

a communication unit configured to provide communication with an information processing device that is a device separate from the image display device; and

a processor connected to the display screen, the line-of-sight sensor, and the communication unit, respectively,

the processor being configured to:

receive image capturing information indicative of whether the information processing device is capturing an image;

if the image capturing information shows that the information processing device is capturing an image, generate gaze detection information indicative of a result of determination which has been made for whether a line-of-sight destination of the user is in a display screen of the information processing device based on the line-of-sight information;

upon determining that the line-of-sight destination of the user is not in the display screen of the information processing device, transmit the gaze detection information to the information processing device via the communication unit; and

if receiving a captured image and a display start signal from the information processing device via the communication unit, start displaying the captured image on the display screen in response to the display start signal.

9 . A captured image transfer and display system, comprising an information processing device and an image display device,

wherein the information processing device comprises:

a camera;

a first display screen configured to display a captured image captured by the camera;

a first communication unit configured to perform communication with the image display device;

a storage configured to record the captured image; and

a first processor connected to the camera, the first display screen, the first communication unit, and the storage,

wherein the first display screen includes a shutter button through which an instruction to record an image in the storage is input,

wherein the first processor is configured to:

while the camera is capturing an image, receive, from the image display device via the first communication unit, gaze detection information indicative of whether a line-of-sight destination of a user is in the first display screen;

if the gaze detection information indicates that the line-of-sight destination of the user is not in the first display screen, transfer the captured image being displayed on the first display screen to the image display device via the first communication unit, and transmit, to the image display device, a display start signal for causing the image display device to display the transferred captured image; and

while the captured image is being transferred to the image display device, stop displaying the captured image and the shutter button on the first display screen,

wherein the image display device comprises:

a second display screen;

a line-of-sight sensor configured to detect a line of sight of a user and output line-of-sight information indicating a line-of-sight direction of the user;

a second communication unit configured to perform communication with the information processing device; and

a second processor connected to the second display screen, the line-of-sight sensor, and the second communication unit, and

wherein the second processor is configured to:

receive, via the second communication unit, image capturing information indicative of whether the information processing device is capturing an image;

if the image capturing information indicates that the information processing device is capturing an image, generate, based on the line-of-sight information, gaze detection information indicative of a result of determination as to whether a line-of-sight destination of the user is in a display screen of the information processing device;

upon determining that the line-of-sight destination of the user is not in the display screen of the information processing device, transmit the gaze detection information to the information processing device via the second communication unit; and

if a captured image and a display start signal are received from the information processing device via the second communication unit, start displaying the captured image on the second display screen in response to the display start signal.

10 . The captured image transfer and display system according to claim 9 , wherein

the captured image is recorded as a recorded captured image in the storage,

the processor of the information processing device transfers the recorded captured image to the image display device, and

the processor of the image display device displays both the recorded captured image and the captured image.

11 . The captured image transfer and display system according to claim 9 , wherein

the recorded captured image is a panoramic image captured by the information processing device,

the image display device is a head-mounted display of which the display screen thereof is positioned in front of an eye of the user with being worn on a head of the user,

the head-mounted display includes a motion detection sensor configured to detect a motion of the head and output motion quantity information indicating a direction and a quantity of the motion,

the processor of the head-mounted display is further connected to the motion detection sensor, and

the processor of the head-mounted display is configured to:

upon receiving the panoramic image, display the panoramic image so that a center of the panoramic image is aligned with a center of the display screen of the head-mounted display; and

move a display range of the panoramic image in accordance with the motion quantity information to display the panoramic image on the display screen of the head-mounted display.

12 . The captured image transfer and display system according to claim 9 , wherein

the information processing device further includes an in-camera provided on a surface which is the same that for the display screen thereof,

the processor of the information processing device is further connected to the in-camera,

the image display device is a head-mounted display of which the display screen thereof is positioned in front of an eye of the user with being worn on a head of the user,

the head-mounted display further includes an out-camera for capturing an image of an outside world,

the processor of the head-mounted display is connected to the out-camera,

when the in-camera is activated and starts generating a captured image, the processor of the information processing device transfers the captured image to the head-mounted display regardless of whether the line-of-sight destination of the user is in the display screen, and

the processor of the head-mounted display is configured to:

carry out object detection processing on the captured image captured by the out-camera to detect a position of the in-camera;

execute face recognition processing and eye detection processing on the captured image as transferred from the information processing device to detect an area of the eye of the user captured in the captured image; and

superimpose and display the captured image as transferred from the information processing device on the display screen of the head-mounted display so that the area of the eye in the captured image overlaps a position where the user views the in-camera through the display screen of the head-mounted display.

13 . A captured image transfer and display method to be executed while connecting an information processing device equipped with a camera and an image display device for displaying a captured image captured by the camera and received from the information processing device to communicate with each other, the method comprising:

displaying a shutter button for inputting an instruction of image capturing and image recording on a display screen equipped in the information processing device while the camera is capturing an image;

by the image display device, determining whether a line-of-sight destination of a user of the image display device is in a display screen provided in the information processing device while the camera is capturing an image;

by the image display device, upon determining that the line-of-sight destination of the user is not in the display screen, transmitting a result of determination to the information processing device;

by the information processing device, upon receiving the result of determination, transferring the captured image being displayed on the display screen to the image display device, and also transmitting, to the image display device, a display start signal for causing the image display device to display the captured image as transferred;

by the image display device, receiving the captured image and the display start signal;

by the image display device, displaying the captured image on a display provided in the image display device in response to the display start signal; and

by the information processing device, while transferring the captured image to the image display device, stop displaying the captured image and the shutter button on the information processing device.

Continuity (2)

References Cited (20)