Granted Patent B2

US 12,204,688 · App. 18/162,914 · Granted Jan 21, 2025

Inventor: Wataru Kaku (Musashino, JP)

Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHA

G06F3/013G06T7/70G06T17/00G09G3/3208G06T2207/30196

Abstract

Claims (63)

1. An information processing apparatus comprising a controller configured to:

for each of a first viewer and a second viewer of a light field display:

identify a three-dimensional coordinate position of eyes;

generate an image according to the three-dimensional coordinate position of the eyes;

identify, based on the three-dimensional coordinate position of the eyes, a channel to which the image is to be output, of a plurality of channels respectively associated with a plurality of light rays to be emitted from the light field display;

output the image to the channel; and

predict a predicted three-dimensional coordinate position of the eyes after a current time;

determine whether the predicted three-dimensional coordinate position of the eyes of the first viewer coincides with the predicted three-dimensional coordinate position of the eyes of the second viewer;

based on the predicted three-dimensional coordinate position of the eyes of the first viewer coinciding with the predicted three-dimensional coordinate position of the eyes of the second viewer:

determine which of the first viewer and the second viewer is a closest viewer to the light field display;

generate a prediction image according to the predicted three-dimensional coordinate position of the eyes of the closest viewer;

identify a prediction channel to which the prediction image is to be output, based on the predicted three-dimensional coordinate position of the eyes of the closest viewer; and

output the prediction image to the prediction channel; and

based on the predicted three-dimensional coordinate position of the eyes of the first viewer not coinciding with the predicted three-dimensional coordinate position of the eyes of the second viewer, for each of the first viewer and the second viewer:

generate a prediction image according to the predicted three-dimensional coordinate position of the eyes;

identify a prediction channel to which the prediction image is to be output, based on the predicted three-dimensional coordinate position of the eyes; and

output the prediction image to the prediction channel.

2. The information processing apparatus according to claim 1 , wherein the controller is further configured to, for each of the first viewer and the second viewer, output the image to an adjacent channel associated with an adjacent emission angle adjacent to an emission angle of a light ray associated with the channel.

3. The information processing apparatus according to claim 1 , wherein the predicted three-dimensional coordinate position is predicted based on a previous three-dimensional coordinate position of the eyes before the current time.

4. The information processing apparatus according to claim 3 , wherein the controller is further configured to, for each of the first viewer and the second viewer:

determine whether the predicted three-dimensional coordinate position of the eyes is out of a viewing angle of the light field display; and

based on the predicted three-dimensional coordinate position of the eyes being out of the viewing angle of the light field display:

estimate an estimated three-dimensional coordinate position of eyes corresponding to a limit value of the viewing angle, based on the previous three-dimensional coordinate position of the eyes before the current time;

generate an estimation image according to the estimated three-dimensional coordinate position of the eyes;

identify a limit channel associated with the limit value of the viewing angle; and

output the estimation image to the limit channel.

5. The information processing apparatus according to claim 1 , wherein the controller is further configured to:

determine, based on the three-dimensional coordinate position of the eyes, that none of the first viewer and the second viewer is present in an emission direction; and

output a predetermined image or not output an image to a channel associated with the emission direction.

6. A method performed by an information processing apparatus, the method comprising:

for each of a first viewer and a second viewer of a light field display:

identifying a three-dimensional coordinate position of eyes;

generating an image according to the three-dimensional coordinate position of the eyes;

identifying, based on the three-dimensional coordinate position of the eyes, a channel to which the image is to be output, of a plurality of channels respectively associated with a plurality of light rays to be emitted from the light field display;

outputting the image to the channel; and

predicting a predicted three-dimensional coordinate position of the eyes after a current time;

determining whether the predicted three-dimensional coordinate position of the eyes of the first viewer coincides with the predicted three-dimensional coordinate position of the eyes of the second viewer;

based on the predicted three-dimensional coordinate position of the eyes of the first viewer coinciding with the predicted three-dimensional coordinate position of the eyes of the second viewer:

determining which of the first viewer and the second viewer is a closest viewer to the light field display;

generating a prediction image according to the predicted three-dimensional coordinate position of the eyes of the closest viewer;

identifying a prediction channel to which the prediction image is to be output, based on the predicted three-dimensional coordinate position of the eyes of the closest viewer; and

outputting the prediction image to the prediction channel; and

based on the predicted three-dimensional coordinate position of the eyes of the first viewer not coinciding with the predicted three-dimensional coordinate position of the eyes of the second viewer, for each of the first viewer and the second viewer:

generating a prediction image according to the predicted three-dimensional coordinate position of the eyes;

identifying a prediction channel to which the prediction image is to be output, based on the predicted three-dimensional coordinate position of the eyes; and

outputting the prediction image to the prediction channel.

7. A non-transitory computer readable medium storing a program configured to cause a computer to execute operations, the operations comprising:

for each of a first viewer and a second viewer of a light field display:

identifying a three-dimensional coordinate position of eyes;

generating an image according to the three-dimensional coordinate position of the eyes;

identifying, based on the three-dimensional coordinate position of the eyes, a channel to which the image is to be output, of a plurality of channels respectively associated with a plurality of light rays to be emitted from the light field display;

outputting the image to the channel; and

predicting a predicted three-dimensional coordinate position of the eyes after a current time;

determining whether the predicted three-dimensional coordinate position of the eyes of the first viewer coincides with the predicted three-dimensional coordinate position of the eyes of the second viewer;

based on the predicted three-dimensional coordinate position of the eyes of the first viewer coinciding with the predicted three-dimensional coordinate position of the eyes of the second viewer:

determining which of the first viewer and the second viewer is a closest viewer to the light field display;

generating a prediction image according to the predicted three-dimensional coordinate position of the eyes of the closest viewer;

identifying a prediction channel to which the prediction image is to be output, based on the predicted three-dimensional coordinate position of the eyes of the closest viewer; and

outputting the prediction image to the prediction channel; and

based on the predicted three-dimensional coordinate position of the eyes of the first viewer not coinciding with the predicted three-dimensional coordinate position of the eyes of the second viewer, for each of the first viewer and the second viewer:

generating a prediction image according to the predicted three-dimensional coordinate position of the eyes;

identifying a prediction channel to which the prediction image is to be output, based on the predicted three-dimensional coordinate position of the eyes; and

outputting the prediction image to the prediction channel.

Assignments (1)

Priority Claims (1)

Continuity (1)

References Cited (13)