LIGHT FIELD PROCESSOR SYSTEM
A wearable ophthalmic device may include a head-mounted light field display configured to generate a physical light field comprising a beam of light. Camera(s) on or in communication with the device may receive light from the surroundings, and a light field processor may determine, based on the light, left and right numerical light field image data describing image(s) to be displayed to the left and right eyes respectively. The left and/or right numerical light field image data can be modified to computationally introduce a shift based on a determined convergence point of the eyes, and the physical light field presented to the user can be generated corresponding to the modified numerical light field image data, e.g., to correct for a convergence deficiency of the eye(s).
1 . A wearable ophthalmic device comprising:
at least one outward facing head-mounted light field camera configured to receive light from surroundings of the device;
a light field processor in communication with the at least one outward facing head-mounted light field camera and configured to:
determine, based on the light received by the at least one outward facing head-mounted light field camera, left numerical light field image data describing images to be displayed to a left eye of a user of the device and right numerical light field image data describing images to be displayed to a right eye of the user;
generate modified numerical light field image data by computationally introducing at least one shift to at least one of the left numerical light field image data or the right numerical light field image data based on a convergence point of the left eye and the right eye of the user; and
a head-mounted light field display configured to generate a physical light field corresponding to the modified numerical light field image data, wherein the physical light field displays images for viewing by the user.
2 . The device of claim 1 , wherein computationally introducing the at least one shift includes computationally introducing a prismatic effect.
3 . The device of claim 1 , wherein the at least one shift includes an angular shift.
4 . The device of claim 1 , wherein the at least one shift includes at least one lateral shift of a location of at least one of the images displayed.
5 . The device of claim 4 , wherein the images include sets of images to be presented to the left eye and the right eye respectively, wherein the light field processor is further configured to determine a gaze direction of at least one of the left eye and the right eye, and wherein the at least one lateral shift adjusts a position of at least one of the sets of images to be centered within a field of view of the corresponding eye based on the respective gaze direction of the eye.
6 . The device of claim 1 , wherein the at least one shift is introduced to correct a convergence deficiency of at least one of the eyes of the user.
7 . The device of claim 1 , wherein at least one of the left outward facing head-mounted light field camera or the right outward facing head-mounted light field camera is an integral imaging camera.
8 . The device of claim 1 , wherein the head-mounted light field display comprises an integral imaging display.
9 . A method performed by a wearable ophthalmic device including a head-mounted light field display, the method comprising:
receiving light from surroundings of the device that is captured by at least one outward facing head-mounted light field camera of the device;
determining, based on the light received by the at least one outward facing head-mounted light field camera, left numerical light field image data describing images to be displayed to a left eye of a user of the device and right numerical light field image data describing images to be displayed to a right eye of the user;
generating modified numerical light field image data by computationally introducing at least one shift to at least one of the left numerical light field image data or the right numerical light field image data based on a convergence point of the left eye and the right eye of the user; and
generating a physical light field that corresponds to the modified numerical light field image data and that is displayed using the head-mounted light field display, wherein the physical light field displays images for viewing by the user.
10 . The method of claim 9 , wherein computationally introducing the at least one shift includes computationally introducing a prismatic effect.
11 . The method of claim 9 , wherein the at least one shift includes an angular shift.
12 . The method of claim 9 , wherein the at least one shift includes at least one lateral shift of a location of at least one of the images displayed.
13 . The method of claim 12 , wherein the images include sets of images to be presented to the left eye and the right eye respectively, wherein the light field processor is further configured to determine a gaze direction of at least one of the left eye and the right eye, and wherein the at least one lateral shift adjusts a position of at least one of the sets of images to be centered within a field of view of the corresponding eye based on the respective gaze direction of the eye.
14 . The method of claim 9 , wherein the at least one shift is introduced to correct a convergence deficiency of at least one of the eyes of the user.
15 . The method of claim 9 , wherein at least one of the left outward facing head-mounted light field camera or the right outward facing head-mounted light field camera is an integral imaging camera.
16 . The method of claim 9 , wherein the head-mounted light field display comprises an integral imaging display.
17 . Non-transitory computer-readable storage media storing instructions which, when executed by at least one processor, instruct the at least one processor to perform actions comprising:
receiving light from surroundings of a wearable ophthalmic device that includes a head-mounted light field display, wherein the light is captured by at least one outward facing head-mounted light field camera of the device;
determining, based on the light received by the at least one outward facing head-mounted light field camera, left numerical light field image data describing images to be displayed to a left eye of a user of the device and right numerical light field image data describing images to be displayed to a right eye of the user;
generating modified numerical light field image data by computationally introducing at least one shift to at least one of the left numerical light field image data or the right numerical light field image data based on a convergence point of the left eye and the right eye of the user; and
generating a physical light field that corresponds to the modified numerical light field image data and that is displayed using the head-mounted light field display, wherein the physical light field displays images for viewing by the user.