IP Library › Granted Patent US 12,386,310
Granted Patent B2
US 12,386,310 · App. 17/922,726 · Granted Aug 12, 2025

Information processing device, information processing method, program, and hologram display system

Inventors: Shihhao Wen (Los Angeles, CA); Masato Akao (Kanagawa, JP); Yoshiaki Kouyama (Kanagawa, JP)
Assignee: SONY GROUP CORPORATION
G03H1/04G03H1/02G06F3/013G06T7/50G06V20/70G03H2001/0224
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,386,310
App. No.
17/922,726
Granted
Aug 12, 2025
Kind
B2
Abstract

User experience is improved. An information processing device includes: a grouping unit ( 21 ) that groups a plurality of pixels configuring one or more objects included in one piece of image data into one or more groups; a phase adjustment unit ( 22 ) that allocates, to the plurality of pixels, a phase pattern having a phase difference different for each of the one or more groups; and a calculation unit ( 30 ) that generates hologram data from the image data to which the phase pattern is added.

Claims (50)

1. An information processing device comprising:

a grouping unit that groups a plurality of pixels configuring one or more objects included in one piece of image data into one or more groups;

a phase adjustment unit that allocates, to the plurality of pixels, a phase pattern having a phase difference different for each of the one or more groups; and

a calculation unit that generates hologram data from the image data to which the phase pattern is added.

2. The information processing device according to claim 1 , wherein the phase adjustment unit allocates, to the plurality of pixels, the phase pattern having a maximum phase difference different for each of the one or more groups.

3. The information processing device according to claim 1 , wherein

the image data includes label information regarding the one or more objects, and

the grouping unit groups the plurality of pixels into the one or more groups on a basis of the label information.

4. The information processing device according to claim 1 , further comprising:

an image analysis unit that analyzes the image data to add a label to each pixel configuring the image data, wherein

the grouping unit groups the plurality of pixels into the one or more groups on a basis of the label added by the image analysis unit.

5. The information processing device according to claim 1 , further comprising:

a line-of-sight tracking unit that detects a line-of-sight direction of a user, wherein

the grouping unit groups pixels configuring an object, which is associated with a body positioned in the line-of-sight direction in a real space, among the one or more objects into a first group, and groups pixels configuring an object, which is associated with a body not positioned in the line-of-sight direction, into a second group.

6. The information processing device according to claim 1 , further comprising:

an imaging unit that images surroundings of a user; and

a characteristic detection unit that detects characteristics of bodies present around the user by analyzing image data acquired by the imaging unit, wherein

the grouping unit groups the plurality of pixels configuring the one or more objects associated with the bodies into the one or more groups on a basis of the characteristics of the bodies detected by the characteristic detection unit.

7. The information processing device according to claim 1 , wherein

the image data includes depth information of each pixel configuring the image data, and

the grouping unit groups the plurality of pixels into the one or more groups on a basis of the depth information.

8. The information processing device according to claim 7 , further comprising:

a line-of-sight tracking unit that detects a line-of-sight direction of a user;

a storage unit that stores a lookup table that holds a correspondence relationship between a distance and a phase difference, wherein

the phase adjustment unit determines the phase difference of the phase pattern to be added to the pixels belonging to each of the one or more groups, by referring to the lookup table on a basis of a distance between a body associated with an object configured by the pixels grouped into each of the one or more groups and a body positioned in the line-of-sight direction in a real space.

9. The information processing device according to claim 1 , wherein

the phase adjustment unit

allocates a first phase pattern having the phase difference of a first phase difference to pixels grouped into a first group by the grouping unit, and

allocates a second phase pattern having the phase difference of a second phase difference larger than the first phase difference to pixels grouped into a second group.

10. The information processing device according to claim 1 , wherein

the phase pattern has a predetermined pixel size, and

the phase adjustment unit allocates the phase pattern in units of cells obtained by dividing the image data into the predetermined pixel size.

11. The information processing device according to claim 1 , wherein the phase pattern is a random phase pattern in which a difference between phase values added to adjacent pixels is a random value.

12. The information processing device according to claim 1 , wherein the one or more objects include a first object associated with a body in a real space and a second object displayed on a virtual screen set in the real space.

13. The information processing device according to claim 12 , wherein the phase adjustment unit allocates a low-frequency phase pattern having the small phase difference to pixels corresponding to the second object.

14. An information processing method comprising:

grouping a plurality of pixels configuring one or more objects included in one piece of image data into one or more groups;

allocating, to the plurality of pixels, a phase pattern having a phase difference different for each of the one or more groups; and

generating hologram data from the image data to which the phase pattern is added.

15. A program for causing a computer that generates hologram data for displaying a hologram from image data to execute:

grouping a plurality of pixels configuring one or more objects included in one piece of image data into one or more groups;

allocating, to the plurality of pixels, a phase pattern having a phase difference different for each of the one or more groups; and

generating hologram data from the image data to which the phase pattern is added.

16. A hologram display system comprising:

the information processing device according to claim 1 ; and

a display device that displays a hologram for a user on a basis of the hologram data generated by the information processing device.

17. The hologram display system according to claim 16 , wherein

the information processing device further includes a post-processing unit that converts the hologram data into a hologram signal capable of being stereoscopically displayed on the display device, and

the display device includes a spatial light modulator that modulates light output on a basis of the hologram signal to display the hologram to the user.

18. The hologram display system according to claim 17 , wherein the spatial light modulator is a reflective spatial light modulator.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2022
From: WEN, SHIHHAO; AKAO, MASATO; KOUYAMA, YOSHIAKI
To: SONY GROUP CORPORATION
Reel/Frame 061617/0156 →
Priority Claims (1)
JP 2020-096399 · Jun 2, 2020 · national
Continuity (1)
Related Publication 20230350344A1 · Nov 2, 2023
References Cited (15)
US 6023353A · Ori · 2000 [cited by applicant]
US 20050207313A1 · Handschy et al. · 2005 [cited by applicant]
US 20100014134A1 · Cable · 2010 [cited by applicant]
US 20150077818A1 · Tsang · 2015 [cited by applicant]
US 20150185523A1 · Matsumoto · 2015 [cited by examiner]
US 20160103321A1 · An · 2016 [cited by examiner]
US 20200150450A1 · Wiersma · 2020 [cited by examiner]
JP H06110371A · 1994 [cited by applicant]
JP 2000322594A · 2000 [cited by applicant]
JP 2005195803A · 2005 [cited by applicant]
JP 2008525832A · 2008 [cited by applicant]
JP 2008544307A · 2008 [cited by applicant]
JP 2010501903A · 2010 [cited by applicant]
JP 2011528132A · 2011 [cited by applicant]
WO WO2019076963A1 · 2019 [cited by applicant]