IP Library Granted Patent US 12671518
Granted Patent B2
US 12671518 · App. 18/459,843 · Granted Jun 30, 2026

Method and system of dynamic optical intelligent computing

Inventors: Lu Fang (Beijing, CN); Tiankuang Zhou (Beijing, CN); Wei Wu (Beijing, CN)
Assignee: TSINGHUA UNIVERSITY
H04J14/08H04L5/0025
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12671518
App. No.
18/459,843
Granted
Jun 30, 2026
Kind
B2
Abstract

The method of dynamic optical intelligent computing includes: acquiring a time frame input from a target dynamic scene; obtaining space information corresponding to a time frame by performing a spatial modulation on the time frame; and obtaining an optical time sequence cache corresponding to the time frame by mapping the space information to an optical time sequence based on a SMUX technology and a WMUX technology.

Claims (87)

1 . A method of dynamic optical intelligent computing, comprising:

acquiring a time frame input from a target dynamic scene;

obtaining space information corresponding to the time frame by performing a spatial modulation on the time frame; and

obtaining an optical time sequence cache corresponding to the time frame by mapping the space information to an optical time sequence based on a space division multiplexing (SMUX) technology and a wavelength division multiplexing (WMUX) technology;

wherein obtaining the space information corresponding to the time frame by performing the spatial modulation on the time frame comprises:

obtaining at least one spatial feature space by performing at least one spatial modulation on the time frame based on at least one spatial mask; and

determining the space information corresponding to the time frame based on the at least one spatial feature space;

wherein obtaining the optical time sequence cache corresponding to the time frame by mapping the space information to the optical time sequence based on the SMUX technology and the WMUX technology comprises:

determining a wavelength input type corresponding to the space information;

converting the space information to time information based on the SMUX technology in response to the wavelength input type being a single-wavelength input, wherein the time information comprises at least one piece of time feature information, and the at least one piece of time feature information corresponds one to one with the at least one spatial feature space;

converting the space information to the time information based on the WMUX technology in response to the wavelength input type being a multi-wavelength input;

obtaining an optical time sequence corresponding to the time frame by performing a time modulation on the time information based on a weight sequence, wherein, the weight sequence comprises at least one weight value, and the at least one weight value corresponds one to one with the at least one piece of time feature information; and

obtaining the optical time sequence cache corresponding to the time frame by processing the optical time sequence by means of a transfer function.

2 . The method according to claim 1 , wherein obtaining the optical time sequence corresponding to the time frame by performing the time modulation on the time information based on the weight sequence comprises:

obtaining the optical time sequence corresponding to the time frame by multiplying the at least one weight value by the at least one piece of time feature information respectively by means of a matrix-vector multiplication mathematical model.

3 . The method according to claim 1 , wherein converting the space information to the time information based on the SMUX technology comprises:

dividing each of the at least one spatial feature space into at least one spatial feature subspace, and obtaining the at least one piece of time feature information corresponding to the at least one spatial feature space by modulating the at least one spatial feature subspace by means of a high speed spatial modulator, wherein the time feature information comprises at least one time channel, and the at least one time channel corresponds one to one with the at least one spatial feature subspace; and

determining the time information corresponding to the space information based on the at least one piece of time feature information corresponding to the at least one spatial feature space.

4 . The method according to claim 1 , wherein converting the space information to the time information based on the WMUX technology comprises:

encoding the at least one spatial feature space with at least one wavelength, and encoding the at least one spatial feature space with at least one spectrum by means of the WMUX, wherein, the at least one spatial feature space corresponds one to one with the at least one spectrum; and

encoding the time information corresponding to the space information based on the at least one spectrum.

5 . The method according to claim 1 , further comprising:

obtaining at least one optical time sequence cache corresponding to at least one time frame respectively by successively acquiring the at least one time frame input from the target dynamic scene based on a time sequence; and

obtaining an optical time sequence cache of a dynamic optical field corresponding to the at least one time frame by successively combining the at least one optical time sequence cache based on the time sequence.

6 . The method according to claim 5 , after obtaining the optical time sequence cache of the dynamic optical field corresponding to the at least one time frame, further comprising:

obtaining an activated optical time sequence cache of the dynamic optical field by performing an optical nonlinear activation on the optical time sequence cache of the dynamic optical field;

obtaining space information of the dynamic optical field corresponding to the activated optical time sequence cache of the dynamic optical field by demultiplexing the activated optical time sequence cache of the dynamic optical field; and

determining feature information of the dynamic optical field corresponding to the at least one time frame based on the space information of the dynamic optical field.

7 . A system of dynamic optical intelligent computing, comprising:

at least one processor; and

a memory communicatively connected to the at least one processor and stored with instructions executable by the at least one processor;

wherein when the instructions are executed by the at least one processor, the at least one processor is caused to perform:

acquiring a time frame input from a target dynamic scene;

obtaining space information corresponding to the time frame by performing a spatial modulation on the time frame; and

obtaining an optical time sequence cache corresponding to the time frame by mapping the space information to an optical time sequence based on a space division multiplexing (SMUX) technology and a wavelength division multiplexing (WMUX) technology;

wherein the at least one processor is further configured to perform:

obtaining at least one spatial feature space by performing at least one spatial modulation on the time frame based on at least one spatial mask; and

determining the space information corresponding to the time frame based on the at least one spatial feature space;

wherein the at least one processor is further configured to perform:

determining a wavelength input type corresponding to the space information;

converting the space information to time information based on the SMUX technology in response to the wavelength input type being a single-wavelength input, wherein the time information comprises at least one piece of time feature information, and the at least one piece of time feature information corresponds one to one with the at least one spatial feature space;

converting the space information to the time information based on the WMUX technology in response to the wavelength input type being a multi-wavelength input;

obtaining an optical time sequence corresponding to the time frame by performing a time modulation on the time information based on a weight sequence, wherein, the weight sequence comprises at least one weight value, and the at least one weight value corresponds one to one with the at least one piece of time feature information; and

obtaining the optical time sequence cache corresponding to the time frame by processing the optical time sequence by means of a transfer function.

8 . The system according to claim 7 , wherein the at least one processor is further configured to perform:

obtaining the optical time sequence corresponding to the time frame by multiplying the at least one weight value by the at least one piece of time feature information respectively by means of a matrix-vector multiplication mathematical model.

9 . The system according to claim 7 , wherein the at least one processor is further configured to perform:

dividing each of the at least one spatial feature space into at least one spatial feature subspace, and obtaining the at least one piece of time feature information corresponding to the at least one spatial feature space by modulating the at least one spatial feature subspace by means of a high speed spatial modulator, wherein the time feature information comprises at least one time channel, and the at least one time channel corresponds one to one with the at least one spatial feature subspace; and

determining the time information corresponding to the space information based on the at least one piece of time feature information corresponding to the at least one spatial feature space.

10 . The system according to claim 7 , wherein the at least one processor is further configured to perform:

encoding the at least one spatial feature space with at least one wavelength, and encoding the at least one spatial feature space with at least one spectrum by means of the WMUX, wherein, the at least one spatial feature space corresponds one to one with the at least one spectrum; and

encoding the time information corresponding to the space information based on the at least one spectrum.

11 . The system according to claim 7 , wherein the at least one processor is further configured to perform:

obtaining at least one optical time sequence cache corresponding to at least one time frame respectively by successively acquiring the at least one time frame input from the target dynamic scene based on a time sequence; and

obtaining an optical time sequence cache of a dynamic optical field corresponding to the at least one time frame by successively combining the at least one optical time sequence cache based on the time sequence.

12 . The system according to claim 11 , wherein the at least one processor is further configured to perform:

obtaining an activated optical time sequence cache of the dynamic optical field by performing an optical nonlinear activation on the optical time sequence cache of the dynamic optical field;

obtaining space information of the dynamic optical field corresponding to the activated optical time sequence cache of the dynamic optical field by demultiplexing the activated optical time sequence cache of the dynamic optical field; and

determining feature information of the dynamic optical field corresponding to the at least one time frame based on the space information of the dynamic optical field.

13 . A non-transitory computer-readable storage medium stored with computer instructions, wherein, the computer instructions are configured to cause a computer to perform:

acquiring a time frame input from a target dynamic scene;

obtaining space information corresponding to the time frame by performing a spatial modulation on the time frame; and

obtaining an optical time sequence cache corresponding to the time frame by mapping the space information to an optical time sequence based on a space division multiplexing (SMUX) technology and a wavelength division multiplexing (WMUX) technology;

wherein obtaining the space information corresponding to the time frame by performing the spatial modulation on the time frame comprises:

obtaining at least one spatial feature space by performing at least one spatial modulation on the time frame based on at least one spatial mask; and

determining the space information corresponding to the time frame based on the at least one spatial feature space;

wherein obtaining the optical time sequence cache corresponding to the time frame by mapping the space information to the optical time sequence based on the SMUX technology and the WMUX technology comprises:

determining a wavelength input type corresponding to the space information;

converting the space information to time information based on the SMUX technology in response to the wavelength input type being a single-wavelength input, wherein the time information comprises at least one piece of time feature information, and the at least one piece of time feature information corresponds one to one with the at least one spatial feature space;

converting the space information to the time information based on the WMUX technology in response to the wavelength input type being a multi-wavelength input;

obtaining an optical time sequence corresponding to the time frame by performing a time modulation on the time information based on a weight sequence, wherein, the weight sequence comprises at least one weight value, and the at least one weight value corresponds one to one with the at least one piece of time feature information; and

obtaining the optical time sequence cache corresponding to the time frame by processing the optical time sequence by means of a transfer function.

14 . The storage medium according to claim 13 , wherein obtaining the optical sequence corresponding to the time frame by performing the time modulation on the time information based on the weight sequence comprises:

obtaining the optical time sequence corresponding to the time frame by multiplying the at least one weight value by the at least one piece of time feature information respectively by means of a matrix-vector multiplication mathematical model.

15 . The storage medium according to claim 13 , wherein converting the space information to the time information based on the SMUX technology comprises:

dividing each of the at least one spatial feature space into at least one spatial feature subspace, and obtaining the at least one piece of time feature information corresponding to the at least one spatial feature space by modulating the at least one spatial feature subspace by means of a high speed spatial modulator, wherein the time feature information comprises at least one time channel, and the at least one time channel corresponds one to one with the at least one spatial feature subspace; and

determining the time information corresponding to the space information based on the at least one piece of time feature information corresponding to the at least one spatial feature space.

16 . The storage medium according to claim 13 , wherein converting the space information to the time information based on the WMUX technology comprises:

encoding the at least one spatial feature space with at least one wavelength, and encoding the at least one spatial feature space with at least one spectrum by means of the WMUX, wherein, the at least one spatial feature space corresponds one to one with the at least one spectrum; and

encoding the time information corresponding to the space information based on the at least one spectrum.

17 . The storage medium according to claim 13 , further comprising:

obtaining at least one optical time sequence cache corresponding to at least one time frame respectively by successively acquiring the at least one time frame input from the target dynamic scene based on a time sequence; and

obtaining an optical time sequence cache of a dynamic optical field corresponding to the at least one time frame by successively combining the at least one optical time sequence cache based on the time sequence.

18 . The storage medium according to claim 17 , after obtaining the optical time sequence cache of the dynamic optical field corresponding to the at least one time frame, further comprising:

obtaining an activated optical time sequence cache of the dynamic optical field by performing an optical nonlinear activation on the optical time sequence cache of the dynamic optical field;

obtaining space information of the dynamic optical field corresponding to the activated optical time sequence cache of the dynamic optical field by demultiplexing the activated optical time sequence cache of the dynamic optical field; and

determining feature information of the dynamic optical field corresponding to the at least one time frame based on the space information of the dynamic optical field.