Granted Patent B2

US 12,357,046 · App. 18/599,796 · Granted Jul 15, 2025

Inventors: Nicholas James Witchey (Laguna Hills, CA); Patrick Soon-Shiong (Los Angeles, CA)

A41D27/085A41D1/002A41D13/1192A41D31/305A61B5/6803A62B23/025G06F1/163G06F3/011G09G3/035G09G2300/026G09G2380/02G09G2380/08G10L15/08

Abstract

Claims (24)

1. A smart mask display system comprising:

a mask comprising at least one display that covers at least a portion of a face;

at least one sensor;

at least one computer readable non-transitory memory storing software instructions, at least one mapping function and renderable data files indexed according to sensor signatures; and

at least one processor coupled with the at least one computer readable non-transitory memory, the at least one sensor, and the at least one display, and that performs the following operations upon execution of the software instructions:

receiving a digital sensor signal from the at least one sensor, wherein the digital sensor signal comprises at least two sensor data modalities, and the at least two sensor data modalities include two of audio data, image data, accelerometer data, thermal data, stress data, strain data, pressure data, and location data;

generating at least one sensor signature from the digital sensor signal, including differentiating between two similar signatures based on the at least two sensor data modalities;

mapping the at least one sensor signature via the mapping function to at least one renderable data file, wherein the mapping function includes a k-nearest neighbors (kNN) algorithm trained to differentiate between two similar signatures to identify a corresponding set of images, and the at least one renderable data file is included in the corresponding set of images; and

rendering the at least one renderable data file on the display.

2. The system of claim 1 , wherein the at least one sensor signature comprises a vector of sensor data values.

3. The system of claim 2 , wherein the vector comprises an input vector to the mapping function.

4. The system of claim 1 , wherein the at least one sensor includes at least two sensors.

5. The system of claim 1 , wherein the at least one sensor signature comprises a custom sensor signature configuration.

6. The system of claim 1 , wherein the at least one sensor signature represents an emotion.

7. The system of claim 1 , wherein the at least one sensor includes at least one of the following types of sensors: a thermal sensor, a microphone, a camera, a capacitance sensor, a resistance sensor, a pressure sensor, a Hall effect sensor, a piezoelectric sensor, a galvanic sensor, an airflow sensor, an accelerometer, a gyroscopic sensor and a location sensor.

8. The system of claim 1 , wherein the digital sensor signal comprises at least one of the following types of signals: a resistance, a capacitance, a current, a voltage, and a location.

9. The system of claim 1 , wherein the digital sensor signal comprises an audio signal, and the audio signal comprises at least one of the following: a sound and an utterance.

10. The system of claim 1 , wherein the at least one display is configured to render more than one display modality.

11. The system of claim 10 , wherein the more than one display modality includes at least one of the following: a 2D rendering, a 3D rendering, a text modality, a sign language modality, an emoticon modality, an animation and an emote.

12. The system of claim 1 , wherein the digital sensor signal comprises real-time sensor data.

13. The system of claim 1 , further comprising a control module comprising the at least one computer readable non-transitory memory and the at least one processor.

14. The system of claim 13 , wherein the control module comprises a mobile phone or a smart watch.

15. The system of claim 1 , wherein the display comprises a touchscreen display.

16. The system of claim 1 , further comprising a helmet including the display.

Assignments (1)

Continuity (5)

References Cited (57)