IP Library › Granted Patent US 12,727,634
Granted Patent B2
US 12,727,634 · App. 19/226,224 · Granted Sep 8, 2026

Smart article visual communication based on facial movement

Inventors: Nicholas James Witchey (Laguna Hills, CA); Patrick Soon-Shiong (Los Angeles, CA)
Assignee: NantWorks, LLC
A41D27/085A41D1/002A41D13/1192A41D31/305A61B5/6803A62B23/025G06F1/163G06F3/011G09G3/035G09G2300/026G09G2380/02G09G2380/08G10L15/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,727,634
App. No.
19/226,224
Granted
Sep 8, 2026
Kind
B2
Abstract

A smart mask includes a first material layer, at least one display, a first sensor, and a control module. The first material layer is configured to cover a portion of a face of a person. The at least one display is connected to the first material layer and configured to display images over a mouth of the person. The first sensor is configured to detect movement of the mouth of the person and generate a signal indicative of the movement of the mouth. The control module is configured to receive the signal and display the images on the display based on the movement of the mouth.

Claims (30)

1 . A smart mask system comprising:

a first material layer configured to cover a portion of a face of a person;

at least one display connected to the first material layer and configured to display images;

a location sensor configured to obtain location data associated with the smart mask system; and

a computer-based control module comprising:

at least one non-transitory memory storing a plurality of indexed image sets and software instructions, wherein each of the plurality of image sets are indexed based on location data; and

at least one processor coupled with the at least one non-transitory memory and that performs the following operations upon execution of the software instructions:

determining a context based on a location derived from the location data obtained from the location sensor;

selecting an indexed image set from the plurality of indexed image sets based on at least the determined context and the location data, wherein selecting the indexed image set includes selecting the indexed image set via at least one of a look up or a mapping of location data to a defined area, selecting a formal image when the determined context is a formal context, and selecting an informal image when the determined context is an informal context; and

rendering at least one image from the location-based selected image set on the display, wherein the display comprises multiple light emitting diodes configured to render a visual digital image covering at least a portion of the first material layer,

wherein a first indexed image set of the plurality of indexed image sets comprises actual face images of the person, and the actual face images of the person are selected for rendering on the display in response to the determined context being the formal context.

2 . The smart mask system of claim 1 , wherein the formal context corresponds to an office location.

3 . The smart mask system of claim 1 , wherein the informal context corresponds to at least one of a park location and a sports venue location.

4 . The smart mask system of claim 1 , wherein:

a second indexed image set of the plurality of indexed image sets comprises cartoon character images; and

the cartoon character images are selected for rendering on the display in response to the determined context being the formal context.

5 . The smart mask system of claim 1 , wherein the location data is derived from at least one of the following: a GPS sensor, an internal movement unit, SLAM data, vSLAM data, and a wireless triangulation device.

6 . The smart mask system of claim 1 , wherein the computer-based control module is further configured to select a language module based on the location.

7 . The smart mask system of claim 6 , wherein the computer-based control module is configured to display translated text based on the selected language module.

8 . The smart mask system of claim 1 , further comprising a plurality of sensors configured to detect facial movements of the person.

9 . The smart mask system of claim 8 , wherein the plurality of sensors comprises at least one of piezoelectric sensors, thermal sensors, stretch sensors, and compression sensors.

10 . The smart mask system of claim 8 , wherein the computer-based control module is configured to render the at least one image based on both the detected facial movements and the determined context.

11 . The smart mask system of claim 1 , wherein the at least one display comprises a high-resolution display having a resolution greater than 70 dots per inch.

12 . The smart mask system of claim 1 , wherein the at least one display comprises a low-resolution LED array having a resolution less than 70 dots per inch.

13 . The smart mask system of claim 1 , wherein the at least one display permits airflow.

14 . The smart mask system of claim 1 , further comprising at least one filter comprising antimicrobial material.

15 . The smart mask system of claim 1 , wherein the computer-based control module is configured to automatically switch between indexed image sets when a change in location is detected.

16 . The smart mask system of claim 1 , further comprising a wireless transceiver allowing communications with external devices.

17 . The smart mask system of claim 16 , wherein the wireless transceiver operates within a personal area network.

18 . The smart mask system of claim 1 , wherein the computer-based control module is configured to modify the rendered at least one image to thereby reduce facial recognition.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 5, 2025
From: WITCHEY, NICHOLAS JAMES; SOON-SHIONG, PATRICK
To: NANTWORKS, LLC
Reel/Frame 071326/0151 →
Continuity (6)
Continuation 18599796 · Mar 8, 2024
Continuation 18234698 · Aug 16, 2023
Continuation 17892256 · Aug 22, 2022
Continuation 17481723 · Sep 22, 2021
Continuation 16990781 · Aug 11, 2020
Related Publication 20250288037A1 · Sep 18, 2025
References Cited (54)
US 6307576B1 · Rosenfeld · 2001 [cited by applicant]
US 10891331B1 · Daya et al. · 2021 [cited by applicant]
US 11160319B1 · Witchey et al. · 2021 [cited by applicant]
US 20160029716A1 · Duncan · 2016 [cited by examiner]
US 20160041581A1 · Piccionelli · 2016 [cited by examiner]
US 20180225988A1 · Morgado · 2018 [cited by examiner]
US 20190035153A1 · Dange · 2019 [cited by examiner]
US 20190060682A1 · Mou et al. · 2019 [cited by applicant]
US 20190347817A1 · Ferrantelli et al. · 2019 [cited by applicant]
US 20210081749A1 · Claire · 2021 [cited by examiner]
US 20210244109A1 · Nishida · 2021 [cited by applicant]
US 20220047021A1 · Witchey et al. · 2022 [cited by applicant]
US 20220395041A1 · Witchey et al. · 2022 [cited by applicant]
US 20240125189A1 · Sherrill et al. · 2024 [cited by applicant]
www.opencv.org (Aug. 7, 2020). [cited by applicant]
www.adafruit.com/product/1755 (Aug. 7, 2020). [cited by applicant]
www.adafruit.com/product/158 (Aug. 7, 2020). [cited by applicant]
www.adafruit.com/product/519 (Aug. 7, 2020). [cited by applicant]
www.bendlabs.com/products/ (Aug. 7, 2020). [cited by applicant]
www.adafruit.com/category/65 (Aug. 7, 2020). [cited by applicant]
www.dyslexia-reading-well.com/44-phonemes-in-english.html, Copyright 2013-2020 © by Michael Bates, Dyslexia-Reading-Well.com (Aug. 7, 2020). [cited by applicant]
en.wikipedia.org/wiki/Phoneme (Aug. 7, 2020). [cited by applicant]
ibug.doc.ic.ac.uk/resources/facial-point-annotations/, Intelligent Behavior Understanding Group (IBUG), Department of Computing, Imperial College London (Aug. 7, 2020). [cited by applicant]
www.rose-medical.com/mouth-positions.html, Copyright © 2020 Rose Medical Solutions Ltd. (Aug. 7, 2020). [cited by applicant]
https://www.conductivetech.com/products/flexible-printed-circuitry/, Conductive Technologies Inc®, ISO 13486/ISO 0001 Certified (Aug. 7, 2020). [cited by applicant]
https://www.cheaptubes.com/graphene-sensors/ (Aug. 7, 2020). [cited by applicant]
https://stretchsense.com/sensors/ (Aug. 7, 2020). [cited by applicant]
https://starboardmedical.com/skin-sensors/, Copyright 2019 Starboard Medical, Inc (Aug. 7, 2020). [cited by applicant]
https://newvisiondisplay.com/6-flexible-amoled/, May 11, 2018, © 2012-2020 New Vision Display (Shenzhen) Technology Co, Ltd. (Aug. 7, 2020). [cited by applicant]
www.raspberripi.org, Raspberry PI Foundation, UK Registered Charity 1129409 (Aug. 7, 2020). [cited by applicant]
https://www.tekscan.com/products-solutions/electronics/flexiforce-oem-development-kit, Tekscan Medical Devices, South Boston, MA, Pressure Mapping, Force Measurement & Tactile Sensors (Aug. 7, 2020). [cited by applicant]
https://www.tekscan.com/products-solutions/electronics/flexiforce-oem-development-kit, © Tekscan Inc., 2020, FlexiForce™ Prototyping Kit, ISO 9001-2008 Compliant & 13485:2016 Registered, DS Rev 072720 (Aug. 7, 2020). [cited by applicant]
Compression Sensing Element, #OSEC—Compression Sensing Element, Version 27082018, Technical Data Sheet, StretchSense™ (Aug. 7, 2020). [cited by applicant]
Frontiers in Chemistry, Published Jun. 2019, vol. 7, Article 399, “Graphene-Based Sensors for Human Health Monitoring” by Haizhou Huang, Shi Su, Nan Wu, Hao Wan, Shu Wan, Hengchang Bi, and Litao Sun. [cited by applicant]
https://www.dezeen.com/2020/03/06/guardian-g-volt-face-mask-graphene-coronavirus-bacteria, Guardian G-Volt masks use graphene and electrical charge to repel viruses (May 14, 2020). [cited by applicant]
https://www.crystalfontz.com/product/cfal16032a0018pw-flexible-oled-display-160x32 (Aug. 7, 2020). [cited by applicant]
https://www.directa-plus.com/, © 2019 Directa Plus S.p.A. (Aug. 7, 2020). [cited by applicant]
https://www.matexcel.com/category/products/graphene/, Matexcell, Bohemia, NY, Copyright © 2007-2020 Matexcel, (Aug. 7, 2020). [cited by applicant]
https://www.nature.com/articles/s41528-019-0061-5, Nature Partner Journals (NPJ), Fleible Electronics, “Wearable multifunctional printed graphene sensors,” by Altynay Kaidarova, Mohammed Asadullah Khan, Marco Marengo, L… [cited by applicant]
https://www.omegapiezo.com/strip-actuators-bimorph-equivalent/, Omega Piezo Technologies © (Aug. 7, 2020). [cited by applicant]
https://www.sciencedirect.com/science/article/abs/pii/S0165993617300031, TrAC Trends in Analytical Chemistry, vol. 91, Jun. 2017, pp. 53-66, “Graphene based sensors nad biosensors,” by Celine I.L. Justino, Ana R. Gomes,… [cited by applicant]
MDPI, Nanomaterials 2019, 9, 496; doi:10.3390/nano9040496, “Flexible and Highly Sensitive Pressure Sensors Based on Microstructured Carbon Nanowalls Electrodes,” by Xi Zhou, Yongna Zhang, Jun Yang, Jialu Li, Shi Luo, an… [cited by applicant]
MDPI, Nanomaterials 2019, 9, 737; doi:10.3390/nano9050737, “Antibacterial Properties of Graphene-Based Nanomaterials,” by Parveen Kumar, Peipei Huo, Rongzhao Zhang, and Bo Liu, Published May 13, 2019. [cited by applicant]
MDPI, Sensors 2018, 18, 645; doi:10.3390/s18020645, “Flexible, Stretchable Sensors for Wearable Health Monitoring: Sensing Mechanisms, Materials, Fabrication Strategies and Features,” by Yan Liu, Hai Wang, Wei Zhao, Min… [cited by applicant]
StretchSense 3-Channel Silicone Sensor Product, StretchSense™. [cited by applicant]
StretchFabric Sensing Element (SSD18), Technical Datasheet, Version 20122018, StretchSense™. [cited by applicant]
www.arduino.cc (Aug. 7, 2020). [cited by applicant]
Office Action from corresponding U.S. Appl. No. 16/990,781 dated Dec. 28, 2020. [cited by applicant]
Office Action from corresponding U.S. Appl. No. 16/990,781 dated Mar. 29, 2021. [cited by applicant]
Office Action from corresponding U.S. Appl. No. 17/481,723 dated Apr. 20, 2022. [cited by applicant]
Office Action from corresponding U.S. Appl. No. 18/234,698, dated Oct. 13, 2023. [cited by applicant]
Office Action from corresponding U.S. Appl. No. 18/234,698 dated Nov. 28, 2023. [cited by applicant]
Office Action from U.S. Appl. No. 18/599,796 dated Jan. 16, 2025. [cited by applicant]
Office Action from U.S. Appl. No. 18/599,796 dated Mar. 17, 2025. [cited by applicant]