IP Library › Granted Patent US 12,265,935
Granted Patent B2
US 12,265,935 · App. 17/247,637 · Granted Apr 1, 2025

Transillumination of iris muscles to infer stroma deformation

Inventors: Seth Weisberg (Austin, TX); Joseph Brown (Austin, TX); Jared Bowden (Austin, TX); David Zakariaie (Austin, TX); Andrew R. Sommerlot (Austin, TX); Kyle Grier (Austin, TX)
Assignee: Senseye, Inc.
G06Q10/0635A61B3/0025A61B3/0041A61B3/0091A61B3/112A61B3/113A61B3/145A61B5/1103A61B5/161A61B5/163A61B5/165A61B5/4845A61B5/4863A61B5/6898A61B5/7246G06N3/045G06N3/08G06Q10/06398G06Q10/10G06T7/73G06V10/143G06V10/454G06V10/764G06V20/46G06V40/18G06V40/19G06V40/193G16H15/00G16H30/20G16H50/20G16H50/50G16H50/70A61B5/7267A61B2503/20G06N3/088G06T2207/10016G06T2207/20081G06T2207/20084G06T2207/30041G16H50/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,265,935
App. No.
17/247,637
Granted
Apr 1, 2025
Kind
B2
Abstract

A method of discovering relationships between iris physiology and cognitive states and/or emotional states of a subject includes providing a computing device and a video camera to record a close-up view of the subject's eye. A first light is held to the lower eyelid skin and a second light a distance away illuminating the stroma of the eye. The first and second light are electronically synced together and configured to flash alternatively. The user engages in a plurality of tasks while recording ocular information which is processed to identify correlations between the responses in the iris musculature and the distortions in the stroma through the use optimized algorithms. One can then identifying at least one predictive distortion is identified in the stroma capturable solely with a visible-spectrum camera correlating to a predicted responses in the iris musculature.

Claims (20)

1. A method of discovering relationships between iris physiology and cognitive states and/or emotional states of a subject, the method comprising the steps of:

providing a computing device;

providing a first video camera configured to record in the near infrared spectrum a close-up view of at least one eye of the subject;

providing a first light configured to be held to a skin of a lower eyelid of the subject allowing light to shine out from within the at least one eye;

providing a second light configured to not be in contact with the subject located a distance apart from the subject and configured to illuminate a stroma of a cornea of the at least one eye of the subject;

wherein the first light and the second light are electronically synced together and configured to flash alternatively;

the method configured to engage the user in a plurality of tasks, each task of the plurality of tasks configured to be cognitively or emotionally evocative;

recording, via the first video camera, ocular information comprising responses in the iris musculature and corresponding distortions in the stroma due to the cognitive state and/or the emotional state of the subject produced by the plurality of tasks;

processing, via the computing device, the ocular information to identify correlations between the responses in the iris musculature and the distortions in the stroma through the use of algorithms; and

identifying, via the computing device, at least one predictive distortion in the stroma that is capturable without utilizing the first light held to the skin of the lower eyelid of the subject and with just a visible-spectrum second video camera correlating to a predicted responses in the iris musculature when the subject was in the cognitive state and/or the emotional state produced by the plurality of tasks.

2. The method of discovering relationships of claim 1 , wherein the first light comprises a NIR LED.

3. The method of discovering relationships of claim 1 , wherein the second light comprises a NIR LED.

4. The method of discovering relationships of claim 1 , wherein the first light comprises a 150 mw NIR LED.

5. The method of discovering relationships of claim 1 , wherein the second light comprises a 150 mw NIR LED.

6. The method of discovering relationships of claim 1 , wherein the first light and the second light are configured to flash alternatively at 160 Hz producing a resultant effect of 80 Hz.

7. The method of discovering relationships of claim 1 , further including a method of generating near infrared images from visible light images, the method comprising the steps of:

providing the visible spectrum second video camera configured to record the close-up view of the at least one eye of the subject;

recording, via the visible spectrum second video camera, the ocular information comprising the distortions in the stroma due to the cognitive state and/or the emotional state of the subject;

predicting, via the computing device, an infrared image of the at least one eye of the subject through a generative adversarial network using the ocular information from the visible spectrum second video camera;

wherein the predicting, via the computing device, utilizes the at least one predictive distortion in the stroma for creating the infrared image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 14, 2021
From: WEISBERG, SETH; BROWN, JOSEPH; BOWDEN, JARED; ZAKARIAIE, DAVID; SOMMERLOT, ANDREW R.; GRIER, KYLE
To: SENSEYE, INC.
Reel/Frame 056245/0517 →
Continuity (2)
Provisional Application 62950918 · Dec 19, 2019
Related Publication 20210186397A1 · Jun 24, 2021
References Cited (48)
US 7614745B2 · Waldorf et al. · 2009 [cited by applicant]
US 9357918B1 · Cohen · 2016 [cited by applicant]
US 9357966B1 · Cohen · 2016 [cited by applicant]
US 20040174496A1 · Ji et al. · 2004 [cited by applicant]
US 20090216092A1 · Waldorf et al. · 2009 [cited by applicant]
US 20110066082A1 · Duffy · 2011 [cited by applicant]
US 20140178843A1 · Smyth · 2014 [cited by applicant]
US 20140330129A1 · Grenon · 2014 [cited by examiner]
US 20180160959A1 · Wilde et al. · 2018 [cited by applicant]
US 20180279948A1 · Medberry · 2018 [cited by examiner]
US 20190167095A1 · Krueger · 2019 [cited by examiner]
JP 2006525829A · 2006 [cited by applicant]
UA 116785U · 2017 [cited by applicant]
WO 2007131076A2 · 2007 [cited by applicant]
Alward et al. 1990 Arch. Opht. 108:748-750 (Year: 1990). [cited by examiner]
Digre 2005 in “Walsh and Hoyt's Clinical Neuro-Ophthalmology” chap. 15 p. 715-738 (Year: 2005). [cited by examiner]
Peysakhovich et al. 2015 Int. J. Psychophysiology 97:30-37 (Year: 2015). [cited by examiner]
Mathot 2014 J. of Cognition 1: article 16, 23 pages (Year: 2014). [cited by examiner]
Reiner et al. 2014 Int. J. Psychophysiology 93:38-44 (Year: 2014). [cited by examiner]
Yadav et al. 2019 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2019, pp. 2422-2430; Pub. Date Jun. 2019 (Year: 2019). [cited by examiner]
Wangwiwattana et al. (2017 Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 1, No. 4, Article 171, 26 pages (Year: 2017). [cited by examiner]
Nowak et al 2014 Biomed Engin Online 13 69-84 (Year: 2014). [cited by examiner]
Tomeo-Reyes et al. 2016 IEEE Xplore IEEE 8th International Conference on Biometrics Theory, Applications and Systems (BTAS) ; 8 pages (Year: 2016). [cited by examiner]
Alexander, M. P., D. T. Stuss, and N. Fansabedian. “California Verbal Learning Test: Performance by Patients with Focal Frontal and Non-frontal Lesions.” Brain 126, No. 6 (Jun. 1, 2003): 1493-1503. https://doi.org/10.10… [cited by applicant]
Anderson, Kristen Joan. “Impulsitivity, Caffeine, and Task Difficulty: A within-Subjects Test of the Yerkes-Dodson Law.” Personality and Individual Differences 16, No. 6 (Jun. 1, 1994): 813-29. https://doi.org/10.1016/0… [cited by applicant]
Chaby, Lauren E, Michael J Sheriff, Amy M Hirrlinger, and Victoria A Braithwaite. “Can We Understand How Developmental Stress Enhances Performance under Future Threat with the Yerkes-Dodson Law?” Communicative & Integra… [cited by applicant]
Cohen, N. J., and H. Eichenbaum. “Memory, Amnesia, and the Hippocampal System. 1993.” Cambridge, MA: MIT Press 3 (1993): 285-290. [cited by applicant]
Dimitrov, Mariana, Joy Granetz, Matthew Peterson, Caroline Hollnagel, Gene Alexander, and Jordan Grafman. “Associative Learning Impairments in Patients with Frontal Lobe Damage.” Brain and Cognition 41, No. 2 (Nov. 1, 1… [cited by applicant]
Ebitz, R. Becket, and Tirin Moore. “Selective Modulation of the Pupil Light Reflex by Microstimulation of Prefrontal Cortex.” The Journal of Neuroscience 37, No. 19 (May 10, 2017): 5008. https://doi.org/10.1523/JNEUROSC… [cited by applicant]
Eslinger, Paul J., and Lynn M. Grattan. “Altered Serial Position Learning after Frontal Lobe Lesion.” Neuropsychologia 32, No. 6 (Jun. 1, 1994): 729-39. https://doi.org/10.1016/0028-3932(94)90032-9. [cited by applicant]
Hampson, R.E., Ioan Opris, and S.A. Deadwyler. “Neural Correlates of Fast Pupil Dilation in Nonhuman Primates: Relation to Behavioral Performance and Cognitive Workload.” Behavioural Brain Research 212, No. 1 (Sep. 1, 2… [cited by applicant]
Jetter, Wolfgang, Ulrich Poser, Robert B. Freeman, and Hans J. Markowitsch. “A Verbal Long Term Memory Deficit in Frontal Lobe Damaged Patients.” Cortex 22, No. 2 (Jun. 1, 1986): 229-42. https://doi.org/10.1016/S0010-94… [cited by applicant]
Jonides, John, Richard L Lewis, Derek Evan Nee, Cindy A Lustig, Marc G Berman, and Katherine Sledge Moore. “The Mind and Brain of Short-Term Memory.” Annual Review of Psychology 59 (2008): 193-224. https://doi.org/10.11… [cited by applicant]
Joshi, Siddhartha, Yin Li, Rishi M. Kalwani, and Joshua I. Gold. “Relationships between Pupil Diameter and Neuronal Activity in the Locus Coeruleus, Colliculi, and Cingulate Cortex.” Neuron 89, No. 1 (Jan. 6, 2016): 221… [cited by applicant]
Kesner, Raymond P., Ramona O. Hopkins, and Bonnie Fineman. “Item and Order Dissociation in Humans with Prefrontal Cortex Damage.” Neuropsychologia 32, No. 8 (Aug. 1, 1994): 881-91. https://doi.org/10.1016/0028-3932(94)9… [cited by applicant]
Kucewicz, Michal T., Jaromir Dolezal, Vaclav Kremen, Brent M. Berry, Laura R. Miller, Abigail L. Magee, Vratislav Fabian, and Gregory A. Worrell. “Pupil Size Reflects Successful Encoding and Recall of Memory in Humans.”… [cited by applicant]
McAndrews, Mary Pat, and Brenda Milner. “The Frontal Cortex and Memory for Temporal Order.” Neuropsychologia 29, No. 9 (Jan. 1, 1991): 849-59. https://doi.org/10.1016/0028-3932(91)90051-9. [cited by applicant]
Moscovitch, Morris, and Gordon Winocur. “Frontal Lobes, Memory, and Aging.” Annals of the New York Academy of Sciences 769, No. 1 (Dec. 1, 1995): 119-50. https://doi.org/10.1111/j.1749-6632.1995.tb38135.x. [cited by applicant]
Nakayama, Minoru, and Yasutaka Shimizu. “Frequency Analysis of Task Evoked Pupillary Response and Eye-Movement.” In Proceedings of the 2004 Symposium on Eye Tracking Research & Applications, 71-76. San Antonio, Texas: A… [cited by applicant]
Peysakhovich, Vsevolod, Mickael Causse, Sébastien Scannella, and Frédéric Dehais. “Frequency Analysis of a Task-Evoked Pupillary Response: Luminance-Independent Measure of Mental Effort.” International Journal of Psycho… [cited by applicant]
Peysakhovich, Vsevolod, François Vachon, and Frederic Dehais. “The Impact of Luminance on Tonic and Phasic Pupillary Responses to Sustained Cognitive Load.” International Journal of Psychophysiology 112 (Feb. 1, 2017): … [cited by applicant]
Reiner, Miriam, and Tatiana M. Gelfeld. “Estimating Mental Workload through Event-Related Fluctuations of Pupil Area during a Task in a Virtual World.” Applied Neuroscience: Functional Enhancement, Prevention, Character… [cited by applicant]
S. P. Marshall. “The Index of Cognitive Activity: Measuring Cognitive Workload.” In Proceedings of the IEEE 7th Conference on Human Factors and Power Plants, 7-7, 2002. https://doi.org/10.1109/HFPP.2002.1042860. [cited by applicant]
Schlag, J., M. Schlag-Rey, and I. Pigarev. “Supplementary Eye Field: Influence of Eye Position on Neural Signals of Fixation.” Experimental Brain Research 90, No. 2 (Aug. 1, 1992): 302-6. https://doi.org/10.1007/BF00227… [cited by applicant]
Stuss, Donald T., Michael P. Alexander, Carole L. Palumbo, Leslie Buckle, Lisa Sayer, and Janice Pogue. “Organizational Strategies with Unilateral or Bilateral Frontal Lobe Injury in Word Learning Tasks.” Neuropsycholog… [cited by applicant]
Swick, Diane, and Robert T. Knight. “Is Prefrontal Cortex Involved in Cued Recall? A Neuropsychological Test of PET Findings.” Neuropsychologia 34, No. 10 (Oct. 1, 1996): 1019-28. https://doi.org/10.1016/0028-3932(96)00… [cited by applicant]
Yerkes, Robert M., and John D. Dodson. “The Relation of Strength of Stimulus to Rapidity of Habit-Formation.” Journal of Comparative Neurology and Psychology 18, No. 5 (Nov. 1, 1908): 459-82. https://doi.org/10.1002/cne… [cited by applicant]
Kardon, R. H., Corbett, J. J., & Thompson, H. S. (1997). Segmental denervation and reinnervation of the iris sphincter as shown by infrared videographic transillumination. Ophthalmology, 105(2), 313-321. [cited by applicant]