Granted Patent B2

US 12,324,628 · App. 18/209,604 · Granted Jun 10, 2025

Inventors: Kyubo Shin (Ulsan, KR); Jaemin Park (Busan, KR); Jongchan Kim (Ulsan, KR); Yoon Won Tak (Ulsan, KR); Hwi Yeon Kim (Ulsan, KR); Eun Yeong Sim (Busan, KR)

Assignee: THYROSCOPE INC.

A61B3/14A61B5/0077A61B5/1079A61B5/4227A61B5/7275G06T7/0012G06T7/62H04N23/611H04N23/633H04N23/64H04N23/698G06T2207/30041

Abstract

Claims (64)

1. A method of obtaining user information to analyze a Clinical Activity Score (CAS) of a user, the method comprising:

providing a guidance on a photographing device to indicate a proper position of at least one eye of the user,

obtaining a facial image of the user in response to satisfying predetermined conditions,

wherein the facial image comprises at least one eye of the user,

wherein the predetermined conditions comprise:

1) whether a position of at least one eye is on a predetermined region,

2) whether a degree of rotation of a face of the user is within a predetermined range,

3) whether a degree of the user's smile is the same or less than a first predetermined value, and

4) whether a degree of ambient brightness is the same or less than a second predetermined value,

outputting inquiries on the photographing device after obtaining the facial image, and

obtaining user input in response to the inquiries,

wherein the user input comprises a first input related to pain on an attempted upward or downward gaze and a second input related to spontaneous retrobulbar pain.

2. The method of claim 1 further comprises,

transmitting the user information to an external device that analyzes the CAS of the user, and

wherein the user information comprises the facial image and the user input.

3. The method of claim 1 ,

wherein after obtaining the facial image and before outputting the inquiries, the following steps are performed:

outputting a cropped image generated from the facial image, and

obtaining other user input to determine using of the facial image to analyze Clinical Activity Score (CAS) of the user.

4. The method of claim 1 ,

wherein the degree of the user's smile is determined by an algorithm selected from a facial expression analysis algorithm, a landmark detection algorithm, or in combination, and

wherein the first predetermined value is 0.1.

5. The method of claim 1 ,

wherein the degree of the ambient brightness is a value obtained by a sensor of the photographing device, and

wherein the second predetermined value is 1000 lux.

6. The method of claim 1 ,

wherein the degree of rotation of the face is determined by an algorithm selected from a pitch detection algorithm, a landmark detection algorithm, or in combination, and

wherein the predetermined range is from −2° to +2° with respect to an up-down rotation angle of the face.

7. The method of claim 1 ,

wherein the degree of rotation of the face is determined by an algorithm selected from a yaw estimation algorithm, a landmark detection algorithm, or in combination, and

wherein the predetermined range is from −2° to +2° with respect to a left-right rotation angle of the face.

8. The method of claim 1 ,

wherein the degree of rotation of the face is determined by a position of a nose of the user and a position of a chin on a preview image, and

wherein the predetermined range is determined based on a position of a nose and a position of a chin on a reference image, the reference image had obtained before obtaining the preview image.

9. The method of claim 1 ,

wherein when obtaining the facial image, a flash of the photographing device does not actuate.

10. The method of claim 1 ,

wherein the guidance comprises a first indication corresponding to a proper position of a pupil of a left eye and a second indication corresponding to a proper position of a pupil of a right eye.

11. The method of claim 10 ,

wherein the position of at least one eye is determined by a landmark algorithm, and

wherein the predetermined region comprises a plurality of coordinate points corresponding to a left eye and a plurality of coordinate points corresponding to a right eye.

12. The method of claim 10 ,

wherein the position of at least one eye is determined by a landmark algorithm, and

wherein the predetermined region comprises a plurality of coordinate points corresponding to a left pupil and a plurality of coordinate points corresponding to a right pupil.

13. The method of claim 1 ,

wherein the guidance comprises a first indication corresponding to a proper position of an iris of a left eye and a second indication corresponding to a proper position of an iris of a right eye.

14. A non-transitory computer-readable medium storing one or more instructions, wherein

when the one or more instructions is executed by one or more processors of a computing device, the one or more instructions cause the computing device to perform the method of claim 1 .

15. A photographing device for obtaining user information to analyze a Clinical Activity Score (CAS) of a user, the photographing device comprising:

a communication part;

a storage part configured to store one or more instructions therein; and

a controller configured to execute the one or more instructions stored in the storage part,

wherein the controller is configured to, by executing the one or more instructions:

provide a guidance on a photographing device to indicate a proper position of at least one eye of the user,

obtain a facial image of the user in response to satisfying predetermined conditions,

wherein the facial image comprises at least one eye of the user,

wherein the predetermined conditions comprise:

 1) whether a position of at least one eye is on a predetermined region,

 2) whether a degree of rotation of a face of the user is within a predetermined range,

 3) whether a degree of the user's smile is the same or less than a first predetermined value, and

 4) whether a degree of ambient brightness is the same or less than a second predetermined value,

output inquiries on the photographing device after obtaining the facial image, and

obtain user input in response to the inquiries,

wherein the user input comprises a first input related to pain on an attempted upward or downward gaze and a second input related to spontaneous retrobulbar pain.

Assignments (1)

Priority Claims (2)

Continuity (3)

References Cited (50)