IP Library Granted Patent US 11,423,697
Granted Patent B1
US 11,423,697 · App. 17/401,053 · Granted Aug 23, 2022

Machine learning architecture for imaging protocol detector

Inventors: Tim Wucher (Windhoek, NA); Ryan Amelon (Nashville, TN); Jordan Katzman (Nashville, TN); Aleksey Gurtovoy (Nashville, TN)
Assignee: SDC U.S. SMILEPAY SPV
G06V40/171G06N20/00G06T7/0002G06V20/41G06V20/46G06T2207/20081G06T2207/30168G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,423,697
App. No.
17/401,053
Granted
Aug 23, 2022
Kind
B1
Abstract

Disclosed is a machine learning architecture for a two-dimensional image protocol detector configured to receive a first image representing at least a portion of a mouth of a user, and output user feedback for capturing a second image representing a portion of the mouth of the user, where the machine learning architecture outputs the user feedback in response to an image quality score of the first image not satisfying an image quality threshold.

Claims (45)

1. A system comprising:

a capture device configured to capture a first image representing at least a portion of a mouth of a user;

a communication device configured to communicate user feedback to the user using a display; and

a processor and a non-transitory computer-readable medium containing instructions that when executed by the processor causes the processor to perform operations comprising:

receiving the first image representing at least the portion of the mouth of the user; and

outputting user feedback for capturing a second image representing at least a portion of the mouth of the user, wherein the user feedback is output in response to using a machine learning architecture to determine that an image quality score of the first image does not satisfy an image quality threshold, the user feedback comprising matching, using the display, a first object overlaid on top of the first image representing at least the portion of the mouth of the user to a second object overlaid on top of the first image representing at least the portion of the mouth of the user.

2. The system of claim 1 , wherein the capture device is further configured to stream a video, the video comprising a plurality of frames, at least one of the frames representing the portion of the mouth of the user.

3. The system of claim 2 , wherein the processor is further configured to perform operations comprising automatically identifying a frame of the plurality of frames as a high quality image, the frame being identified as the high quality image in response to determining via the machine learning architecture that the image quality score of the frame satisfies the image quality threshold.

4. The system of claim 1 , wherein the communication device is configured to communicate user feedback to the user using audio.

5. The system of claim 1 , wherein the communication device is configured to communicate user feedback to the user using haptic feedback.

6. The system of claim 1 , wherein the capture device comprises a light, the capture device configured to activate the light in response to the user feedback.

7. A computer-implemented method comprising:

receiving, by a machine learning architecture executing on one or more processors, a first image representing at least a portion of a mouth of a user;

determining, by the machine learning architecture, user feedback for outputting to the user, wherein the user feedback is determined based on a machine learning model of the machine learning architecture, the machine learning model trained by calculating a reward in response to an action and a policy; and

outputting, by the machine learning architecture, the user feedback, the user feedback for capturing a second image representing a portion of the mouth of the user, wherein the machine learning architecture outputs the user feedback in response to an image quality score of the first image not satisfying an image quality threshold.

8. The computer-implemented method of claim 7 , wherein the image quality score comprises at least one of an image quality score with respect to an image characteristic or an image quality score with respect to image content.

9. The computer-implemented method of claim 8 , wherein the image quality score with respect to the image characteristic is determined using a machine learning model of the machine learning architecture, the machine learning model trained using a training dataset comprising a distorted image and a corresponding clean image.

10. The computer-implemented method of claim 8 , wherein the image quality score with respect to image content is determined using a machine learning model of the machine learning architecture, the machine learning model trained using a class label to identify a class in a training image.

11. The computer-implemented method of claim 7 , wherein the image quality score is used to predict at least one of a future image characteristic or a future image content.

12. The computer-implemented method of claim 7 , further comprising:

selecting, by the machine learning architecture, a user feedback phrase, the user feedback phrase being output to the user as the user feedback, the user feedback phrase selected in response to a user feedback type output from the machine learning model, the user feedback phrase selected from a dictionary of phrases.

13. The computer-implemented method of claim 7 , further comprising:

receiving, by the one or more processors, a video comprising a plurality of frames, at least one of the frames representing the portion of the mouth of the user; and

extracting, by the one or more processors, the at least one frame representing the portion of the mouth of the user as the first image.

14. The computer-implemented method of claim 7 , further comprising:

receiving, by the machine learning architecture, the second image representing at least the mouth of the user;

causing, by the machine learning architecture, the second image to be provided to a server in response to an image quality score of the second image satisfying the image quality threshold.

15. The computer-implemented method of claim 7 , wherein the machine learning architecture executes on one or more processors of a device, and wherein the first image is captured by the device.

16. The computer-implemented method of claim 7 , wherein the machine learning architecture executes on one or more processors of a server, and wherein the first image is captured by a device of the user.

17. The computer-implemented method of claim 7 , further comprising:

receiving, by the machine learning architecture, another image representing at least a portion of the mouth of the user; and

outputting, by the machine learning architecture, user feedback in response to an image quality score of the another image satisfying the image quality threshold.

18. The computer-implemented method of claim 7 , further comprising:

receiving, by the machine learning architecture, a third image; and

outputting, by the machine learning architecture, user feedback in response to determining via the machine learning architecture that the third image does not represent at least a portion of the mouth of the user.

19. A system comprising:

a communication device configured to capture a first image representing at least a portion of a mouth of a user and communicate the first image to a server; and

a processor of the server and a non-transitory computer-readable medium containing instructions that when executed by the processor causes the processor to perform operations comprising:

receiving the first image representing at least the portion of the mouth of the user;

selecting, using a machine learning architecture, a user feedback phrase, the user feedback phrase selected in response to a user feedback type output from a machine learning model, the user feedback phrase selected from a dictionary of phrases; and

communicating, to the communication device, user feedback for capturing a second image representing at least a portion of the mouth of the user, wherein the user feedback is determined in response to determining via an imaging protocol algorithm that an image quality score of a portion of the first image does not satisfy an image quality threshold, wherein the user feedback comprises the user feedback phrase.

20. The system of claim 19 , wherein the instructions when executed by the processor further cause the processor to transmit a command to the communication device using an application programming interface.

21. The system of claim 19 , wherein the server communicates to the communication device using an application on the communication device supported by a corresponding application on the server.

22. The system of claim 19 , wherein the instructions when executed by the processor further cause the processor to receive a second portion of the first image satisfying an image quality threshold.

23. The system of claim 19 , wherein the instructions when executed by the processor further cause the processor to bias the user feedback to improve the portion of the first image that does not satisfy the image quality threshold.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 29, 2024
From: SDC U.S. SMILEPAY SPV
To: OTIP HOLDING, LLC
Reel/Frame 068178/0379 →
SECURITY INTEREST Recorded Apr 28, 2022
From: SMILEDIRECTCLUB, LLC
To: SDC U.S. SMILEPAY SPV
Reel/Frame 059759/0145 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 28, 2022
From: SMILEDIRECTCLUB, LLC
To: SDC U.S. SMILEPAY SPV
Reel/Frame 059764/0431 →
SECURITY INTEREST Recorded Apr 28, 2022
From: SDC U.S. SMILEPAY SPV
To: HPS INVESTMENT PARTNERS, LLC
Reel/Frame 059820/0026 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 27, 2021
From: WUCHER, TIM; AMELON, RYAN; KATZMAN, JORDAN; GURTOVOY, ALEKSEY
To: SMILEDIRECTCLUB LLC
Reel/Frame 057603/0924 →
Cited By (4)
US 12,210,802 US 12,236,594 US 12,295,806 US 12,705,737