IP Library Granted Patent US 11,321,831
Granted Patent B2
US 11,321,831 · App. 16/651,269 · Granted May 3, 2022

Automated evaluation of human embryos

Inventors: Hadi Shafiee (Boston, MA); Charles Bormann (Boston, MA); Manoj Kumar Kanakasabapathy (Boston, MA); Prudhvi Thirumalaraju (Boston, MA)
Assignees: THE BRIGHAM AND WOMEN'S HOSPITAL, INC.; THE GENERAL HOSPITAL CORPORATION
G06T7/0012G06T2207/10024G06T2207/20036G06T2207/20081G06T2207/20084G06T2207/30044
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,321,831
App. No.
16/651,269
Granted
May 3, 2022
Kind
B2
Abstract

Systems and methods are provided for provided for automatic evaluation of a human embryo. An image of the embryo is obtained and provided to a neural network to generate a plurality of values representing the morphology of the embryo. The plurality of values representing the morphology of the embryo are evaluated at an expert system to provide an output class representing one of a current quality of the embryo, a future quality of the embryo, a likelihood that implantation of the embryo will be successful, and a likelihood that implantation of the embryo will result in a live birth.

Claims (31)

1. A method for fully automatic evaluation of a human embryo, comprising:

obtaining an image of the embryo representing a specific time point in the development of the embryo;

generating, from the image of the embryo, a plurality of values representing a morphology of the embryo at a neural network trained on a set of images of embryos representing the specific time point, each image of the set of images being labeled with an output class of a plurality of output classes; and

evaluating the plurality of values representing the morphology of the embryo at an expert system to provide an output class of the plurality of output classes, each of the plurality of output classes representing one of a current quality of the embryo, a future quality of the embryo, a likelihood that implantation of the embryo will be successful, and a likelihood that implantation of the embryo will result in a live birth.

2. The method of claim 1 , wherein the the neural network is a recurrent neural network.

3. The method of claim 1 , wherein the neural network comprises a discriminative classifier trained as part of a generative adversarial network.

4. The method of claim 1 , wherein the neural network comprises a convolutional neural network.

5. The method of claim 1 , the method further comprising providing a plurality of features each representing biometric parameters of one of a patient receiving the embryo, an egg utilized to produce the human embryo, a sperm donor who provided sperm used to create the embryo, and an egg donor who provided the egg to the expert system, the expert system providing the output class based upon the plurality of values and the plurality of features.

6. The method of claim 5 , wherein the expert system is a feedforward neural network.

7. The method of claim 5 , wherein the biometric parameters represented by the plurality of features include at least one of an age of the egg, a body mass index of the patient, an age of the patient, an egg maturation status, a method of fertilization for the embryo, a treatment regime for the patient, a hormonal profile of the patient, and an age of the egg donor, a past diagnosis of a condition of the patient, a past diagnosis of a condition of the sperm donor, and an endometrium thickness of the patient.

8. The method of claim 1 , wherein the expert system comprises a genetic algorithm that calculates a plurality of weights corresponding to the plurality of values, such that the output is determined as weighted linear combination of the plurality of values.

9. A system for fully automatic evaluation of a human embryo comprising:

an imager that acquires an image of the embryo at a specific time point in the development of the embryo;

a convolutional neural network that calculates, from the image of the embryo, at least one output value representing one of a current quality of the embryo, a future quality of the embryo, a likelihood that implantation of the embryo will be successful, and a likelihood that implantation of the embryo will result in a live birth, wherein the convolutional neural network is trained on a set of images, each image of the set of images comprising a training embryo representing the specific time point being labeled with an output value representing one of a current quality of the training embryo, a future quality of the training embryo, a likelihood that implantation of the training embryo will be successful, and a likelihood that implantation of the training embryo will result in a live birth.

10. The system of claim 9 , wherein the imager acquires the image of the embryo on a first day of development, and the at least one output value includes a value representing a likelihood that the embryo currently has two pronuclei.

11. The system of claim 9 , wherein the imager acquires the image of the embryo on a third day of development, and the at least one output value represents an expected grade of the embryo on a fifth day of development.

12. The system of claim 9 , wherein the imager acquires the image of the embryo on a fifth day of development, and the at least one output value represents a current grade of the embryo.

13. The system of claim 12 , wherein the embryo is a first embryo of a plurality of embryos, and the at least one output value is a plurality of output values, each representing one of a plurality of possible grades for the embryo on the fifth day of development, the system further comprising an embryo selector that assigns, for each embryo, a score as a weighted linear combination of the plurality of output values weighted by a corresponding plurality of weights.

14. The system of claim 12 , wherein the plurality of weights are generated via a genetic algorithm trained on a training set comprising sets of output values for a set of embryos and a corresponding set of outcomes for the set of embryos following implantation of the set of embryos into a patient.

15. The system of claim 9 , wherein the imager comprises:

a white light emitting diode;

a complementary metal-oxide-semiconductor (CMOS) image sensor; and

an objective lens connected to the CMOS image sensor.

16. The system of claim 9 , wherein the imager comprises a plastic housing containing an acrylic lens and configured to affix to a mobile device, such that the acrylic lens is aligned with a camera of the mobile device.

17. The system of claim 9 , further comprising an expert system that receives the at least one output value and a set of values representing biometric parameters of one of a patient receiving the embryo, an egg utilized to produce the human embryo, a sperm donor who provided sperm used to create the embryo, and an egg donor who provided the egg and produces an output representing one of a likelihood that implantation of the embryo will be successful and a likelihood that implantation of the embryo will result in a live birth.

18. The system of claim 17 , wherein the biometric parameters represented by the set of values include at least one of an age of the egg, a body mass index of the patient, an age of the patient, an egg maturation status, a method of fertilization for the embryo, a treatment regime for the patient, a hormonal profile of the patient, and an age of the egg donor, a past diagnosis of a condition of the patient, a past diagnosis of a condition of the sperm donor, and an endometrium thickness of the patient.

19. A system for fully automatic evaluation of a human embryo, comprising:

an imager that acquires an image of the embryo at a specific time point in the development of the embryo;

a convolutional neural network that generates a plurality of values representing a morphology of the embryo from the image of the embryo, wherein the convolutional neural network is trained on a set of images, each image of the set of images comprising a training embryo representing the specific time point being labeled with an output value representing one of a current quality of the training embryo, a future quality of the training embryo, a likelihood that implantation of the training embryo will be successful, and a likelihood that implantation of the training embryo will result in a live birth; and

an expert system that evaluates the plurality of values representing the morphology of the embryo to provide an output value representing one of a current quality of the embryo, a future quality of the embryo, a likelihood that implantation of the embryo will be successful, and a likelihood that implantation of the embryo will result in a live birth.

20. The system of claim 19 , wherein the expert system further receives a set of values representing biometric parameters of one of a patient receiving the embryo, an egg utilized to produce the human embryo, a sperm donor who provided sperm used to create the embryo, and an egg donor who provided the egg.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 19, 2022
From: BORMANN, CHARLES
To: THE GENERAL HOSPITAL CORPORATION
Reel/Frame 058696/0188 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 5, 2021
From: SHAFIEE, HADI; BORMANN, CHARLES; KANAKASABAPATHY, MANOJ KUMAR; THIRUMALARAJU, PRUDHVI
To: THE BRIGHAM AND WOMEN'S HOSPITAL, INC.
Reel/Frame 055504/0185 →
Continuity (3)
Provisional Application 62651658 · Apr 2, 2018
Provisional Application 62565237 · Sep 29, 2017
Related Publication 20200226750A1 · Jul 16, 2020
Cited By (2)
US 12,333,715 US 12,555,224