System and method for automatically generating care record
A system and method for automatically generating a care record are provided, which are suitable for a baby bed cover. The system includes an image capturing device and a processor. The image capturing device captures a real-time image of a baby in the baby bed. The processor is configured to receive the real-time image and detects whether an abnormal event occurs in the real-time image. The processor detects an opening time and a closing time of the bed cover to obtain a start and end time of a care operation. The processor recognizes an abnormal event type according to the abnormal event, selects a care record template according to the abnormal event type, and generates a care record according to an occurrence time of the abnormal event, the abnormal event type, the start and end time of the care operation, and the care record template.
1 . A system for automatically generating a care record applied to a baby bed, a hinge and a bed cover arranged above the baby bed, the bed cover rotates relative to the baby bed with the hinge as a rotation axis, the system comprising:
an image capturing device with a downward field of view (FOV) configured on the bed cover to capture a real-time image of a baby in the baby bed; and
a processor coupled to the image capturing device and configured to receive the real-time image, detect whether an abnormal event occurs in the real-time image, and perform a care operation when an occurrence of the abnormal event in the real-time image is detected, detect an opening time and a closing time of the bed cover to obtain a start time and an end time of the care operation, recognize an abnormal event type according to the abnormal event, and select a care record template according to the abnormal event type to correspondingly generate a care record according to an occurrence time of the abnormal event, the abnormal event type, the start time and the end time of the care operation, and the care record template, wherein an operation in which the processor detects the opening time and the closing time of the bed cover to obtain the start time and the end time of the care operation further comprises:
the processor being further configured to use a region of interest (ROI) to perform face detection on the abnormal image corresponding to the abnormal event to obtain a baby face, obtain a human face ratio of the baby face to the abnormal image corresponding to the abnormal event, when the bed cover rotates relative to the baby bed with the hinge as the rotation axis so that the bed cover is away from the baby bed, the processor obtains a minimum of the human face ratio of the baby face to the abnormal image, the bed cover is opened, and perform the care operation, the processor obtains an opening time of the bed cover as the start time of the care operation, after performing the care operation, when the bed cover rotates relative to the baby bed with the hinge as the rotation axis so that the bed cover approaches the baby bed, the processor obtains a maximum of the human face ratio of the baby face to the abnormal image, the bed cover is closed, and the processor obtains a closing time of the bed cover as the end time of the care operation.
2 . The system for automatically generating the care record according to claim 1 , wherein an operation in which the processor recognizes the abnormal event type according to the abnormal event and selects the care record template according to the abnormal event type to correspondingly generate the care record according to the occurrence time of the abnormal event, the abnormal event type, the start time and the end time of the care operation, and the care record template further comprises:
the processor being further configured to obtain a name of a caretaker, a bed cover recognition code corresponding to the baby bed, an abnormal image corresponding to the abnormal event, and an image before the care operation and an image after the care operation.
3 . The system for automatically generating the care record according to claim 2 , the system further comprising:
a storage device coupled to the image capturing device and the processor and configured to store a plurality of care record templates respectively corresponding to the abnormal event type and the care record.
4 . The system for automatically generating the care record according to claim 1 , wherein an operation in which the processor is configured to receive the real-time image and detect whether the abnormal event occurs in the real-time image further comprises:
in response to an occurrence of the abnormal event being detected in the real-time image, the processor being further configured to transmit a warning signal to notify a caretaker.
5 . The system for automatically generating the care record according to claim 1 , wherein an operation in which the processor is configured to receive the real-time image and detect whether the abnormal event occurs in the real-time image further comprises:
the processor being further configured to detect whether the abnormal event occurs in the real-time image by using a deep neural network (DNN).
6 . The system for automatically generating the care record according to claim 3 , wherein the care record comprises at least one of the bed cover recognition code, the name of the caretaker, the occurrence time of the abnormal event, the abnormal event type, the start time and the end time of the care operation, the abnormal image corresponding to the abnormal event, the image before the care operation, and the image after the care operation.
7 . A method for automatically generating a care record applied to a baby bed, a hinge and a bed cover arranged above the baby bed, the bed cover rotates relative to the baby bed with the hinge as a rotation axis, the method comprising:
capturing a real-time image of a baby in the baby bed by an image capturing device with a downward field of view (FOV);
receiving the real-time image and detecting whether an abnormal event occurs in the real-time image, and performing a care operation when an occurrence of the abnormal event in the real-time image is detected;
detecting an opening time and a closing time of the bed cover to obtain a start time and an end time of the care operation; and
recognizing an abnormal event type according to the abnormal event to select a care record template according to the abnormal event type to correspondingly generate a care record according to an occurrence time of the abnormal event, the abnormal event type, the start time and the end time of the care operation, and the care record template, wherein detecting the opening time and the closing time of the bed cover to obtain the start time and the end time of the care operation further comprises:
using a region of interest (ROI) to perform face detection on the abnormal image corresponding to the abnormal event and calculate a human face ratio of a baby face to the abnormal image corresponding to the abnormal event, when the bed cover rotates relative to the baby bed with the hinge as the rotation axis so that the bed cover is away from the baby bed, obtaining a minimum of the human face ratio of the baby face to the abnormal image, the bed cover is opened, and performing the care operation, obtaining an opening time of the bed cover as the start time of the care operation, after performing the care operation, when the bed cover rotates relative to the baby bed with the hinge as the rotation axis so that the bed cover approaches the baby bed, obtaining a maximum of the human face ratio of the baby face to the abnormal image, the bed cover is closed, and obtaining a closing time of the bed cover as the end time of the care operation.
8 . The method for automatically generating the care record according to claim 7 , wherein recognizing the abnormal event type according to the abnormal event to select the care record template according to the abnormal event type to correspondingly generate the care record according to the occurrence time of the abnormal event, the abnormal event type, the start time and the end time of the care operation, and the care record template further comprises:
obtaining a name of a caretaker, a bed cover recognition code corresponding to the baby bed, an abnormal image corresponding to the abnormal event, and an image before the care and an image after the care operation.
9 . The method for automatically generating the care record according to claim 8 , the method further comprising:
storing a plurality of care record templates respectively corresponding to the abnormal event type and the care record.
10 . The method for automatically generating the care record according to claim 7 , wherein receiving the real-time image and detecting whether the abnormal event occurs in the real-time image further comprise:
in response to an occurrence of the abnormal event being detected in the real-time image, transmitting a warning signal to notify a caretaker.
11 . The method for automatically generating the care record according to claim 7 , wherein receiving the real-time image and detecting whether the abnormal event occurs in the real-time image further comprise:
detecting whether the abnormal event occurs in the real-time image by using a deep neural network.
12 . The method for automatically generating the care record according to claim 9 , wherein the care record comprises at least one of the bed cover recognition code, the name of the caretaker, the occurrence time of the abnormal event, the abnormal event type, the start time and the end time of the care operation, the abnormal image corresponding to the abnormal event, the image before the care operation, and the image after the care operation.