Device and method of correlating rodent vocalizations with rodent behavior
The field of this invention is classifying animal behaviors. In particular the fields of this invention include using animals in vivariums, such as rodents, particularly mice. Ultrasonic vocalizations are compared to times-shifted video behaviors of the same mice to identify vocalizations that occur prior to, during, and after particular video behaviors. The comparisons generate correlations weights that may then be used to apply known classifications of the video behaviors to the vocalizations.
1. A device for automatically correlating animal vocalizations with animal behaviors comprising:
a study animal type, wherein the study animal type is non-human;
a vivarium comprising a first study animal in a vivarium home cage;
at least one ultrasonic audio sensor proximal to the vivarium home cage, adapted to receive from the vivarium home cage audio vocalizations and then communicate the audio vocalizations to a first, second and third processor;
at least one video camera proximal to the vivarium home cage, adapted to detect and communicate one or more video behaviors of the first study animal;
the first processor adapted to compare the audio vocalizations with the one or more video behaviors, wherein a first audio vocalization, of the audio vocalizations, occurs prior to a first video behavior, of the one or more video behaviors;
the second processor adapted to compare the audio vocalizations with the one or more video behaviors, wherein a second audio vocalization, of the audio vocalizations, occurs overlapped in time to a second video behavior of the one or more video behaviors;
the third processor adapted to compare the audio vocalizations with the one or more video behaviors, wherein a third audio vocalization, of the audio vocalizations, occurs after to a third video behavior of the one or more video behaviors;
wherein outputs of the first, second and third processors comprise correlation weights of respective comparisons of the first, second, and third processors; and
wherein the first, second and third processor may be a same processor or two processors;
wherein the correlation weights are selected to optimize an expected probability of a valid association of an audio vocalization with the one more video behaviors to which it is compared.
2. The device of claim 1 , further comprising:
a fourth processor adapted to accept as input the correlation weights from the first, second and third processor; and to generate as output classification metrics responsive to the audio vocalizations and the one or more video behaviors;
wherein the fourth processor may be the same processor as one of the first, second or third processors.
3. The device of claim 1 , wherein:
the vivarium home cage is free of electronic penetrations.
4. The device of claim 1 , wherein:
the at least one ultrasonic sensor is mechanically independent of the vivarium home cage such that the at least one ultrasonic sensor or the vivarium home cage are replaceable without mechanically moving the vivarium home cage or the at least one ultrasonic sensor, respectively.
5. The device of claim 1 , wherein:
the device is free of manually observed behavior of the first study animal, and free of manually communicated behavior of the first study animal, and free of manual classifying of sets of behaviors.
6. The device of claim 1 , wherein:
the communication of the audio vocalizations and the detection and communication of the one or more behaviors are continuous.
7. A method of classifying study animal behaviors using a device comprising:
a study animal type, wherein the study animal type is non-human;
a vivarium comprising a first study animal in a vivarium home cage;
at least one ultrasonic audio sensor proximal to the vivarium home cage, adapted to receive from the vivarium home cage audio vocalizations and then communicate the audio vocalizations to a first, second and third processor;
at least one video camera proximal to the vivarium home cage, adapted to detect and communicate one or more video behaviors of the first study animal;
the first processor adapted to compare the audio vocalizations with the one or more video behaviors, wherein a first audio vocalization, of the audio vocalizations, occurs prior to a first video behavior, of the one or more video behaviors;
the second processor adapted to compare the audio vocalizations with the one or more video behaviors, wherein a second audio vocalization, of the audio vocalizations, occurs overlapped in time to a second video behavior of the one or more video behaviors;
the third processor adapted to compare the audio vocalizations with the one or more video behaviors, wherein a third audio vocalization, of the audio vocalizations, occurs after to a third video behavior of the one or more video behaviors;
wherein outputs of the first, second and third processors comprise correlation weights of respective comparisons of the first, second, and third processors; and
wherein the first, second and third processor may be a same processor or two processors;
wherein the correlation weights are selected to optimize an expected probability of a valid association of an audio vocalization with the one more video behaviors to which it is compared.
8. A system of classifying study animal behaviors using a device comprising:
a study animal type, wherein the study animal type is non-human;
a vivarium comprising a first study animal in a vivarium home cage;
at least one ultrasonic audio sensor proximal to the vivarium home cage, adapted to receive from the vivarium home cage audio vocalizations and then communicate the audio vocalizations to a first, second and third processor;
at least one video camera proximal to the vivarium home cage, adapted to detect and communicate one or more video behaviors of the first study animal;
the first processor adapted to compare the audio vocalizations with the one or more video behaviors, wherein a first audio vocalization, of the audio vocalizations, occurs prior to a first video behavior, of the one or more video behaviors;
the second processor adapted to compare the audio vocalizations with the one or more video behaviors, wherein a second audio vocalization, of the audio vocalizations, occurs overlapped in time to a second video behavior of the one or more video behaviors;
the third processor adapted to compare the audio vocalizations with the one or more video behaviors, wherein a third audio vocalization, of the audio vocalizations, occurs after to a third video behavior of the one or more video behaviors;
wherein outputs of the first, second and third processors comprise correlation weights of respective comparisons of the first, second, and third processors; and
wherein the first, second and third processor may be a same processor or two processors;
wherein the correlation weights are selected to optimize an expected probability of a valid association of an audio vocalization with the one more video behaviors to which it is compared.