Movement tracking of operator-facing cameras
Systems and methods for optimizing operator-state detection including tracking position of an operator-facing camera are described. Systems and methods include receiving a first image captured by an operator-facing camera, detecting a first position of the operator-facing camera with respect to the calibration object, ascertaining the first position with respect to at least one fiducial marker within a passenger compartment of a vehicle, capturing, via controller, a second image using the operator-facing camera, determining the second image is captured by the operator-facing camera from a second position with respect to the at least one fiducial marker, and analyzing, based on determining the second image is captured by the operator-facing camera from the second position, the second image to identify facial features of the operator. The receiving, detecting, ascertaining, determining, and analyzing are performed via a controller. The first image includes a calibration object disposed at a predetermined location.
1. A method comprising:
receiving, via a controller, a first image captured by an operator-facing camera, the first image including a calibration object that is directly attached to a calibration apparatus, and the calibration apparatus is disposed at a predetermined location within a passenger compartment of a vehicle, the operator-facing camera being movable within the passenger compartment;
detecting a first position of the operator-facing camera with respect to the calibration object;
ascertaining the first position with respect to at least one fiducial marker disposed within the passenger compartment;
capturing a second image using the operator-facing camera, the second image including an operator and the at least one fiducial marker;
determining whether the second image is captured by the operator-facing camera from a second position with respect to the at least one fiducial marker; and
analyzing, based on determining the second image is captured by the operator-facing camera from the second position, the second image to identify facial features of the operator.
2. The method of claim 1 , wherein the calibration object is a plurality of crosshairs.
3. The method of claim 1 , wherein the calibration apparatus is removably coupled to a steering wheel of an adjustable steering apparatus.
4. The method of claim 1 , wherein the operator-facing camera is co-located with a steering wheel of an adjustable steering apparatus.
5. The method of claim 1 , wherein the at least one fiducial marker includes a structure within the passenger compartment.
6. The method of claim 1 , wherein the at least one fiducial marker includes an infrared-emitting object.
7. The method of claim 6 , wherein the infrared-emitting object is integrated within a textile.
8. The method of claim 6 , wherein the infrared-emitting object passively emits infrared radiation.
9. The method of claim 6 , wherein the infrared-emitting object actively emits infrared radiation and wherein the infrared-emitting object is selectively actuated to provide infrared radiation to the operator-facing camera while capturing the second image.
10. The method of claim 1 , further comprising determining a configuration of an operator seat, wherein analyzing the second image to identify facial features of the operator is further based on the configuration of the operator seat.
11. A vehicle comprising:
a passenger compartment configured to receive an operator therein;
an operator-facing camera configured to capture images of the passenger compartment including the operator, the operator-facing camera being movable within the passenger compartment of the vehicle; and
a controller in communication with the operator-facing camera, the controller being programmed to:
receive a first image captured by the operator-facing camera, the first image including a calibration object that is directly attached to a calibration apparatus, and the calibration apparatus is disposed at a predetermined location within the passenger compartment;
detect a first position of the operator-facing camera with respect to the calibration object;
ascertain the first position with respect to at least one fiducial marker disposed within the passenger compartment;
capture a second image using the operator-facing camera, the second image including the operator and the at least one fiducial marker;
determine whether the second image is captured by the operator-facing camera from a second position with respect to the at least one fiducial marker; and
analyze, based on determining the second image is captured by the operator-facing camera from the second position, the second image to identify facial features of the operator.
12. The vehicle of claim 11 , wherein the calibration object is a plurality of crosshairs.
13. The vehicle of claim 11 , wherein the calibration apparatus is removably coupled to a steering wheel of an adjustable steering apparatus.
14. The vehicle of claim 11 , wherein the operator-facing camera is co-located with a steering wheel of an adjustable steering apparatus.
15. The vehicle of claim 11 , wherein the at least one fiducial marker includes a structure within the passenger compartment.
16. The vehicle of claim 11 , wherein the at least one fiducial marker includes an infrared-emitting object.
17. The vehicle of claim 16 , wherein the infrared-emitting object is integrated within a textile, the infrared-emitting object passively emits infrared radiation, or both.
18. The vehicle of claim 16 , wherein the infrared-emitting object is configured to actively emit infrared radiation and wherein the infrared-emitting object is selectively actuated to provide infrared radiation to the operator-facing camera while capturing the second image.
19. The vehicle of claim 11 , wherein the controller is further programmed to determine a configuration of an operator seat, and wherein analyzing the second image to identify facial features of the operator is further based on the configuration of the operator seat.
20. An operator monitoring system comprising:
an operator-facing camera configured to capture images of a passenger compartment including an operator, the operator-facing camera being movable within the passenger compartment; and
a controller in communication with the operator-facing camera, the controller being programmed to:
receive a first image captured by the operator-facing camera, the first image including a calibration object that is directly attached to a calibration apparatus, and the calibration apparatus is disposed at a predetermined location within the passenger compartment;
detect a first position of the operator-facing camera with respect to the calibration object;
ascertain the first position with respect to at least one fiducial marker disposed within the passenger compartment;
capture a second image using the operator-facing camera, the second image including the operator and the at least one fiducial marker;
determine whether the second image is captured by the operator-facing camera from a second position with respect to the at least one fiducial marker; and
analyze, based on determining the second image is captured by the operator-facing camera from the second position, the second image to identify facial features of the operator.