Active marker device for performance capture
A performance capture system is provided to detect one or more active marker units in a live action scene. Active marker units emanate at least one wavelength of light that is captured by the performance capture system and used to detect the active markers in the scene. The system detects the presence of the light as a light patch in a capture frames and determines if the light patch represents light from an active marker unit. In some implementations, various active markers in a scene may emanate different wavelengths of light. For example, wavelengths of light from multi-emitting active marker units may be changed due to various conditions in the scene.
1. A method for detecting one or more active marker units in performance capture associated with a virtual production, the method comprising:
providing the one or more active marker units attached to an object in a live action scene, each of the one or more active marker units being configured to emanate at least one wavelength of electromagnetic radiation in response to signals from a signal controller;
detecting by a plurality of sensor devices, a presence of electromagnetic radiation captured in frames produced by the plurality of sensor devices;
generating marker data associated with the detected presence of electromagnetic radiation; and
determining according to the marker data, by the one or more processors, that the frames represent at least one active marker unit of the one or more active marker units, based, at least in part, on the frames corresponding with predefined frames associated with blocks of time expected to include the at least one wavelength of electromagnetic radiation emanating from the at least one active marker unit.
2. The method of claim 1 , wherein the one or more active marker units include a first active marker unit that emanates a first wavelength of electromagnetic radiation and a second active marker unit that emanates a second wavelength of electromagnetic radiation that is different from the first wavelength of electromagnetic radiation.
3. The method of claim 1 , wherein the at least one active marker unit emanates a first wavelength of electromagnetic radiation at a first time period and emanates a second wavelength of electromagnetic radiation at a second time period.
4. The method of claim 3 , wherein emanating of the first wavelength of electromagnetic radiation is in response to first signals from the signal controller and emanating of the second wavelength of electromagnetic radiation is in response to second signals from the signal controller.
5. The method of claim 4 , further comprising:
determining target marker parameters suitable for a current condition, wherein the first signals and second signals are responsive to the target marker parameters.
6. The method of claim 1 , wherein the one or more active marker units simultaneously emanate a first wavelength of electromagnetic radiation and a second wavelength of electromagnetic radiation.
7. The method of claim 6 , wherein a first portion of a diffuser of the at least one active marker unit is transmissive to the first wavelength of electromagnetic radiation and a second portion of the diffuser is transmissive for the second wavelength of electromagnetic radiation.
8. The method of claim 1 , wherein determining that the frames represent the at least one active marker unit is further based on verification that the at least one wavelength of electromagnetic radiation is captured by at least two sensor devices of the plurality of sensor devices during the blocks of time.
9. A non-transitory computer-readable storage medium carrying program instructions thereon to detect one or more active marker units in attached to an object in a live action scene of a virtual production, the instructions when executed by one or more processors cause the one or more processors to perform operations comprising:
generating marker data associated with a presence of at least one wavelength of electromagnetic radiation captured in frames produced by a plurality of sensor devices, the at least one wavelength of electromagnetic radiation emanated from the one or more active marker units in response to signals received from a signal controller; and
determining according to the marker data that the frames represent at least one active marker unit of the one or more active marker units, based, at least in part, on the frames corresponding with predefined frames associated with blocks of time expected to include the at least one wavelength of electromagnetic radiation emanating from the at least one active marker unit.
10. The computer-readable storage medium of claim 9 ,
wherein the at least one active marker unit emanates a first wavelength of electromagnetic radiation at a first time period and emanates a second wavelength of electromagnetic radiation at a second time period.
11. The computer-readable storage medium of claim 10 , wherein emanating of the first wavelength of electromagnetic radiation is in response to first signals from the signal controller and emanating of the second wavelength of electromagnetic radiation is in response to second signals from the signal controller.
12. The computer-readable storage medium of claim 11 , the operations further comprise:
determining target marker parameters suitable for a current condition, wherein the first signals and second signals are responsive to the target marker parameters.
13. The computer-readable storage medium of claim 9 , wherein the one or more active marker units simultaneously emanate a first wavelength of electromagnetic radiation and a second wavelength of electromagnetic radiation.
14. The computer-readable storage medium of claim 9 , wherein determining that the frames represent the at least one active marker unit is further based on verification that the at least one wavelength of electromagnetic radiation is captured by at least two sensor devices of the plurality of sensor devices during the blocks of time.
15. A system to detect an active marker unit in performance capture associated with a virtual production, the system comprising:
one or more active marker units attached to an object in a live action scene, each of the one or more active marker units being configured to emanate at least one wavelength of electromagnetic radiation in response to signals received from a signal controller;
a plurality of sensor devices configured to capture a presence of electromagnetic radiation in frames; and
a computer device comprising:
one or more processors; and
one or more non-transitory computer-readable media with logic encoded thereon, the one or more processors executing the logic to perform operations comprising:
generating marker data associated with the presence of electromagnetic radiation captured in the frames; and
determining according to the marker data that the frames represent at least one active marker unit of the one or more active marker units, based, at least in part, on the frames corresponding with predefined frames associated with blocks of time expected to include the at least one wavelength of electromagnetic radiation emanating from the one or more active marker units.
16. The system of claim 15 , wherein the at least one active marker unit includes a first active marker unit that emanates a first wavelength of electromagnetic radiation and a second active marker unit that emanates a second wavelength of electromagnetic radiation that is different from the first wavelength of electromagnetic radiation.
17. The system of claim 15 , wherein the at least one active marker unit emanates a first wavelength of electromagnetic radiation at a first time period and emanates a second wavelength of electromagnetic radiation at a second time period.
18. The system of claim 15 , wherein the one or more active marker units simultaneously emanate a first wavelength of electromagnetic radiation and a second wavelength of electromagnetic radiation.
19. The system of claim 18 , wherein a first portion of a diffuser of the at least one active marker unit is transmissive to the first wavelength of electromagnetic radiation and a second portion of the diffuser is transmissive for the second wavelength of electromagnetic radiation.
20. The system of claim 15 , wherein determining that the frames represent the at least one active marker unit is further based on verification that the at least one wavelength of electromagnetic radiation is captured by at least two sensor devices of the plurality of sensor devices during the blocks of time.