Active marker device for performance capture
A performance capture system is provided to detect one or more active marker units in a live action scene. Active marker units emanate at least one wavelength of light that is captured by the performance capture system and used to detect the active markers in the scene. The system detects the presence of the light as a light patch in a capture frames and determines if the light patch represents light from an active marker unit. In some implementations, various active markers in a scene may emanate different wavelengths of light. For example, wavelengths of light from multi-emitting active marker units may be changed due to various conditions in the scene.
1. A method for detecting one or more active marker units in performance capture associated with a visual production, the method comprising:
providing the one or more active marker units attached to an object in a live action scene, each of the one or more active marker units being configured to emanate at least one wavelength of light in response to signals received from a signal controller;
capturing, by a plurality of sensor devices, a presence of light from the live action scene, wherein the presence of light is captured as a light patch in capture frames produced by the plurality of sensor devices;
generating, by one or more processors, marker data associated with the captured presence of light; and
determining, by the one or more processors, that the light patch represents at least one of the one or more active marker units, based on the marker data meeting criteria, including:
the capture frames correspond with predefined frames in a block of time expected to include the at least one wavelength of light emanating from the active marker units, and
the light patch meets a trigger threshold including one or more of: a threshold size of the light patch, or an intensity threshold of the light patch compared to a pixel area proximal to the light patch.
2. The method of claim 1 , wherein the one or more active marker units include a first active marker unit that emanates a first wavelength of light and a second active marker unit that emanates a second wavelength of light that is different from the first wavelength of light.
3. The method of claim 2 , wherein a first sensor device of the plurality of sensor devices captures the first wavelength of light and a second sensor device of the plurality of sensor devices captures the second wavelength of light.
4. The method of claim 1 , wherein at least one active marker unit of the one or more active marker units is configured to emanate a first wavelength of light at a first time period and emanate a second wavelength of light at a second time period.
5. The method of claim 4 , further comprising:
determining target light parameters suitable for a current condition; and
adjusting a function of the at least one active marker unit according to the target light parameters, including changing the wavelength of light emanating from the at least one active marker unit.
6. The method of claim 1 , wherein at least one multi-emitting active marker unit of the one or more active marker units simultaneously emanates a first wavelength of light and a second wavelength of light.
7. The method of claim 1 , further comprising:
adjusting at least one parameter of the plurality of sensor devices to fix on the light patch, including adjusting one or more of: aperture, contrast, focus, or exposure; and
masking the pixel area surrounding the light patch to exclude interfering light.
8. The method of claim 1 , wherein the criteria further includes verification that the light patch is captured by at least two sensor devices of the plurality of sensor devices during the block of time.
9. A non-transitory computer-readable storage medium carrying program instructions thereon to detect one or more active marker units in attached to an object in a live action scene of a visual production, each of the one or more active marker units being configured to emanate at least one wavelength of light in response to signals received from a signal controller, the instructions when executed by one or more processors cause the one or more processors to perform operations comprising:
generating marker data associated with a presence of light captured from a live action scene, wherein the presence of light is captured as a light patch in capture frames produced by a plurality of sensor devices; and
determining that the light patch represents at least one of the one or more active marker units attached to an object in a live action scene, each of the one or more active marker units being configured to emanate at least one wavelength of light in response to signals received from a signal controller, wherein the determination is based on the marker data meeting criteria, including:
the capture frames correspond with predefined frames in a block of time expected to include the at least one wavelength of light emanating from the active marker units, and
the light patch meets a trigger threshold including one or more of: a threshold size of the light patch, or an intensity threshold of the light patch compared to a pixel area proximal to the light patch.
10. The computer-readable storage medium of claim 9 ,
wherein the marker data includes first marker data associated with a first wavelength of light emanating at a first time period from at least one multi-emitting active marker unit of the one or more active marker units and a second wavelength of light that is different from the first wavelength of light, emanating from the at least one multi-emitting active marker unit at a second time period.
11. The computer-readable storage medium of claim 9 , the operations further comprise:
determining target light parameters suitable for a current condition; and
adjusting a function of the at least one active marker unit according to the target light parameters, including changing the wavelength of light emanating by the at least one active marker unit.
12. The computer-readable storage medium of claim 9 , wherein the marker data is associated with a first wavelength of light and a second wavelength of light simultaneously emanating from a first active marker unit.
13. The computer-readable storage medium of claim 9 , wherein the operations further comprise:
adjusting at least one parameter of the plurality of sensor devices to fix on the light patch, including adjusting one or more of: aperture, contrast, focus, or exposure; and
masking the pixel area surrounding the light patch to exclude interfering light.
14. The computer-readable storage medium of claim 9 , wherein the criteria further includes verification that the light patch is captured by at least two sensor devices of the plurality of sensor devices during the block of time.
15. A system to detect an active marker unit in performance capture associated with a visual production, the system comprising:
one or more active marker units in attached to an object in a live action scene of a visual production, each of the one or more active marker units being configured to emanate at least one wavelength of light in response to signals received from a signal controller;
a plurality of sensor devices of a performance capture system, configured to capture a presence of light from the live action scene, wherein the presence of light is captured as a light patch in capture frames produced by the plurality of sensor devices; a computer device comprising:
one or more processors; and
one or more non-transitory computer-readable media with logic encoded thereon, the one or more processors executing the logic to perform operations comprising:
generating, by one or more processors, marker data associated with the captured presence of light; and
determining, by the one or more processors, that the light patch represents at least one of the one or more active marker units, based on the marker data meeting criteria, including:
the capture frames correspond with predefined frames in a block of time expected to include the at least one wavelength of light emanating from the active marker units, and
the light patch meets a trigger threshold including one or more of: a threshold size of the light patch, or an intensity threshold of the light patch compared to a pixel area proximal to the light patch.
16. The system of claim 15 , wherein the one or more active marker units include a first active marker unit that emanates a first wavelength of light and a second active marker unit that emanates a second wavelength of light that is different from the first wavelength of light.
17. The system of claim 15 , wherein at least one multi-emitting active marker unit of the one or more active marker units is configured to emanate a first wavelength of light at a first time period and emanate a second wavelength of light at a second time period.
18. The system of claim 15 , wherein at least one multi-emitting active marker unit of the one or more active marker units simultaneously emanates a first wavelength of light and a second wavelength of light.
19. The system of claim 15 , wherein the operations further comprise:
adjusting at least one parameter of the plurality of sensor devices to fix on the light patch, including adjusting one or more of: aperture, contrast, focus, or exposure; and
masking a pixel area surrounding the light patch to exclude interfering light.
20. The system of claim 15 , wherein the criteria further includes verification that the light patch is captured by at least two sensor devices of the plurality of sensor devices during the block of time.