System and method of dynamic, natural camera transitions in an electronic camera
Scene changes that are done pleasingly and without user input or control. Based on the number of speakers and changes in speakers, either to a different individual or movement by the same speaker, based on the locations of the speakers and based on the overlap of the current and intended scenes, a decision is made whether to perform a smooth transition or do a cut. It has been determined that the decision on cut versus smooth transition is preferably based on the location of the center of the intended new scene versus the boundaries of the current scene, a cut used if the center is outside the boundaries and a smooth transition if inside. If a smooth transition, an easing function, such as ease in ease out, is performed to change the scene. A preferred value for the smooth transition is to perform the transition over 80 frames.
1. A method for operating a videoconferencing device for transitioning between scenes of a room captured by an electronic pan, tilt and zoom (EPTZ) camera with a view of the room and to be transmitted over a network in a videoconference, the method comprising:
determining a number of speakers in the room;
determining positions of any speakers in the room;
based on the determined positions of speakers in the room, determine a need to transition a present scene to a new scene;
based on the determined number of speakers in the room, the determined positions of speakers in the room and the need to transition to a new scene, determine if the transition should be smooth or a cut;
performing the transition to the new scene based on the smooth or cut determination; and
transmitting the new scene to another videoconferencing device for display,
wherein the smooth or cut determination is smooth, and
wherein the transition is performed using an easing function.
2. The method of claim 1 , wherein the easing function is ease in ease out.
3. The method of claim 1 , wherein the easing function is performed over a range of 60 to 100 frames at 30 frames per second.
4. The method of claim 3 , wherein the easing function is performed over 80 frames at 30 frames per second.
5. The method of claim 1 , wherein it is determined that there is one speaker,
wherein it is determined that the speaker is a different speaker or in a different location,
wherein it is determined to transition to a new scene, and
wherein the determination if the transition should be smooth or a cut is based on determining if the center of the new scene is within boundaries of the present scene, smooth being used if the center of the new scene is within boundaries of the present scene and cut being used if the center of the new scene is not within boundaries of the present scene.
6. The method of claim 1 , wherein it is determined that there are two speakers,
wherein it is determined that a speaker is a different speaker or in a different location,
wherein it is determined to transition to a new scene,
wherein the determination if the transition should be smooth or a cut is based on determining if the two speakers are close, smooth being used if the speakers are close and cut if the speakers are not close,
wherein a smooth transition results in a scene with a camera view being in the center of the two speakers, and
wherein a cut transition results in a split screen scene of the two speakers, with looking space added to the split screen if the speakers are facing each other.
7. A non-transitory program storage device, readable by one or more processors in a videoconferencing device and comprising instructions stored thereon to cause the one or more processors to perform a method for operating the videoconferencing device for transitioning between scenes of a room captured by an electronic pan, tilt and zoom (EPTZ) camera with a view of the room and to be transmitted over a network in a videoconference, the method comprising the steps of:
determining a number of speakers in the room;
determining positions of any speakers in the room;
based on the determined positions of speakers in the room, determining a need to transition a present scene to a new scene;
based on the determined number of speakers in the room, the determined positions of speakers in the room and the need to transition to a new scene, determining if the transition should be smooth or a cut;
performing the transition to the new scene based on the smooth or cut determination; and
transmitting the new scene to another videoconferencing device for display,
wherein the smooth or cut determination is smooth, and
wherein the transition is performed using an easing function.
8. The non-transitory program storage device of claim 7 , wherein the easing function is ease in ease out.
9. The non-transitory program storage device of claim 7 , wherein the easing function is performed over a range of 60 to 100 frames at 30 frames per second.
10. The non-transitory program storage device of claim 9 , wherein the easing function is performed over 80 frames at 30 frames per second.
11. The non-transitory program storage device of claim 7 , wherein it is determined that there is one speaker,
wherein it is determined that the speaker is a different speaker or in a different location,
wherein it is determined to transition to a new scene, and
wherein the determination if the transition should be smooth or a cut is based on determining if the center of the new scene is within boundaries of the present scene, smooth being used if the center of the new scene is within boundaries of the present scene and cut being used if the center of the new scene is not within boundaries of the present scene.
12. The non-transitory program storage device of claim 7 , wherein it is determined that there are two speakers,
wherein it is determined that a speaker is a different speaker or in a different location,
wherein it is determined to transition to a new scene,
wherein the determination if the transition should be smooth or a cut is based on determining if the two speakers are close, smooth being used if the speakers are close and cut if the speakers are not close,
wherein a smooth transition results in a scene with a camera view being in the center of the two speakers, and
wherein a cut transition results in a split screen scene of the two speakers, with looking space added to the split screen if the speakers are facing each other.
13. A videoconferencing device for transitioning between scenes of a room captured by an electronic pan, tilt and zoom (EPTZ) camera with a view of the room and to be transmitted over a network in a videoconference, the videoconferencing device comprising:
an EPTZ camera for providing a view of the room and having an output;
a microphone providing an output for allowing determination of speaker location;
a network interface for interacting with another videoconferencing device;
a processor coupled to the network interface, the EPTZ camera and the microphone and receiving the output from each; and
a memory coupled to the processor and including programs that when executed cause the processor to perform a method of operating the videoconferencing device for transitioning between scenes of a room to be transmitted over a network in a videoconference, the method comprising the steps of:
determining a number of speakers in the room;
determining positions of any speakers in the room;
based on the determined positions of speakers in the room, determining a need to transition a present scene to a new scene;
based on the determined number of speakers in the room, the determined positions of speakers in the room and the need to transition to a new scene, determining if the transition should be smooth or a cut;
performing the transition to the new scene based on the smooth or cut determination; and
providing the new scene to the network interface for transmission to the other videoconferencing device for display,
wherein the smooth or cut determination is smooth, and
wherein the transition is performed using an easing function.
14. The videoconferencing device of claim 13 , wherein the easing function is ease in ease out.
15. The videoconferencing device of claim 13 , wherein the easing function is performed over a range of 60 to 100 frames at 30 frames per second.
16. The videoconferencing device of claim 15 , wherein the easing function is performed over 80 frames at 30 frames per second.
17. The videoconferencing device of claim 13 , wherein it is determined that there is one speaker,
wherein it is determined that the speaker is a different speaker or in a different location,
wherein it is determined to transition to a new scene, and
wherein the determination if the transition should be smooth or a cut is based on determining if the center of the new scene is within boundaries of the present scene, smooth being used if the center of the new scene is within boundaries of the present scene and cut being used if the center of the new scene is not within boundaries of the present scene.
18. The videoconferencing device of claim 13 , wherein it is determined that there are two speakers,
wherein it is determined that a speaker is a different speaker or in a different location,
wherein it is determined to transition to a new scene,
wherein the determination if the transition should be smooth or a cut is based on determining if the two speakers are close, smooth being used if the speakers are close and cut if the speakers are not close,
wherein a smooth transition results in a scene with a camera view being in the center of the two speakers, and
wherein a cut transition results in a split screen scene of the two speakers, with looking space added to the split screen if the speakers are facing each other.