IP Library Granted Patent US 11,367,210
Granted Patent B1
US 11,367,210 · App. 17/525,766 · Granted Jun 21, 2022

Smoothly changing a focus of a camera between multiple target objects

Inventors: Eric S. Hayes (Calgary, CA); Robert S. Hurlburt (Los Angeles, CA); Corey B. Frew (Los Angeles, CA)
Assignee: Unity Technologies SF
G06T7/571G06T15/20H04N5/2226H04N5/23212G06T2207/10028G06T2207/10148
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,367,210
App. No.
17/525,766
Granted
Jun 21, 2022
Kind
B1
Abstract

Disclosed herein is a system to smoothly change the focus of a camera between multiple targets. The system can obtain an indication of a target, an indication of a manner of focus transition between a first target and a second target, and camera settings. The system can determine a point associated with the second target, where the point has a property that focusing the camera on the point places the second target in focus, and the point is closer to the current focus point of the camera than a substantial portion of other points having the property. The system can obtain a nonlinear function indicating a second manner of focus transition between the first target and the second target. The system can change the focus of the camera between the first target and the second target by changing the focus of the camera from the current focus point to the determined point based on the nonlinear function.

Claims (82)

1. A method to change a focus of a computer graphics (CG) camera between multiple target objects, the method comprising:

obtaining an indication of a first target object and a second target object among the multiple target objects, and the CG camera settings,

wherein the CG camera is configured to transition the focus from the first target object to the second target object,

wherein the CG camera settings include a current focus point of the CG camera;

obtaining a nonlinear function indicating a manner of focus transition between the first target object and the second target object; and

changing the focus of the CG camera between the first target object and the second target object based on the nonlinear function.

2. The method of claim 1 , comprising:

determining a point associated with the second target object,

wherein the point has a property that focusing the CG camera on the point causes the second target object to be in focus,

wherein the point associated with the second target object is closer to the current focus point of the CG camera than a substantial portion of other points having the property.

3. The method of claim 2 , comprising determining the point associated with the second target object including:

determining a region of acceptable focus associated with the second target object,

wherein the region of acceptable focus is a region between a nearest object and a farthest object that are in focus in an image formed by the CG camera,

wherein the region of acceptable focus indicates a near distance to the CG camera and a far distance to the CG camera,

wherein when a focus point of the CG camera is between the near distance and the far distance, an object located between the near distance and the far distance is in focus; and

determining the point between the near distance and the far distance substantially closest to the current focus point of the CG camera.

4. The method of claim 2 , comprising:

for a target object among the multiple target objects:

creating a first distance, a second distance, and an exact distance,

wherein the first distance and the second distance indicate region within which a focus point of the CG camera can lie and have the target object in focus,

wherein the exact distance indicates a distance between the current focus point of the CG camera and the target object; and

updating which of the first distance, the second distance, and the exact distance are closest to the current focus point of the CG camera.

5. The method of claim 2 , comprising:

receiving an input indicating a magnitude of contribution of the point to changing the focus of the CG camera,

wherein the magnitude can indicate to partially use the point; and

changing the focus of the CG camera between the first target object and the second target object by changing the focus of the CG camera from the current focus point to the point associated with the second target object, based on the nonlinear function and the magnitude.

6. The method of claim 1 , comprising:

receiving a user input indicating a magnitude of contribution of the nonlinear function to changing the focus of the CG camera,

wherein the magnitude can indicate to partially use the nonlinear function; and

changing the focus of the CG camera between the first target object and the second target object based on the magnitude of contribution of the nonlinear function.

7. The method of claim 1 , wherein the nonlinear function comprises an indication of an animation associated with the manner of focus transition between the first target object and the second target object.

8. The method of claim 1 , comprising:

obtaining the nonlinear function substantially inversely proportional to a distance between the CG camera and the current focus point and indicating the manner of focus transition between the first target object and the second target object.

9. The method of claim 1 , comprising:

obtaining the nonlinear function substantially inversely proportional to a square root of a distance between the CG camera and the current focus point and indicating the manner of focus transition between the first target object and the second target object.

10. At least one computer-readable storage medium carrying instructions, which, when executed by at least one data processor of a system, cause the system to:

obtain an indication of a first target object and a second target object, and camera settings,

wherein a camera is configured to transition a focus from the first target object to the second target object,

wherein the camera settings include a current focus point of the camera;

obtain a nonlinear function indicating a manner of focus transition between the first target object and the second target object; and

change the focus of the camera between the first target object and the second target object based on the nonlinear function.

11. The non-transitory computer-readable storage medium of claim 10 , causing the system to: determine a point associated with the second target object, wherein the point has a property that focusing the camera on the point causes the second target object to be in focus, wherein the point associated with the second target object is closer to the current focus point of the camera than a substantial portion of other points having the property.

12. The non-transitory computer-readable storage medium of claim 11 , causing the system to determine the point associated with the second target object by: determining a region of acceptable focus associated with the second target object, wherein the region of acceptable focus is a region between a nearest object and a farthest object that are in focus in an image formed by the camera,

wherein the region of acceptable focus indicates a near distance to the camera and a far distance to the camera, wherein when a focus point of the camera is between the near distance and the far distance, an object located between the near distance and the far distance is in focus; and determining the point between the near distance and the far distance substantially closest to the current focus point of the camera.

13. The non-transitory computer-readable storage medium of claim 11 , causing the system to: for a target object: create a first distance, a second distance, and an exact distance, wherein the first distance and the second distance indicate region within which a focus point of the camera can lie and have the target object in focus, wherein the exact distance indicates a distance between the current focus point of the camera and the target object; and update which of the first distance, the second distance, and the exact distance are closest to the current focus point of the camera.

14. The non-transitory computer-readable storage medium of claim 11 , causing the system to: receive an input indicating a magnitude of contribution of the point to changing the focus of the camera, wherein the magnitude can indicate to partially use the point; and change the focus of the camera between the first target object and the second target object by changing the focus of the camera from the current focus point to the point associated with the second target object, based on the nonlinear function and the magnitude.

15. The non-transitory computer-readable storage medium of claim 10 , causing the system to: obtain an indication of a physical camera lens; retrieve the nonlinear function representing focus behavior of the physical camera lens; and use the nonlinear function to change the focus of the camera.

16. The non-transitory computer-readable storage medium of claim 10 , causing the system to: receive a user input indicating a magnitude of contribution of the nonlinear function to changing the focus of the camera, wherein the magnitude can indicate to partially use the nonlinear function; and change the focus of the camera between the first target object and the second target object based on the magnitude of contribution of the nonlinear function.

17. The non-transitory computer-readable storage medium of claim 10 , wherein the nonlinear function comprises an indication of an animation associated with the manner of focus transition between the first target object and the second target object.

18. The non-transitory computer-readable storage medium of claim 10 , causing the system to: obtain the nonlinear function substantially inversely proportional to a square root of a distance between the camera and the current focus point and indicating the manner of focus transition between the first target object and the second target object.

19. A system comprising:

at least one hardware processor; and

at least one non-transitory memory storing instructions, which, when executed by the at least one hardware processor, cause the system to:

obtain an indication of a first target object and a second target object, and camera settings,

wherein a camera is configured to transition a focus from the first target object to the second target object,

wherein the camera settings include a current focus point of the camera;

obtain a nonlinear function indicating a manner of focus transition between the first target object and the second target object; and

change the focus of the camera between the first target object and the second target object based on the nonlinear function.

20. The system of claim 19 , comprising instructions to:

determine a point associated with the second target object,

wherein the point has a property that focusing the camera on the point causes the second target object to be in focus,

wherein the point associated with the second target object is closer to the current focus point of the camera than a substantial portion of other points having the property.

21. The system of claim 20 , comprising instructions to determine the point associated with the second target object by:

determining a region of acceptable focus associated with the second target object,

wherein the region of acceptable focus is a region between a nearest object and a farthest object that are in focus in an image formed by the camera,

wherein the region of acceptable focus indicates a near distance to the camera and a far distance to the camera,

wherein when a focus point of the camera is between the near distance and the far distance, an object located between the near distance and the far distance is in focus; and

determining the point between the near distance and the far distance substantially closest to the current focus point of the camera.

22. The system of claim 20 , comprising instructions to: for a target object: create a first distance, a second distance, and an exact distance, wherein the first distance and the second distance indicate region within which a focus point of the camera can lie and have the target object in focus, wherein the exact distance indicates a distance between the current focus point of the camera and the target object; and update which of the first distance, the second distance, and the exact distance are closest to the current focus point of the camera.

23. The system of claim 20 , comprising instructions to:

receive an input indicating a magnitude of contribution of the point to changing the focus of the camera,

wherein the magnitude can indicate to partially use the point; and

change the focus of the camera between the first target object and the second target object by changing the focus of the camera from the current focus point to the point associated with the second target object, based on the nonlinear function and the magnitude.

24. The system of claim 19 , comprising instructions to:

obtain an indication of a physical camera lens;

retrieve the nonlinear function representing focus behavior of the physical camera lens; and

use the nonlinear function to change the focus of the camera.

25. The system of claim 19 , wherein the nonlinear function comprises an indication of an animation associated with the manner of focus transition between the first target object and the second target object.

26. The system of claim 19 , comprising instructions to:

obtain the nonlinear function substantially inversely proportional to a distance between the camera and the current focus point and indicating the manner of focus transition between the first target object and the second target object.

27. The system of claim 19 , comprising instructions to:

obtain the nonlinear function substantially inversely proportional to a square root of a distance between the camera and the current focus point and indicating the manner of focus transition between the first target object and the second target object.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 6, 2023
From: HAYES, ERIC S.; HURLBURT, ROBERT S.; FREW, COREY B.
To: WETA DIGITAL LIMITED
Reel/Frame 063869/0379 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 9, 2022
From: UNITY SOFTWARE INC.
To: UNITY TECHNOLOGIES SF
Reel/Frame 058980/0369 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 8, 2022
From: WETA DIGITAL LIMITED
To: UNITY SOFTWARE INC.
Reel/Frame 058978/0905 →
Continuity (2)
Continuation 17378489 · Jul 16, 2021
Provisional Application 63222287 · Jul 15, 2021