IP Library Granted Patent US 10,274,129
Granted Patent B2
US 10,274,129 · App. 15/841,555 · Granted Apr 30, 2019

Camera system using stabilizing gimbal

Inventors: Noriaki Saika (Foster City, CA); Ryan Harrison (Walpole, NH); Joshua Todd Druker (Redwood City, CA); Himay Rashmikant Shukla (San Mateo, CA); Nenad Uzunovic (San Mateo, CA); Edward Gordon Russell (Pacifica, CA)
Assignee: GoPro, Inc.
F16M13/02B64C39/024B64D47/08F16M11/041F16M11/121F16M11/18F16M13/04G03B15/006G03B17/561G05D1/0094H04N5/2251H04N5/2328H04N7/183B64C2201/127H04N5/23203H04N5/23258H04N5/772H04N5/783H04N9/8205
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,274,129
App. No.
15/841,555
Granted
Apr 30, 2019
Kind
B2
Abstract

Disclosed is an electronic gimbal with camera and mounting configuration. The gimbal can include an inertial measurement unit which can sense the orientation of the camera and three electronic motors which can manipulate the orientation of the camera. The gimbal can be removably coupled to a variety of mount platforms, such as an aerial vehicle, a handheld grip, or a rotating platform. Moreover, a camera can be removably coupled to the gimbal and can be held in a removable camera frame. Also disclosed is a system for allowing the platform, to which the gimbal is mounted, to control settings of the camera or to trigger actions on the camera, such as taking a picture, or initiating the recording of a video. The gimbal can also provide a connection between the camera and the mount platform, such that the mount platform receives images and video content from the camera.

Claims (88)

1. A method, comprising:

detecting a first angular position of an object relative to an orientation of a camera coupled to a gimbal, the gimbal coupled to a rotating platform; and

controlling any of a motor of the rotating platform; and a motor of the gimbal by:

determining a target change in angular velocity representing a difference between an angular velocity of the camera and a target angular velocity of the camera suitable for tracking the object;

comparing the target change in angular velocity to a threshold change in angular velocity;

responsive to the target change in angular velocity exceeding the threshold change in angular velocity, adjusting an angular velocity of the motor of the rotating platform to reduce the difference between the angular velocity of the camera and the target angular velocity of the camera; and

responsive to the target change in angular velocity not exceeding the threshold change in angular velocity, adjusting an angular velocity of the motor of the gimbal to reduce the difference between the angular velocity of the camera and the target angular velocity of the camera.

2. The method of claim 1 , wherein controlling any of the motor of the rotating platform; and the motor of the gimbal comprises:

determining a target angular velocity for moving the camera to track the object based on an angular velocity of the object and a displacement between the orientation of the camera and the first angular position of the object;

determining if the target angular velocity is below a threshold angular velocity;

responsive to determining that the target angular velocity is not below the threshold angular velocity, controlling the motor of the rotating platform to adjust an angular velocity of the rotating platform to reduce an offset between the angular velocity of the rotating platform and the target angular velocity;

responsive to determining that the target angular velocity is below the threshold angular velocity, determining if the rotating platform is stationary;

responsive to determining that the rotating platform is stationary, controlling the motor of the gimbal to adjust an angular velocity of the motor of the gimbal to reduce an offset between the angular velocity of the motor of the gimbal and the target angular velocity; and

responsive to determining that the rotating platform is not stationary, decelerating the rotating platform and adjusting the angular velocity of the motor of the gimbal to reduce the offset between the angular velocity of the motor of the gimbal and the target angular velocity.

3. The method of claim 1 , wherein controlling any of the motor of the rotating platform and the motor of the gimbal comprises:

determining a target change in angular velocity representing a difference between an angular velocity of the camera and a target angular velocity of the camera suitable for tracking the object;

summing an angular velocity of the motor of the gimbal and the target change in angular velocity to generate a combined angular velocity;

comparing the combined angular velocity to a threshold change in angular velocity;

responsive to the combined angular velocity exceeding the threshold change in angular velocity, adjusting an angular velocity of the motor of the rotating platform to reduce the difference between the angular velocity of the camera and the target angular velocity of the camera; and

responsive to the combined angular velocity not exceeding the threshold change in angular velocity, adjusting an angular velocity of the motor of the gimbal to reduce the difference between the angular velocity of the camera and the target angular velocity of the camera.

4. The method of claim 1 , wherein controlling any of the motor of the rotating platform and the motor of the gimbal comprises:

detecting a second angular position of the object relative to the orientation of the camera, the first angular position detected at a first time instance and the second angular position detected at a second time instance;

calculating an angular velocity of the object based on at least the first and second angular positions and at least the first and second time instances;

adjusting an angular velocity of the motor of the rotating platform to reduce a difference between an angular velocity of the rotating platform and the angular velocity of the object; and

determining a target angular position of the motor of the gimbal based on an angular position of the motor of the gimbal, the second angular position of the object, and an angular position of the camera;

adjusting the angular position of the motor of the gimbal to reduce a difference between the angular position of the motor of the gimbal and the target angular position.

5. A non-transitory computer-readable storage medium storing instructions that when executed cause a processor to perform operations including:

detecting a first angular position of an object relative to an orientation of a camera coupled to a gimbal, the gimbal coupled to a rotating platform; and

controlling any of a motor of the rotating platform and a motor of the gimbal by:

determining a target change in angular velocity representing a difference between an angular velocity of the camera and a target angular velocity of the camera suitable for tracking the object;

comparing the target change in angular velocity to a threshold change in angular velocity;

responsive to the target change in angular velocity exceeding the threshold change in angular velocity, adjusting an angular velocity of the motor of the rotating platform to reduce the difference between the angular velocity of the camera and the target angular velocity of the camera; and

responsive to the target change in angular velocity not exceeding the threshold change in angular velocity, adjusting an angular velocity of the motor of the gimbal to reduce the difference between the angular velocity of the camera and the target angular velocity of the camera.

6. The non-transitory computer-readable storage medium of claim 5 , wherein controlling any of the motor of the rotating platform and the motor of the gimbal comprises:

determining a target angular velocity for moving the camera to track the object based on an angular velocity of the object and a displacement between the orientation of the camera and the first angular position of the object;

determining if the target angular velocity is below a threshold angular velocity;

responsive to determining that the target angular velocity is not below the threshold angular velocity, controlling the motor of the rotating platform to adjust an angular velocity of the rotating platform to reduce an offset between the angular velocity of the rotating platform and the target angular velocity;

responsive to determining that the target angular velocity is below the threshold angular velocity, determining if the rotating platform is stationary;

responsive to determining that the rotating platform is stationary, controlling the motor of the gimbal to adjust an angular velocity of the motor of the gimbal to reduce an offset between the angular velocity of the motor of the gimbal and the target angular velocity; and

responsive to determining that the rotating platform is not stationary, decelerating the rotating platform and adjusting the angular velocity of the motor of the gimbal to reduce the offset between the angular velocity of the motor of the gimbal and the target angular velocity.

7. The non-transitory computer-readable storage medium of claim 5 , wherein controlling any of the motor of the rotating platform; and the motor of the gimbal comprises:

determining a target change in angular velocity representing a difference between an angular velocity of the camera and a target angular velocity of the camera suitable for tracking the object;

summing an angular velocity of the motor of the gimbal and the target change in angular velocity to generate a combined angular velocity;

comparing the combined angular velocity to a threshold change in angular velocity;

responsive to the combined angular velocity exceeding the threshold change in angular velocity, adjusting an angular velocity of the motor of the rotating platform to reduce the difference between the angular velocity of the camera and the target angular velocity of the camera; and

responsive to the combined angular velocity not exceeding the threshold change in angular velocity, adjusting an angular velocity of the motor of the gimbal to reduce the difference between the angular velocity of the camera and the target angular velocity of the camera.

8. The non-transitory computer-readable storage medium of claim 5 , wherein controlling any of the motor of the rotating platform and the motor of the gimbal comprises:

detecting a second angular position of the object relative to the orientation of the camera, the first angular position detected at a first time instance and the second angular position detected at a second time instance;

calculating an angular velocity of the object based on at least the first and second angular positions and at least the first and second time instances;

adjusting an angular velocity of the motor of the rotating platform to reduce a difference between an angular velocity of the rotating platform and the angular velocity of the object; and

determining a target angular position of the motor of the gimbal based on an angular position of the motor of the gimbal, the second angular position of the object, and an angular position of the camera;

adjusting the angular position of the motor of the gimbal to reduce a difference between the angular position of the motor of the gimbal and the target angular position.

9. A system, comprising:

a processor; and

a memory coupled to the processor, wherein the memory includes instructions executable by the processor to cause the system to:

detect a first angular position of an object relative to an orientation of a camera coupled to a gimbal, the gimbal coupled to a rotating mount apparatus; and

control any of a motor of the rotating mount apparatus and a motor of the gimbal by:

determining a target change in angular velocity representing a difference between an angular velocity of the camera and a target angular velocity of the camera suitable for tracking the object;

comparing the target change in angular velocity to a threshold change in angular velocity;

responsive to the target change in angular velocity exceeding the threshold change in angular velocity, adjusting an angular velocity of the motor of the rotating platform to reduce the difference between the angular velocity of the camera and the target angular velocity of the camera; and

responsive to the target change in angular velocity not exceeding the threshold change in angular velocity, adjusting an angular velocity of the motor of the gimbal to reduce the difference between the angular velocity of the camera and the target angular velocity of the camera.

10. The system of claim 9 , wherein the rotating mount apparatus comprises:

a gimbal mount including a mechanical coupling for removably coupling to the gimbal, the gimbal mount further including an electronic connection to connect to the gimbal, the electronic connection allowing communication between the rotating mount apparatus and the camera coupled to the gimbal via an electronic bus internal to the gimbal;

a motor shaft connected to the gimbal mount such that rotation of the motor shaft causes the gimbal mount to rotate;

an electric motor coupled to the motor shaft to provide torque on the motor shaft; and

a base coupled to the electric motor.

11. The system of claim 9 , wherein the rotating mount apparatus receives any of a digital video and a digital image from the camera coupled to the gimbal.

12. The system of claim 9 , wherein the rotating mount apparatus sends a set of instructions to the camera via the electronic bus, the set of instructions including any of an instruction to capture a picture and an instruction to begin recording a video.

13. The system of claim 10 , wherein the rotating mount apparatus further comprises a control logic unit, the control logic unit allowing movement of the electric motor in the gimbal to be controlled through the electronic connection.

14. The system of claim 9 , wherein controlling any of the motor of the rotating platform and the motor of the gimbal comprises:

determining a target angular velocity for moving the camera to track the object based on an angular velocity of the object and a displacement between the orientation of the camera and the first angular position of the object;

determining if the target angular velocity is below a threshold angular velocity;

responsive to determining that the target angular velocity is not below the threshold angular velocity, controlling the motor of the rotating platform to adjust an angular velocity of the rotating platform to reduce an offset between the angular velocity of the rotating platform and the target angular velocity;

responsive to determining that the target angular velocity is below the threshold angular velocity, determining if the rotating platform is stationary;

responsive to determining that the rotating platform is stationary, controlling the motor of the gimbal to adjust an angular velocity of the motor of the gimbal to reduce an offset between the angular velocity of the motor of the gimbal and the target angular velocity; and

responsive to determining that the rotating platform is not stationary, decelerating the rotating platform and adjusting the angular velocity of the motor of the gimbal to reduce the offset between the angular velocity of the motor of the gimbal and the target angular velocity.

15. The system of claim 9 , wherein controlling any of the motor of the rotating platform and the motor of the gimbal comprises:

determining a target change in angular velocity representing a difference between an angular velocity of the camera and a target angular velocity of the camera suitable for tracking the object;

summing an angular velocity of the motor of the gimbal and the target change in angular velocity to generate a combined angular velocity;

comparing the combined angular velocity to a threshold change in angular velocity;

responsive to the combined angular velocity exceeding the threshold change in angular velocity, adjusting an angular velocity of the motor of the rotating platform to reduce the difference between the angular velocity of the camera and the target angular velocity of the camera; and

responsive to the combined angular velocity not exceeding the threshold change in angular velocity, adjusting an angular velocity of the motor of the gimbal to reduce the difference between the angular velocity of the camera and the target angular velocity of the camera.

16. The system of claim 9 , wherein controlling any of the motor of the rotating platform and the motor of the gimbal comprises:

detecting a second angular position of the object relative to the orientation of the camera, the first angular position detected at a first time instance and the second angular position detected at a second time instance;

calculating an angular velocity of the object based on at least the first and second angular positions and at least the first and second time instances;

adjusting an angular velocity of the motor of the rotating platform to reduce a difference between an angular velocity of the rotating platform and the angular velocity of the object; and

determining a target angular position of the motor of the gimbal based on an angular position of the motor of the gimbal, the second angular position of the object, and an angular position of the camera;

adjusting the angular position of the motor of the gimbal to reduce a difference between the angular position of the motor of the gimbal and the target angular position.

Assignments (6)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Oct 19, 2020
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054113/0594 →
SECURITY INTEREST Recorded Jun 7, 2018
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 047140/0831 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 31, 2018
From: SAIKA, NORIAKI; HARRISON, RYAN; DRUKER, JOSHUA TODD; SHUKLA, HIMAY RASHMIKANT; UZUNOVIC, NENAD; RUSSELL, EDWARD GORDON; FONG, GARY
To: GOPRO, INC.
Reel/Frame 044782/0098 →
Continuity (5)
Continuation 15307331
Provisional Application 62302170 · Mar 2, 2016
Provisional Application 62249879 · Nov 2, 2015
Provisional Application 62167241 · May 27, 2015
Related Publication 20180106422A1 · Apr 19, 2018
Cited By (8)
US 1,139,557 US 12,203,592 US 12,206,990 US 12,425,739 US 12,479,596 US 12,546,598 US 12,556,820 US 12,604,137