IP Library Granted Patent US 10,791,269
Granted Patent B2
US 10,791,269 · App. 15/945,264 · Granted Sep 29, 2020

Operation method and system for camera operation apparatus, and apparatus therefor

Inventors: Min Gyu Lee (Changwon-si, KR); Mee Jee Jeong (Changwon-si, KR); Il Hwang Cha (Changwon-si, KR); Hyun Gyu Lee (Changwon-si, KR)
Assignee: HANWHA TECHWIN CO., LTD.
H04N5/23245A61B5/0402A61B5/746G08B13/19602G08B21/0453G08B25/08H04N5/23219H04N5/23222H04N5/232411A61B5/0022A61B5/0077A61B5/01A61B5/0476A61B5/0488A61B2560/0209
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,791,269
App. No.
15/945,264
Granted
Sep 29, 2020
Kind
B2
Abstract

Provided are an operation method for a camera operation apparatus, the method including the steps of: obtaining a bio-signal of a user from a wearable sensor; determining, based on the bio-signal, whether a state of a user is a stable state; setting the camera to a low power mode if the state of the user is a stable state; determining the type of bio-signal if the state of the user is not a stable state; and setting the camera to a mode in accordance with the type of the bio-signal.

Claims (39)

1. A method of operating a camera operating apparatus, the method comprising:

obtaining a bio-signal of a user from a wearable sensor;

determining, based on the bio-signal, whether the user is in a stable state;

when the user is in the stable state, transmitting a first driving signal to a camera that is separately provided from the camera operating apparatus and the wearable sensor, to set the camera to a low-power mode so that the camera is enabled to capture an image the user in the low-power mode;

when the user is not in the stable state, determining a type of the bio-signal, and transmitting a second driving signal to the camera to set the camera to a non-low-power mode according to the type of the bio-signal so that the camera is enabled to capture the image of the user in the non-low power mode.

2. The method of claim 1 , wherein the determining of whether the user is in the stable state comprises, when a value measured by an electrocardiogram (ECG) sensor in the wearable sensor is within a reference ECG range set in advance and a value measured by a temperature sensor in the wearable sensor is within a reference temperature range set in advance, determining that the user is in stable state.

3. The method of claim 1 , wherein the camera is provided in an external environment outside a wearable device comprising the wearable sensor.

4. The method of claim 3 , further comprising setting a communication connection between the camera operating apparatus and the camera.

5. The method of claim 1 ,

wherein the transmitting the second driving signal to the camera comprises

transmitting the first driving signal to set the camera to one of the non-low-power mode comprising a real-time live mode in which the camera transmits the image of the user to the camera operating apparatus in real time, an action cam mode in which a frame rate of the camera is set to be greater than or equal to a reference frame rate and an image stabilizing function is turned on, and a high-resolution imaging mode in which the frame rate of the camera is set to be greater than or equal to a reference resolution,

wherein the method further comprises storing every frame included in images transmitted from the camera, within a time range corresponding to a time point when it is determined that the user is not in the stable state and when the camera is set to the one of the non-low-power mode.

6. The method of claim 5 , further comprising storing every frame after mapping the bio-signal to each frame, within the time range corresponding to the time point when it is determined that the user is not in the stable state.

7. The method of claim 1 , further comprising, when the camera is set to the low-power mode, storing, according to a frame selecting condition set in advance, only some of a plurality of frames included in images transmitted from the camera.

8. The method of claim 1 , further comprising transmitting a feedback signal to the wearable sensor, based on an operation result of the camera.

9. A method of operating a camera operating apparatus, the method comprising:

obtaining a bio-signal of a user from a wearable sensor;

determining, based on the bio-signal, whether the user is in a stable state;

when the user is in the stable state, setting a camera to a low-power mode;

when the user is not in the stable state, determining a type of the bio-signal; and

setting the camera to a mode according to the type of the bio-signal,

wherein the setting of the low-power mode comprises setting a frame rate of the camera to be equal to or less than a reference frame rate set in advance, and turning off an image stabilizing function of the camera.

10. The method of claim 9 , wherein the camera is a wearable camera provided on a body of the user.

11. A camera operating apparatus comprising:

a communication interface configured to obtain a bio-signal of a user from a wearable sensor; and

at least one processor configured to implement:

a user condition determiner configured to determine, based on the bio-signal, whether the user is in a stable state;

a bio-signal type determiner configured to determine a type of the bio-signal, when the user is not in the stable state; and

a camera mode setting unit configured to

control the communication interface to transmit a first driving signal to a camera, that is provided separately from the camera operating apparatus and the wearable sensor, to set the camera to a low-power mode when the user is in the stable state so that the camera is enabled to capture an image of the user in the low-power mode, and

control the communication interface to transmit a second driving signal to the camera to set the camera to a non-low-power mode according to the type of the bio-signal when the user is not in the stable state so that the camera is enabled to capture the image of the user in the non-low power mode.

12. The camera operating apparatus of claim 11 , wherein the wearable sensor comprises an electroencephalography (EEG) sensor, an electromyography (EMG) sensor, an electrocardiogram (ECG) sensor, and a temperature sensor.

13. The camera operating apparatus of claim 11 , further comprising a feedback signal transmitter configured to transmit a feedback signal to the wearable sensor based on an operating result of the camera.

14. The camera operating apparatus of claim 11 , wherein the camera is provided in an external environment outside a wearable device comprising the wearable sensor.

15. The camera operating apparatus of claim 11 , wherein the communication interface is further configured to establish a communication connection between the camera operating apparatus and the camera.

16. A camera operating system comprising:

at least one wearable sensor comprising at least one of an electroencephalography (EEG) sensor, an electromyography (EMG) sensor, an electrocardiogram (ECG) sensor, and a temperature sensor to obtain a bio-signal of a user;

a camera provided separately from the camera operating system and the at least one wearable sensor, and configured to capture images of the user; and

at least one processor configured to obtain the bio-signal, to determine a condition of the user based on the bio-signal, and to transmit a driving signal to the camera to set a power mode of the camera based on the condition of the user.

Assignments (5)
CHANGE OF NAME Recorded Aug 10, 2023
From: HANWHA TECHWIN CO., LTD.
To: HANWHA VISION CO., LTD.
Reel/Frame 064549/0075 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2019
From: HANWHA AEROSPACE CO., LTD.
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 049013/0723 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NUMBER 10/853,669. IN ADDITION PLEASE SEE EXHIBIT A PREVIOUSLY RECORDED ON REEL 046927 FRAME 0019. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Jan 17, 2019
From: HANWHA TECHWIN CO., LTD.
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 048496/0596 →
CHANGE OF NAME Recorded Aug 24, 2018
From: HANWHA TECHWIN CO., LTD
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 046927/0019 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2018
From: LEE, MIN GYU; JEONG, MEE JEE; CHA, IL HWANG; LEE, HYUN GYU
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 045436/0557 →
Priority Claims (1)
KR 10-2016-0014722 · Feb 5, 2016 · national
Continuity (2)
Continuation PCTKR2016009290 · Aug 23, 2016
Related Publication 20180227491A1 · Aug 9, 2018