IP Library Granted Patent US 10,157,227
Granted Patent B2
US 10,157,227 · App. 14/931,222 · Granted Dec 18, 2018

Apparatus and method for generating a summary image by image processing

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,157,227
App. No.
14/931,222
Granted
Dec 18, 2018
Kind
B2
Abstract

Provided is an image processing apparatus including at least one processor configured to implement: an image processing unit which receives at least one image captured by at least one camera, analyzing the captured image, and generates a summary image related to occurrence of an event among the captured image; and a controller which controls the image processor to generate the summary image in response to at least one of a user request received from a user terminal and a predetermined condition being satisfied.

Claims (59)

1. An image processing apparatus comprising:

an image processor which receives at least one image captured by at least one camera, analyzes the at least one captured image, and generates a summary image related to occurrence of an event among the at least one captured image, wherein the generating the summary image comprises extracting at least one image frame from the at least one captured image, arranging the at least one image frame by time, and compressing the at least one image frame into one image frame;

a control processor which controls the image processor to generate the summary image in response to at least one of a user request being received from a user terminal and a predetermined condition being satisfied;

an authentication processor which registers face information of a user, and performs user authentication through the user terminal; and

an image storage which stores object information extracted from the at least one captured image to recognize a face,

wherein the control processor selectively operates in one of a video summary mode and a privacy masking mode depending on results of the user authentication and the recognizing the face,

wherein the control processor, in the video summary mode, controls the image processor to, in response to the user request including a user identification of the user, generate, based on the stored object information, the summary image that includes the registered face information of the user, and

wherein the control processor, in the privacy masking mode, performs at least one of replacing the at least one captured image with a replacement image and scrambling the at least one captured image, after the user authentication is successful.

2. The image processing apparatus of claim 1 , wherein the authentication processor searches for the user terminal through wireless communication to perform pairing with the user terminal, and performs the user authentication through the user terminal.

3. The image processing apparatus of claim 2 , wherein the control processor prevents transmission of the at least one captured image to one of the user terminal and a display unit after the user authentication is successful.

4. The image processing apparatus of claim 2 , wherein the control processor controls the image processor to generate the summary image in response to the user request,

wherein the user request comprises an indication of a predetermined image or audio information, and

wherein the summary image comprises an image corresponding to the predetermined image or audio information.

5. The image processing apparatus of claim 4 , wherein the control processor transmits the summary image to the user terminal which is a mobile device.

6. The image processing apparatus of claim 5 , wherein the control processor receives a control signal from the user terminal to control the image processor to generate the summary image, and, according to the control signal, transmits the summary image to the user terminal.

7. The image processing apparatus of claim 1 , wherein the image processor stores the at least one captured image, the summary image, an event condition for triggering the occurrence of the event, audio information related to the occurrence of the event, and reference audio information to be compared with the audio information to determine the occurrence of the event.

8. The image processing apparatus of claim 1 , wherein the control processor controls the image processor to generate the summary image in response to the predetermined condition being satisfied without the user request, and

wherein the predetermined condition comprises at least one of appearance of an object, a change in color in the at least one captured image, sensing a motion of the object, and arrival at a predetermined time.

9. The image processing apparatus of claim 8 , wherein the control processor transmits the summary image to the user terminal which is a mobile device.

10. The image processing apparatus of claim 9 , wherein the control processor receives a control signal from the user terminal to control the image processor to generate the summary image, and, according to the control signal, transmits the summary image to the user terminal.

11. The image processing apparatus of claim 1 , wherein the control processor controls the at least one camera to stop capturing the at least one image after the user authentication is successful.

12. The image processing apparatus of claim 1 , wherein the control processor outputs an event notice to the user terminal if the user terminal is sensed within a predetermined distance.

13. The image processing apparatus of claim 1 , wherein the control processor controls the image processor to generate the summary image in response to the user request,

wherein the authentication processor registers information about a predetermined object received from the user terminal, and

wherein the control processor recognizes the predetermined object from the at least one captured image and controls the image processor to generate the summary image related to the occurrence of the event and the predetermined object in response to the user request.

14. The image processing apparatus of claim 1 , wherein the control processor operates in the video summary mode in response to the user authentication being successful.

15. The image processing apparatus of claim 1 , wherein the control processor operates in the privacy masking mode in response to the user authentication being successful and the face being recognized.

16. A method of image processing using at least one processor, the method comprising:

receiving at least one image captured by at least one camera;

in response to at least one of a user request received from a user terminal, generating a summary image related to occurrence of an event among the at least one captured image by extracting at least one image frame from the at least one captured image, arranging the at least one image frame by time, and compressing the at least one image frame into one image frame;

registering face information of a user;

extracting object information from the at least one captured image to recognize a face and storing the object information;

performing user authentication through the user terminal; and

selectively operating in one of a video summary mode and a privacy masking mode depending on results of the user authentication and the recognizing the face,

wherein, in the video summary mode, the generating the summary image comprises, in response to the user request including a user identification of the user, generating, based on the stored object information, the summary image that includes the registered face information of the user, and

wherein, in the privacy masking mode, after the user authentication is successful, performing at least one of replacing the at least one captured image with a replacement image and scrambling the at least one captured image.

17. The method of claim 16 , further comprising preventing transmission of the at least one captured image to one of the user terminal and a display unit after the user authentication is successful.

18. The method of claim 16 , wherein the summary image is generated in response to the user request,

wherein the user request comprises an indication of a predetermined image or audio information, and

wherein the summary image comprises an image corresponding to the predetermined image or audio information.

19. The method of claim 18 , further comprising:

receiving a control signal from the user terminal, which is a mobile device, to generate the summary image; and

according to the control signal, transmitting the summary image to one of the user terminal and a display unit.

20. The method of claim 16 , wherein the summary image is generated in response to a predetermined condition being satisfied without the user request, and

wherein the predetermined condition comprises at least one of appearance of an object, a change in color in the at least one captured image, sensing a motion of the object, and arrival at a predetermined time.

21. The method of claim 16 , further comprising: receiving a control signal from the user terminal, which is a mobile device, to generate the summary image; and

according to the control signal, transmitting the summary image to one of the user terminal and a display unit.

22. The method of claim 16 , wherein the video summary mode is selected in response to the user authentication being successful.

23. The method of claim 16 , wherein the privacy masking mode is selected in response to the user authentication being successful and the face being recognized.

24. A method of image processing using at least one processor, the method comprising:

receiving at least one image captured by at least one camera;

registering face information of a user;

extracting object information from the at least one captured image to recognize a face and storing the object information;

performing user authentication through the user terminal;

selectively operating in one of a video summary mode and a privacy masking mode depending on results of the user authentication and the recognizing the face; and

in the video summary mode, in response to a user request for an image of a non-registered object, generating, based on the stored object information, a summary image that includes the non-registered object by extracting at least one image frame from the at least one captured image including the object information, arranging the at least one image frame by time, and compressing the at least one image frame into one image frame,

wherein, in the privacy masking mode, after the user authentication is successful, performing at least one of replacing the at least one captured image with a replacement image and scrambling the at least one captured image.

25. The method of claim 24 , wherein the video summary mode is selected in response to the user authentication being successful.

26. The method of claim 24 , wherein the privacy masking mode is selected in response to the user authentication being successful and the face being recognized.

Assignments (5)
CHANGE OF NAME Recorded Aug 10, 2023
From: HANWHA TECHWIN CO., LTD.
To: HANWHA VISION CO., LTD.
Reel/Frame 064549/0075 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2019
From: HANWHA AEROSPACE CO., LTD.
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 049013/0723 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NUMBER 10/853,669. IN ADDITION PLEASE SEE EXHIBIT A PREVIOUSLY RECORDED ON REEL 046927 FRAME 0019. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Jan 17, 2019
From: HANWHA TECHWIN CO., LTD.
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 048496/0596 →
CHANGE OF NAME Recorded Aug 24, 2018
From: HANWHA TECHWIN CO., LTD
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 046927/0019 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 3, 2015
From: CHO, SUNGBONG; PARK, JEONGWOONG
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 036950/0146 →