IP Library Granted Patent US 12,520,043
Granted Patent B2
US 12,520,043 · App. 17/888,950 · Granted Jan 6, 2026

Method for optimizing privacy mask of camera with panning and tilting control and imaging device with privacy mask optimization applied

Inventors: Jong In Park (Seongnam-si, KR); Jung Suk Oh (Seongnam-si, KR); Dae Bong Kim (Seongnam-si, KR)
Assignee: HANWHA TECHWIN CO., LTD.
H04N23/69G01C1/00G01C19/04G06T7/20G06T7/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,520,043
App. No.
17/888,950
Granted
Jan 6, 2026
Kind
B2
Abstract

A method of creating a privacy mask from an image imaged by an imaging device in which a rotation axis of a camera and a center of a lens do not match includes measuring a distance from the camera to an object in a first imaging condition; creating a first mask for the object, and storing the distance together with the first mask; and creating a second mask for the object in a second imaging condition and correcting a position of the second mask using the first mask and the distance, wherein an imaging angle of the camera in the first imaging condition is same as the imaging angle of the camera in the second imaging condition, and wherein a position of the lens in the first imaging condition is reversed around the rotation axis from a position of the lens in the second imaging condition.

Claims (54)

1 . A method of creating a privacy mask from an image imaged by an imaging device in which a rotation axis of a camera and a center of a lens do not match, the method comprising:

imaging an object in a first imaging condition;

creating a first mask for the object and storing a position of the first mask in the image and a distance from the camera to the object;

changing an imaging angle of the camera from the first imaging condition to a second imaging condition such that a position of the lens in the second imaging condition is reversed around the rotation axis from a position of the lens in the first imaging condition after at least a panning motion and a tilting motion of the camera; and

creating a second mask for the object in the second imaging condition and correcting a position of the second mask in the image using the first mask,

wherein the correcting the position of the second mask using the first mask includes correcting the position of the second mask based on the position of the first mask, the distance from the camera to the object, and the distance between the rotation axis of the camera and the center of the lens.

2 . The method of claim 1 , further comprising:

calculating an error between the second mask created and the object based on an offset between a center point of the lens and the rotation axis and the distance from the camera to the object; and

correcting the position of the second mask using the calculated error.

3 . The method of claim 2 , wherein the distance is measured using locus data of the lens.

4 . The method of claim 1 , further comprising initializing the imaging device by correcting a structural error of the imaging device.

5 . The method of claim 4 , wherein the correcting of the structural error comprises:

rotating a panning motor from 0 degrees to 180 degrees at unit angle intervals;

measuring an actual rotation angle of the camera; and

comparing and storing a rotation angle of the panning motor and the actual rotation angle of the camera.

6 . The method of claim 5 , wherein the actual rotation angle of the camera is measured using one or more of a gyro sensor or an acceleration sensor.

7 . The method of claim 5 , wherein information stored by comparing the rotation angle of the panning motor and the actual rotation angle of the camera is applied to the actual rotation angle of the camera at 180 to 360 degrees of the panning motor.

8 . The method of claim 5 , wherein the correcting of the second mask comprises correcting the position of the second mask using a difference between the rotation angle of the panning motor and the actual rotation angle of the camera.

9 . The method of claim 4 , wherein the correcting of the structural error comprises:

setting a position of a tilting angle of 0 degrees to a predetermined position;

calculating a tilting error angle using a lens position of the lens at a first tilting angle and a lens position of the lens at a second tilting angle; and

rotating the position of the tilting angle of 0 degrees by half of the tilting error angle to correct the position of the tilting angle of 0 degrees,

wherein an imaging angle of the camera for the second tilting angle is same as an imaging angle of the camera for the first tilting angle, and

wherein the position of the lens at the second tilting angle is reversed around the rotation axis from the position of the lens at the first tilting angle.

10 . The method of claim 2 , wherein the error is calculated based on a following equation:

θ=tan −1 (l/d),

wherein θ represents the error, d represents the distance from the camera to the object, and l represents the twice the distance between the rotation axis of the camera and the center of the lens.

11 . An imaging device, comprising:

a camera configured to support panning and/or tilting motions, wherein a rotation axis of the camera and a center of a lens of the camera do not match;

a memory configured to store instructions for creating a privacy mask in an image imaged by the camera; and

at least one processor configured to execute the instructions to:

imaging an object in a first imaging condition;

create a first mask for the object in the first imaging condition and store a position of the first mask in the image and a distance from the camera to the object;

changing an imaging angle of the camera from the first imaging condition to a second imaging condition such that a position of the lens in the second imaging condition is reversed around the rotation axis from a position of the lens in the first imaging condition after at least a panning motion and a tilting motion of the camera;

create a second mask for the object in the second imaging condition; and

correct a position of the second mask based on the position of the first mask, the distance from the camera to the object, and the distance between the rotation axis of the camera and the center of the lens.

12 . The device of claim 11 , wherein the at least one processor is further configured to execute the instructions to:

calculate an error between the second mask and the object based on an offset between a center point of the lens and the rotation axis and the distance from the camera to the object, and

correct the position of the second mask using the calculated error.

13 . The device of claim 12 , wherein the at least one processor is further configured to execute the instructions to measure the distance using locus data of the lens.

14 . The device of claim 11 , wherein the at least one processor is further configured to execute the instructions to initialize the imaging device by correcting a structural error of the imaging device.

15 . The device of claim 14 , wherein the at least one processor is further configured to execute the instructions to:

rotate a panning motor from 0 degrees to 180 degrees at unit angle intervals,

measure an actual rotation angle of the camera, and

compare a rotation angle of the panning motor and the actual rotation angle of the camera; and

store the rotation angle of the panning motor and the actual rotation angle of the camera in the memory.

16 . The device of claim 15 , further comprising:

one or more of a gyro sensor or an acceleration sensor configured to measure the actual rotation angle of the camera.

17 . The device of claim 16 , wherein the at least one processor is further configured to execute the instructions to:

set a position of a tilting angle of 0 degrees to a predetermined position,

calculate a tilting error angle using a lens position of the lens at a first tilting angle and a lens position of the lens at a second tilting angle, and

rotate the position of the tilting angle of 0 degrees by half of the tilting error angle to correct the position of the tilting angle of 0 degrees,

wherein an imaging angle of the camera for the second tilting angle is same as an imaging angle of the camera for the first tilting angle, and

wherein a position of the lens at the second tilting angle is reversed around the rotation axis from a position of the lens at the first tilting angle.

Assignments (1)
CHANGE OF NAME Recorded Aug 10, 2023
From: HANWHA TECHWIN CO., LTD.
To: HANWHA VISION CO., LTD.
Reel/Frame 064549/0075 →
Priority Claims (1)
KR 10-2018-0067567 · Jun 12, 2018 · national
Continuity (3)
Continuation 17118784 · Dec 11, 2020
Continuation PCTKR2019000545 · Jul 14, 2019
Related Publication 20220394182A1 · Dec 8, 2022
References Cited (11)
US 20120120266A1 · Kang · 2012 [cited by examiner]
US 20150304574A1 · Yanagi · 2015 [cited by examiner]
US 20160134801A1 · Ashitani · 2016 [cited by examiner]
US 20160150188A1 · Ha · 2016 [cited by examiner]
KR 100664811B1 · 2007 [cited by applicant]
KR 1020070048841A · 2007 [cited by applicant]
KR 1020130102743A · 2013 [cited by applicant]
KR 1020140117183A · 2014 [cited by applicant]
KR 1020170002308A · 2017 [cited by applicant]
International Search Report dated Apr. 24, 2019 issued by the International Searching Authority in counterpart International Application No. PCT/KR2019/000545 (PCT/ISA/210). [cited by applicant]
International Written Opinion dated Apr. 24, 2019 issued by the International Searching Authority in counterpart International Application No. PCT/KR2019/000545 (PCT/ISA/237). [cited by applicant]