IP Library › Granted Patent US 11,294,510
Granted Patent B2
US 11,294,510 · App. 17/096,355 · Granted Apr 5, 2022

Method, system and non-transitory computer-readable recording medium for supporting object control by using a 2D camera

Inventor: Seok Joong Kim (Seoul, KR)
Assignee: VTOUCH CO., LTD.
G06F3/042G06V40/13G06V40/19
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,294,510
App. No.
17/096,355
Granted
Apr 5, 2022
Kind
B2
Abstract

According to one aspect of the present invention, there is provided a method for assisting object control using a two-dimensional camera, comprising the steps of: acquiring a two-dimensional image of a user's body from a two-dimensional camera; and determining a control target area with reference to a candidate target area specified on the basis of two-dimensional relative coordinate points respectively corresponding to a first body part and a second body part of the user in the two-dimensional image, wherein the candidate target area and the control target area are determined on a reference surface established with respect to the two-dimensional camera.

Claims (25)

1. A system for assisting object control using a two-dimensional camera, comprising:

an image acquisition unit configured to acquire a two-dimensional image of a user's body from a two-dimensional camera; and

a control target area determination unit configured to determine a control target area with reference to a candidate target area specified on the basis of two-dimensional relative coordinate points respectively corresponding to a first body part and a second body part of the user in the two-dimensional image,

wherein the candidate target area and the control target area are determined on a reference surface established with respect to the two-dimensional camera,

wherein the candidate target area is specified on the basis of a virtual line connecting a virtual point and a point where the two-dimensional camera is positioned on the reference surface,

wherein the virtual point is specified with reference to an angle between a line connecting the two-dimensional relative coordinate points respectively corresponding to the first and second body parts in the two-dimensional image, and a reference line established in the two-dimensional image, and

wherein the control target area determination unit is configured to determine an object included in the control target area, among objects included in the candidate target area, as an object to be controlled by the user.

2. A method for assisting object control using a two-dimensional camera, comprising the steps of:

acquiring a two-dimensional image of a user's body from a two-dimensional camera; and

determining a control target area with reference to a candidate target area specified on the basis of two-dimensional relative coordinate points respectively corresponding to a first body part and a second body part of the user in the two-dimensional image,

wherein the candidate target area and the control target area are determined on a reference surface established with respect to the two-dimensional camera,

wherein the candidate target area is specified on the basis of a virtual line connecting a virtual point and a point where the two-dimensional camera is positioned on the reference surface,

wherein the virtual point is specified with reference to an angle between a line connecting the two-dimensional relative coordinate points respectively corresponding to the first and second body parts in the two-dimensional image, and a reference line established in the two-dimensional image, and

wherein in the determining step, an object included in the control target area, among objects included in the candidate target area, is determined as an object to be controlled by the user.

3. The method of claim 2 , wherein the two-dimensional relative coordinate points are specified in a relative coordinate system associated with the two-dimensional camera.

4. The method of claim 2 , wherein in the determining step, an area within the candidate target area that is judged to be associated with a gesture of the user is determined as the control target area.

5. The method of claim 4 , wherein the gesture includes a gesture of the user moving the first body part or the second body part.

6. The method of claim 4 , wherein the determining step comprises the steps of:

providing guide information for assisting the user to identify the candidate target area; and

determining an area judged to be associated with the user's gesture recognized after the guide information is provided as the control target area.

7. The method of claim 2 , wherein in the acquiring step, a first two-dimensional image of the user's body is acquired from a first two-dimensional camera, and a second two-dimensional image of the user's body is acquired from a second two-dimensional camera,

wherein in the determining step, the control target area is determined with reference to a first candidate target area specified on the basis of two-dimensional relative coordinate points respectively corresponding to the first and second body parts of the user in the first two-dimensional image, and a second candidate target area specified on the basis of two-dimensional relative coordinate points respectively corresponding to the first and second body parts of the user in the second two-dimensional image, and

wherein the first candidate target area, the second candidate target area, and the control target area are determined on a reference surface established with respect to the first and second two-dimensional cameras.

8. The method of claim 7 , wherein in the determining step, an area common to the first candidate target area and the second candidate target area is determined as the control target area.

9. A non-transitory computer-readable recording medium having stored thereon a computer program for executing the method of claim 2 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 12, 2020
From: KIM, SEOK JOONG
To: VTOUCH CO., LTD.
Reel/Frame 054351/0010 →
Priority Claims (1)
KR 10-2019-0027623 · Mar 11, 2019 · national
Continuity (2)
Continuation PCTKR2020003063 · Mar 4, 2020
Related Publication 20210064160A1 · Mar 4, 2021