IP Library › Granted Patent US 11,722,768
Granted Patent B2
US 11,722,768 · App. 17/388,077 · Granted Aug 8, 2023

Method and apparatus for controlling camera, and medium and electronic device

Inventors: Jin Huang (Beijing, CN); Gang Huang (Beijing, CN); Kesheng Wang (Beijing, CN); Yin Yao (Beijing, CN); Qiaoling Xu (Beijing, CN)
Assignee: BEIJING AMBOW SHENGYING EDUCATION AND TECHNOLOGY CO., LTD.
H04N23/67G06V40/18H04N21/2187H04N21/23418
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,722,768
App. No.
17/388,077
Granted
Aug 8, 2023
Kind
B2
Abstract

A method and an apparatus for controlling a camera, and a medium and an electronic device are disclosed. The method includes: acquiring head portrait information of a teacher in a video frame image of a live classroom in real time; analyzing the head portrait information to acquire organ identification information of each organ, wherein the organ identification information is used to indicate whether the organ exists; determining an orientation type of a face in the head portrait information based on the organ identification information, wherein the orientation type comprises a forward type, a lateral type, and a backward type; controlling the camera to focus on the teacher in response to the orientation type being the forward type; and controlling the camera to focus on a blackboard in response to the orientation type being the backward type or the lateral type.

Claims (35)

1. A method for controlling a camera, comprising:

acquiring head portrait information of a teacher in a video frame image of a live classroom in real time;

analyzing the head portrait information to acquire organ identification information of each organ, wherein the organ identification information is used to indicate whether the organ exists;

determining an orientation type of a face in the head portrait information based on the organ identification information, wherein the orientation type comprises a forward type, a lateral type, and a backward type, and the forward type indicates that the face in the head portrait information faces the camera, the lateral type indicates that one side of the face in the head portrait information faces the camera, and the backward type indicates that the face in the head portrait information faces away from the camera;

controlling the camera to focus on the teacher in response to the orientation type being the forward type; and

controlling the camera to focus on a blackboard in response to the orientation type being the backward type or the lateral type.

2. The method of claim 1 , wherein the organ identification information comprises at least left eye identification information and right eye identification information;

the determining an orientation type of a face in the head portrait information based on the organ identification information comprises:

determining that the orientation type is the forward type in response to both the left eye identification information and the right eye identification information indicating existence;

determining that the orientation type is the lateral type in response to one of the left eye identification information and the right eye identification information indicating existence;

determining that the orientation type is the backward type in response to both the left eye identification information and the right eye identification information indicating non-existence.

3. The method of claim 1 , wherein the controlling the camera to focus on the teacher in response to the orientation type being the forward type comprises:

controlling a focal length and a shooting angle of the camera to focus on the teacher in response to the orientation type being the forward type, to acquire a first current video frame image, wherein the first current video frame image comprises whole body image information of the teacher, and the whole body image information occupies a first area of the first current video frame image, and the first area is preset.

4. The method of claim 2 , wherein the controlling the camera to focus on a blackboard in response to the orientation type being the lateral type comprises:

controlling a focal length and a shooting angle of the camera to focus on the blackboard in response to the orientation type being the lateral type, to acquire a second current video frame image, wherein the second current video frame image comprises image information of the blackboard and image information of the teacher, and in the second current video frame image, a ratio of a height of the image information of the blackboard to a height of the second current video frame image satisfies a preset height ratio range, and the image information of the teacher is located in a second area associated with the orientation type in the second current video frame image, and the second area is preset.

5. The method of claim 4 , wherein the lateral type comprises a left-side type, and in response to the right eye identification information indicating existence and the left eye identification information indicating non-existence, it is determined that the lateral type is the left-side type;

the controlling a focal length and a shooting angle of the camera to focus on the blackboard in response to the orientation type being the lateral type, to acquire a second current video frame image comprises:

controlling the focal length and the shooting angle of the camera to focus on the blackboard in response to the lateral type being the left-side type, to acquire the second current video frame image, wherein the second current video frame image comprise the image information of the blackboard and the image information of the teacher, and in the second current video frame image, the ratio of the height of the image information of the blackboard to the height of the second current video frame image satisfies the preset height ratio range, and the image information of the teacher is located in the second area on the left side of the second current video frame image.

6. The method of claim 4 , wherein the lateral type comprises a right-side type, and in response to the left eye identification information indicating existence and the right eye identification information indicating non-existence, it is determined that the lateral type is the right-side type;

the controlling a focal length and a shooting angle of the camera to focus on the blackboard in response to the orientation type being the lateral type, to acquire a second current video frame image comprises:

controlling the focal length and the shooting angle of the camera to focus on the blackboard in response to the lateral type being the right-side type, to acquire the second current video frame image, wherein the second current video frame image comprise the image information of the blackboard and the image information of the teacher, and in the second current video frame image, the ratio of the height of the image information of the blackboard to the height of the second current video frame image satisfies the preset height ratio range, and the image information of the teacher is located in the second area on the right side of the second current video frame image.

7. The method of claim 1 , wherein the acquiring head portrait information of a teacher in a video frame image of a live classroom in real time comprises:

acquiring the video frame image of the live classroom through the camera in real time;

judging whether the video frame image comprises the head portrait information of the teacher;

acquiring the head portrait information of the teacher in the video frame image in response to the video frame image comprising the head portrait information of the teacher;

adjusting the camera based on preset camera parameters in response to the video frame image not comprising the head portrait information of the teacher, so that the video frame image comprises overall image information of the blackboard.

8. An apparatus for controlling a camera, comprising:

a head portrait acquisition component configured to acquire head portrait information of a teacher in a video frame image of a live classroom in real time;

an analysis component configured to analyze the head portrait information to acquire organ identification information of each organ, wherein the organ identification information is used to indicate whether the organ exists;

a determination component configured to determine an orientation type of a face in the head portrait information based on the organ identification information, wherein the orientation type comprises a forward type, a lateral type, and a backward type, and the forward type indicates that the face is in the head portrait information faces a camera, the lateral type indicates that one side of the face in the head portrait information faces the camera, and the backward type indicates that the face of the head portrait information faces away from the camera; and

a focus control component configured to control the camera to focus on the teacher in response to the orientation type being the forward type; and control the camera to focus on a blackboard in response to the orientation type being the backward type or the lateral type.

9. A non-transitory computer readable storage medium having a computer program stored thereon, wherein the program is executed by a processor to implement the method according to claim 1 .

10. An electronic device, comprising:

one or more processors;

a storage device configured to store one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors implement the method according to claim 1 .

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2023
From: BEIJING AMBOW SHENGYING EDUCATION AND TECHONOLGY CO., LTD.
To: OOOK INTELLIGENT CO., LIMITED
Reel/Frame 065724/0011 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 30, 2021
From: HUANG, JIN; HUANG, GANG; WANG, KESHENG; YAO, YIN; XU, QIAOLING
To: BEIJING AMBOW SHENGYING EDUCATION AND TECHNOLOGY CO., LTD.
Reel/Frame 057032/0147 →
Priority Claims (1)
CN 202110423610.2 · Apr 20, 2021 · national
Continuity (1)
Related Publication 20220337738A1 · Oct 20, 2022