IP Library Granted Patent US 11,922,605
Granted Patent B2
US 11,922,605 · App. 17/294,565 · Granted Mar 5, 2024

Selective distortion or deformation correction in images from a camera with a wide angle lens

Inventors: Tianran Wang (Beijing, CN); Hailin Song (Beijing, CN); Wenxue He (Beijing, CN)
Assignee: Hewlett-Packard Development Company, L.P.
G06T5/006G06T3/0018G06T7/11G06T2207/10016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,922,605
App. No.
17/294,565
Granted
Mar 5, 2024
Kind
B2
Abstract

A method includes receiving, at a conference endpoint, video captured using a wide angle lens. The method further includes selecting a view region in a frame of the video. The method further includes selectively applying, based on a size of the view region, deformation correction or distortion correction to the view region to generate a corrected video frame. The method further includes transmitting the corrected video frame to a remote endpoint.

Claims (41)

1. A method comprises:

receiving, at a conference endpoint, video captured using a wide angle lens;

selecting a view region in a frame of the video;

selectively applying, based on a size of the view region, deformation correction or distortion correction to the view region to generate a corrected video frame; and

transmitting the corrected video frame to a remote endpoint,

wherein selectively applying, based on the size of the view region, deformation correction or distortion correction includes applying the deformation correction to the view region in response to determining that the size of the view region is less than a threshold size.

2. The method of claim 1 , wherein the threshold size corresponds to half a size of the frame of the video.

3. The method of claim 1 , wherein selecting the view region in the frame of the video includes detecting, at the conference endpoint, an active participant in a conference and cropping the frame to an area around the active participant.

4. The method of claim 1 , wherein the deformation correction corresponds to a first table mapping indicating one or more first transformations to apply to the view region to correct deformation effects in the view region and the distortion correction corresponds to a second table mapping indicating one or more second transformations to apply to the view region to correct distortion effects in the view region.

5. The method of claim 1 , wherein selectively applying, based on the size of the view region, the deformation correction or the distortion correction further includes:

identifying a location, in the frame, of a face depicted in the view region and;

applying the deformation correction in response to determining that the location of the face is within a threshold range of a border of the frame and that the size of the view region is smaller than a threshold size.

6. The method of claim 1 , wherein selectively applying, based on the size of the view region, the deformation correction or the distortion correction is based further on whether the deformation correction or the distortion correction was applied to a previous frame.

7. A computer readable storage device storing instructions executable by one or more processors to:

receive video captured using a wide angle lens;

select a view region in a frame of the video;

selectively apply, based on a size of the view region, deformation correction or distortion correction to the view region to generate a corrected video frame; and

transmit the corrected video frame to a remote endpoint,

wherein selectively applying, based on the size of the view region, the deformation correction or the distortion correction further includes:

identifying a location, in the frame, of a face depicted in the view region and;

applying the deformation correction in response to determining that the location of the face is within a threshold range of a border of the frame and that the size of the view region is smaller than a threshold size.

8. The computer readable storage device of claim 7 , wherein selectively applying, based on the size of the view region, deformation correction or distortion correction includes applying the deformation correction to the view region in response to determining that the size of the view region is less than a threshold size.

9. The computer readable storage device of claim 8 , wherein the threshold size corresponds to half a size of the frame of the video.

10. The computer readable storage device of claim 7 , wherein selecting the view region in the frame of the video includes detecting an active participant in a conference and cropping the frame to an area around the active participant.

11. The computer readable storage device of claim 7 , wherein the deformation correction corresponds to a first table mapping indicating one or more first transformations to apply to the view region to correct deformation effects in the view region and the distortion correction corresponds to a second table mapping indicating one or more second transformations to apply to the view region to correct distortion effects in the view region.

12. The computer readable storage device of claim 7 , wherein selectively applying, based on the size of the view region, the deformation correction or the distortion correction is based further on whether the deformation correction or the distortion correction was applied to a previous frame.

13. An apparatus comprising:

a camera including a wide angle lens;

one or more processors; and

a memory storing instructions executable by the one or more processors to:

receive video captured by the camera;

select a view region in a frame of the video;

selectively apply, based on a size of the view region, deformation correction or distortion correction to the view region to generate a corrected video frame; and

transmit the corrected video frame to a remote endpoint,

wherein selecting the view region in the frame of the video includes detecting active participant in a conference and cropping the frame to an area around the active participant.

14. The apparatus of claim 13 , wherein selectively applying, based on the size of the view region, deformation correction or distortion correction includes applying the deformation correction to the view region in response to determining that the size of the view region is less than a threshold size.

15. The apparatus of claim 14 , wherein the threshold size corresponds to half a size of the frame of the video.

16. The apparatus of claim 13 , wherein the deformation correction corresponds to a first table mapping indicating one or more first transformations to apply to the view region to correct deformation effects in the view region and the distortion correction corresponds to a second table mapping indicating one or more second transformations to apply to the view region to correct distortion effects in the view region.

17. The apparatus of claim 13 , wherein selectively applying, based on the size of the view region, the deformation correction or the distortion correction further includes:

identifying a location, in the frame, of a face depicted in the view region and;

applying the deformation correction in response to determining that the location of the face is within a threshold range of a border of the frame and that the size of the view region is smaller than a threshold size.

Assignments (5)
NUNC PRO TUNC ASSIGNMENT Recorded Dec 21, 2023
From: POLYCOM, INC.
To: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
Reel/Frame 066091/0407 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 6, 2023
From: WANG, TIANRAN; SONG, HAILIN; HE, WENXUE
To: POLYCOM, INC.
Reel/Frame 065778/0166 →
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY ADDRESS PREVIOUSLY RECORDED AT REEL: 063115 FRAME: 0558. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Nov 21, 2023
From: POLYCOM, LLC.
To: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
Reel/Frame 066175/0381 →
CORRECTIVE ASSIGNMENT TO CORRECT THE CONVEYING AND RECEIVING PARTY NAMES PREVIOUSLY RECORDED AT REEL: 062699 FRAME: 0203. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Mar 16, 2023
From: POLYCOM, INC.
To: POLYCOM, LLC
Reel/Frame 063115/0558 →
CHANGE OF NAME Recorded Feb 9, 2023
From: POLYCOMM, INC.
To: POLYCOMM, LLC
Reel/Frame 062699/0203 →
Continuity (1)
Related Publication 20220005162A1 · Jan 6, 2022