IP Library Granted Patent US 9,167,201
Granted Patent B2
US 9,167,201 · App. 13/911,325 · Granted Oct 20, 2015

Feedback-system for managing video conferencing with a portable multimedia device comprising a frontal camera

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,167,201
App. No.
13/911,325
Granted
Oct 20, 2015
Kind
B2
Abstract

A feedback-system for managing the position of a frontal camera provided on a portable multimedia device during video communication. The feedback-system comprises a camera image analyzer coupled to the frontal camera and adapted to detect and analyze the pose of a user facing the frontal camera, an optimal video estimator coupled to the camera image analyzer and adapted to calculate a 6-dimensional error-vector of the current position of the frontal camera with respect to an optimal position of the frontal camera, an intuitive feedback manager coupled to the optimal video estimator and adapted to generate a transformation matrix translating the error-vector into an error message for the image displayed on a screen of the portable multimedia device, the intuitive feedback manager being further coupled to the portable multimedia device which is adapted to use the error message for modifying the image displayed on the screen.

Claims (18)

1. A feedback-system for managing during video communication the position of a frontal camera provided on a portable multimedia device,

wherein said feedback-system comprises

a camera image analyzer coupled to said frontal camera and adapted to detect and analyze the pose of a user facing said frontal camera,

an optimal video estimator coupled to said camera image analyzer and adapted to calculate an error-vector of the current position of said frontal camera with respect to an optimal position of said frontal camera,

an intuitive feedback manager coupled to said optimal video estimator and adapted to translate said error-vector into an error message for the image displayed on a screen of said portable multimedia device, said intuitive feedback manager being further coupled to said portable multimedia device which is adapted to use said error message for modifying the image displayed on said screen.

2. The feedback-system according to claim 1 , wherein said feedback-system further comprises a display controller coupled to said intuitive feedback manager and adapted to receive said error message and to modify the image on said screen by displaying instructions corresponding to said error message.

3. The feedback-system according to claim 2 , wherein said instructions are displayed under the form of arrows on said screen.

4. The feedback-system according to claim 2 , said user manages the position of said frontal camera by modifying the position of said portable multimedia device.

5. The feedback-system according to claim 2 , wherein said user manages the position of said frontal camera by modifying his position with respect to said portable multimedia device.

6. The feedback-system according to claim 1 , wherein said feedback-system further comprises a display controller coupled to said intuitive feedback manager and adapted to receive said error message and to accordingly modify the perspective of the image displayed on said screen.

7. The feedback-system according to claim 6 , wherein said user intuitively modifies the position of said portable multimedia device for correcting the perspective of the image displayed on said screen.

8. The feedback-system according to claim 6 , wherein said user intuitively modifies his position with respect to said portable multimedia device for correcting the perspective of the image displayed on said screen.

9. The feedback-system according to claim 1 , wherein said camera image analyzer is adapted to detect and analyze the pose of said user facing said frontal camera based on pose tracking by pose detectors, optical flow algorithms and/or feature point analysis.

10. The feedback-system according to claim 1 ,

wherein said optimal video estimator is adapted to calculate an error-vector of the current position of said frontal camera with respect to an optimal position of said frontal camera,

and in that said intuitive feedback manager is adapted to translate said error-vector into an error message by transforming said error-vector with a transformation matrix.

11. The feedback-system according to claim 10 , wherein said error-vector is a 6-dimensional error-vector comprising 3 x-y-z translations errors and 3 rotations errors.

12. The feedback-system according to claim 10 , said optimal video estimator is further coupled to other sensors such as gyroscope, accelerometers and/or proximity sensors in order to calculate said error-vector.

Assignments (11)
PATENT SECURITY AGREEMENT Recorded Apr 22, 2023
From: RPX CORPORATION
To: BARINGS FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 063429/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2021
From: PROVENANCE ASSET GROUP LLC
To: RPX CORPORATION
Reel/Frame 059352/0001 →
RELEASE OF SECURITY INTEREST Recorded Nov 30, 2021
From: NOKIA US HOLDINGS INC.
To: PROVENANCE ASSET GROUP HOLDINGS LLC; PROVENANCE ASSET GROUP LLC
Reel/Frame 058363/0723 →
RELEASE OF SECURITY INTEREST Recorded Nov 30, 2021
From: CORTLAND CAPITAL MARKETS SERVICES LLC
To: PROVENANCE ASSET GROUP HOLDINGS LLC; PROVENANCE ASSET GROUP LLC
Reel/Frame 058983/0104 →
ASSIGNMENT AND ASSUMPTION AGREEMENT Recorded Feb 14, 2019
From: NOKIA USA INC.
To: NOKIA US HOLDINGS INC.
Reel/Frame 048370/0682 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2017
From: NOKIA TECHNOLOGIES OY; NOKIA SOLUTIONS AND NETWORKS BV; ALCATEL LUCENT SAS
To: PROVENANCE ASSET GROUP LLC
Reel/Frame 043877/0001 →
SECURITY INTEREST Recorded Sep 13, 2017
From: PROVENANCE ASSET GROUP HOLDINGS, LLC; PROVENANCE ASSET GROUP LLC
To: NOKIA USA INC.
Reel/Frame 043879/0001 →
SECURITY INTEREST Recorded Sep 13, 2017
From: PROVENANCE ASSET GROUP HOLDINGS, LLC; PROVENANCE ASSET GROUP, LLC
To: CORTLAND CAPITAL MARKET SERVICES, LLC
Reel/Frame 043967/0001 →
RELEASE OF SECURITY INTEREST Recorded Sep 2, 2014
From: CREDIT SUISSE AG
To: ALCATEL LUCENT
Reel/Frame 033677/0419 →
SECURITY AGREEMENT Recorded Jul 22, 2013
From: ALCATEL LUCENT
To: CREDIT SUISSE AG
Reel/Frame 030851/0345 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 6, 2013
From: SIX, ERWIN ALFONS CONSTANT; LIEVENS, SAMMY; AERTS, MAARTEN; TYTGAT, DONNY G.
To: ALCATEL LUCENT
Reel/Frame 030558/0783 →