IP Library › Granted Patent US 8,762,846
Granted Patent B2
US 8,762,846 · App. 12/619,461 · Granted Jun 24, 2014

Method and system for adaptive viewport for a mobile device based on viewing angle

Inventors: Marcus Kellerman (San Diego, CA); Xuemin Chen (Rancho Santa Fe, CA); Samir Hulyalkar (Newtown, PA); Ilya Klebanov (Thornhill, CA)
Assignee: Broadcom Corporation
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,762,846
App. No.
12/619,461
Granted
Jun 24, 2014
Kind
B2
Abstract

A 2D and/or 3D video processing device comprising a camera and a display captures images of a viewer as the viewer observes displayed 2D and/or 3D video content in a viewport. Face and/or eye tracking of viewer images is utilized to generate a different viewport. Current and different viewports may comprise 2D and/or 3D video content from a single source or from different sources. The sources of 2D and/or 3D content may be scrolled, zoomed and/or navigated through for generating the different viewport. Content for the different viewport may be processed. Images of a viewer's positions, angles and/or movements of face, facial expression, eyes and/or physical gestures are captured by the camera and interpreted by face and/or eye tracking. The different viewport may be generated for navigating through 3D content and/or for rotating a 3D object. The 2D and/or 3D video processing device communicates via wire, wireless and/or optical interfaces.

Claims (40)

1. A method, comprising:

performing by one or more processors, one or more circuits, or any combination thereof in a video processing device:

capturing one or more images of a viewer while said viewer observes video content that is displayed in a current viewport;

performing at least one of face tracking or eye tracking on said captured one or more images of said viewer;

generating a different viewport comprising at least partially different video content based on said tracking, wherein generating said different viewport comprises navigating, based on said tracking, through three-dimensional (3D) video content by varying viewing angles or depths of view in said 3D video content; and

displaying said generated different viewport.

2. The method according to claim 1 , wherein said current viewport and said different viewport respectively display at least partially different portions of a single source of video content.

3. The method according to claim 1 , wherein said different viewport comprises video content from a different source of video content than said current viewport.

4. The method according to claim 1 , wherein generating a different viewport comprises at least one of scrolling, zooming, navigating, or combinations thereof, through at least one of a source of currently available video content or a different source of video content.

5. The method according to claim 1 , wherein capturing one or more images comprises capturing images of one or more positions of a face of said viewer, of one or more angles of said face of said viewer, of one or more movements of said face of said viewer, of a facial expression of said viewer, of eyes of said viewer, of other physical gestures of a body of said viewer, or combinations thereof, by a camera.

6. The method according to claim 1 , comprising interpreting captured images of one or more positions of a face of said viewer, of one or more angles of said face of said viewer, of one or more movements of said face of said viewer, of a facial expression of said viewer, of a eyes of said viewer, of other physical gestures of a body of said viewer, or combinations thereof, for scrolling, zooming, navigating, or combinations thereof, beyond said current viewport.

7. A system for communication, comprising:

one or more processors, one or more circuits, or any combination thereof for use in a video processing device operable to:

capture one or more images of a viewer while said viewer observes video content that is displayed in a current viewport;

perform at least one of face tracking or eye tracking on said captured one or more images of said viewer;

generate a different viewport by navigating, based on said tracking, through three-dimensional (3D) video content by varying viewing angles or depths of view in said 3D video content; and

display said generated different viewport.

8. The system according to claim 7 , wherein said current viewport and said different viewport respectively display at least partially different portions of a single source of video content.

9. The system according to claim 7 , wherein said different viewport comprises video content from a different source of video content than said current viewport.

10. The system according to claim 7 , wherein said one or more processors, one or more circuits, or any combination thereof is operable to scroll, zoom, navigate, or combinations thereof, through at least one of a source of currently available video content or a different source of video content.

11. The system according to claim 7 , wherein said one or more processors, one or more circuits, or any combination thereof is operable to capture images of one or more positions of a face of said viewer, of one or more angles of said face of said viewer, of one or more movements of said face of said viewer, of a facial expression of said viewer, of eyes of said viewer, of other physical gestures of a body of said viewer, or combinations thereof, by a camera.

12. A system for communication, comprising:

one or more processors, one or more circuits, or any combination thereof for use in a video processing device operable to:

display content in a current viewport;

capture one or more images of a viewer while said viewer observes said content that is displayed in said current viewport;

perform at least one of face or eye tracking said captured one or more images of said viewer;

generate, based on said tracking, another viewport of said content that is at least partly different from said current viewport; and

display said another viewport, wherein:

said content comprises three-dimensional (3D) video content; and

said one or more processors, one or more circuits, or any combination thereof is further operable to generate a different viewing angle of said 3D video content in said another viewport based on said tracking.

13. The system according to claim 12 , wherein said content comprises two-dimensional video content.

14. A method for communication, comprising:

performing by at least one processing circuit in a video processing device:

capturing one or more images of a viewer while said viewer observes three-dimensional (3D) video content that is displayed in a current viewport;

performing at least one of face tracking or eye tracking on said captured one or more images of said viewer;

generating a different viewport by navigating, based on said face tracking or said eye tracking, through three-dimensional (3D) video content by varying viewing angles or depths of view in said 3D video content; and

displaying said generated different viewport.

15. The method according to claim 14 , further comprising determining when said viewer attempts to see content other than said video content displayed in said current viewport based on said tracking.

16. The method according to claim 14 , wherein said generating a different viewport comprises generating a different viewing angle or different view in a 3D space in said different viewport.

17. The method according to claim 14 , wherein said generating a different viewport comprises rotating a 3D object in said different viewport.

Assignments (7)
CORRECTIVE ASSIGNMENT TO CORRECT THE ERROR IN RECORDING THE MERGER IN THE INCORRECT US PATENT NO. 8,876,094 PREVIOUSLY RECORDED ON REEL 047351 FRAME 0384. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER. Recorded Mar 8, 2019
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 049248/0558 →
CORRECTIVE ASSIGNMENT TO CORRECT THE EFFECTIVE DATE OF THE MERGER PREVIOUSLY RECORDED AT REEL: 047230 FRAME: 0910. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER. Recorded Oct 29, 2018
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 047351/0384 →
MERGER Recorded Oct 4, 2018
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 047230/0910 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Feb 3, 2017
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: BROADCOM CORPORATION
Reel/Frame 041712/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2017
From: BROADCOM CORPORATION
To: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
Reel/Frame 041706/0001 →
PATENT SECURITY AGREEMENT Recorded Feb 11, 2016
From: BROADCOM CORPORATION
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 037806/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 2, 2010
From: KELLERMAN, MARCUS; CHEN, XUEMIN; HULYALKAR, SAMIR; KLEBANOV, ILYA
To: BROADCOM CORPORATION
Reel/Frame 023886/0004 →
Continuity (1)
Related Publication 20110115883A1 · May 19, 2011