IP Library Granted Patent US 8,937,638
Granted Patent B2
US 8,937,638 · App. 13/571,775 · Granted Jan 20, 2015

Method and apparatus for tracking active subject in video call service

Inventor: Phillip Lindberg (Helsinki, FI)
Assignee: Tellybean Oy
H04N7/14
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,937,638
App. No.
13/571,775
Granted
Jan 20, 2015
Kind
B2
Abstract

A method for tracking an active subject in a video call service includes establishing a peer-to-peer connection between a videophone input apparatus and a peer over a wireless connection; receiving information of a first resolution display of an A/V output apparatus of the peer; and generating a local video stream in the videophone apparatus based on a video signal provided by a second resolution camera of the videophone apparatus, the second resolution being greater than the first resolution. The method further includes generating a local audio stream in the videophone input apparatus based on an audio signal provided by a microphone of the videophone input apparatus; determining active subject information of the video call using at least one of the local video stream and the local audio stream; targeting the local video stream towards the active subject by selecting a first resolution view area from the second resolution video signal based on the determined active subject information; and transmitting the first resolution view area for displaying on the first resolution display.

Claims (50)

1. A videophone input apparatus, for tracking an active subject in a video call service, comprising:

a communication interface for communicating with a peer;

at least one processor; and

at least one memory including computer program code;

the at least one memory and the computer program code configured to, with the at least one processor, cause the videophone input apparatus to:

establish a peer-to-peer connection between the videophone input apparatus and a peer over a wireless connection;

receive information of a first resolution display of an A/V output apparatus of the peer;

generate a local video stream in the videophone apparatus based on a video signal provided by a second resolution camera of the videophone apparatus, the second resolution being greater than the first resolution;

generate a local audio stream in the videophone input apparatus based on an audio signal provided by a microphone of the videophone input apparatus;

determine active subject information of the video call using at least one of the local video stream and the local audio stream;

target the local video stream towards the active subject by selecting a first resolution view area from the second resolution video signal based on the determined active subject information; and

transmit the first resolution view area for displaying on the first resolution display.

2. The videophone input apparatus of claim 1 , the at least one memory and the computer program code configured to, with the at least one processor, cause the videophone apparatus further to:

recognize the active subject from the second resolution video signal using shape recognition; and

determine active subject information based on the recognized active subject.

3. The videophone input apparatus of claim 1 , the at least one memory and the computer program code configured to, with the at least one processor, cause the videophone apparatus further to:

recognize the active subject from the audio signal using sound direction detection; and

determine active subject information based on the recognized active subject.

4. A method for tracking an active subject in a video call service comprising:

establishing a peer-to-peer connection between a videophone input apparatus and a peer over a wireless connection;

receiving information of a first resolution display of an A/V output apparatus of the peer;

generating a local video stream in the videophone apparatus based on a video signal provided by a second resolution camera of the videophone apparatus, the second resolution being greater than the first resolution;

generating a local audio stream in the videophone input apparatus based on an audio signal provided by a microphone of the videophone input apparatus;

determining active subject information of the video call using at least one of the local video stream and the local audio stream;

targeting the local video stream towards the active subject by selecting a first resolution view area from the second resolution video signal based on the determined active subject information; and

transmitting the first resolution view area for displaying on the first resolution display.

5. The method of claim 4 , further comprising:

recognizing the active subject from the second resolution video signal using shape recognition; and

determining active subject information based on the recognized active subject.

6. The method of claim 4 , further comprising:

recognizing the active subject from the audio signal using sound direction detection; and

determining active subject information based on the recognized active subject.

7. The method of claim 4 , further comprising:

generating the local audio stream in the videophone input apparatus based on audio signals provided by at least two microphones of the videophone input apparatus;

recognizing the active subject from the audio signals using sound direction detection; and

determining active subject information based on the recognized active subject.

8. The method of claim 4 further comprising:

targeting the local video stream towards the active subject by selecting a first resolution view area from the second resolution video signal based on the determined active subject information.

9. The method of claim 8 further comprising:

targeting the local video stream towards the active subject using at least one of the following:

moving the first resolution view area in a horizontal direction;

moving the first resolution view area in a vertical direction; and

zooming the first resolution view area.

10. A computer program embodied on a non-transitory computer readable medium comprising computer executable program code, which when executed by at least one processor of a videophone apparatus, causes the videophone apparatus to: establish a peer-to-peer connection between the videophone input apparatus and a peer over a wireless connection;

receive information of a first resolution display of an A/V output apparatus of the peer;

generate a local video stream in the videophone apparatus based on a video signal provided by a second resolution camera of the videophone apparatus, the second resolution being greater than the first resolution;

generate a local audio stream in the videophone input apparatus based on an audio signal provided by a microphone of the videophone input apparatus;

determine active subject information of the video call using at least one of the local video stream and the local audio stream;

target the local video stream towards the active subject by selecting a first resolution view area from the second resolution video signal based on the determined active subject information; and

transmit the first resolution view area for displaying on the first resolution display.

Assignments (4)
CHANGE OF NAME Recorded Nov 26, 2013
From: TWINELAB OY
To: TELLYBEAN OY
Reel/Frame 031710/0423 →
TO CORRECT ERROR IN SPELLING OF RECEIVING PARTY STREET ADDRESS ON REEL/FRAME 030452/0914. Recorded Nov 26, 2013
From: TWINELAB OY
To: TELLYBEAN OY
Reel/Frame 032189/0285 →
CHANGE OF NAME Recorded May 20, 2013
From: TWINELAB OY
To: TELLYBEAN OY
Reel/Frame 030452/0914 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 10, 2012
From: LINDBERG, PHILLIP
To: TWINELAB OY
Reel/Frame 028764/0794 →
Continuity (1)
Related Publication 20140043432A1 · Feb 13, 2014