IP Library Granted Patent US 9,792,716
Granted Patent B2
US 9,792,716 · App. 14/304,831 · Granted Oct 17, 2017

Enhancing video chatting

Inventors: Hui Deng (San Ramon, CA); Jin Wang (Hangzhou, CN); Kaixuan Mao (Fremont, CA)
Assignee: ARCSOFT INC.
G06T13/80G06K9/00315H04N5/23219H04N5/23229H04N7/147H04N2007/145
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,792,716
App. No.
14/304,831
Granted
Oct 17, 2017
Kind
B2
Abstract

A method for a computing device to enhance video chatting Includes receiving a live video stream, processing a frame in the live video stream in real-time, and transmitting the frame to another computing device. Processing the frame in real-time includes detecting a face, an upper torso, or a gesture in the frame, and applying a visual effect to the frame. The method includes processing a next frame in the live video stream in real-time by repeating the enhancing, the detecting, and the applying.

Claims (46)

1. A method for a computing device to enhance video chatting, comprising:

receiving a live video stream;

processing a frame in the live video stream in real-time, comprising:

detecting a face in the frame; and

applying a visual effect to the frame, comprising adding a graphic to or about the face in the frame;

transmitting the frame to an other computing device;

processing additional frames that consecutively follow the frame in the live video stream in real-time by repeating said detecting and said applying to add other graphics to or about the face in the additional frames to generate an animated effect in the frame and the additional frames, wherein the animated effect comprises the graphic in the frame and the other graphics in the additional frames that create an appearance of movement;

transmitting the additional frames to the other computing device; and

processing more frames in the live video stream in real-time by detecting the face in the more frames and applying another visual effect to the more frame, wherein said applying another visual effect to the more frames comprising morphing the face.

2. The method of claim 1 , further comprising adjusting lighting in the frame, removing noise from the frame, or removing blur from the frame.

3. The method of claim 1 , further comprising detecting facial features from the face.

4. The method of claim 3 , further comprising processing further frames in the live video stream in real-time by detecting the face in the further frames and applying a further visual effect to the further frames, wherein said applying a further visual effect to the further frames comprises retouching the face.

5. The method of claim 3 , wherein the graphic is placed on the face based on a location of a facial feature.

6. The method of claim 1 , wherein processing a frame in the live video stream in real-time and processing additional frames in the live video stream in real time comprise detecting a gesture in the live video and generating the animated effect in response to the gesture, wherein the gesture comprises a facial gesture, a hand gesture, or a movement of another body part, and the animated effect is applied in response to detecting the gesture.

7. The method of claim 3 , further comprising processing further frames in the live video stream in real-time by detecting the face in the further frames and applying a further visual effect to the further frame, wherein said applying a further visual effect to the further frames comprises applying a cosmetic to the face.

8. A method for a computing device to enhance video chatting, comprising:

receiving a live video stream;

processing a frame in the live video stream in real-time, comprising:

detecting a person's face in the frame; and

applying a visual effect to the frame, wherein said applying a visual effect to the frame comprises completely obscuring a background in the frame of the live video stream in real-time;

transmitting the frame to an other computing device;

processing a next frame in the live video stream in real-time by repeating said detecting and said applying;

transmitting the additional frames to the other computing device; and

processing more frames in the live video stream in real-time by detecting the face in the more frames and applying another visual effect to the more frame, wherein said applying another visual effect to the more frames comprising morphing the face.

9. A non-transitory computer-readable medium comprising instructions for a processor to enhance video chatting, the instructions comprising:

receiving a live video stream;

processing a frame in the live video stream in real-time, comprising:

detecting a face in the frame; and

applying a visual effect to the frame based on said detecting, comprising adding a graphic to or about the face in the frame;

transmitting the frame to an other computing device;

processing additional frames that consecutively follow the frame in the live video stream in real-time by repeating said detecting and said applying to add other graphics to or about the face in the additional frames to generate an animated effect in the frame and the additional frames, wherein the animated effect comprises the graphic in the frame and the other graphics in the additional frames that create an appearance of movement;

transmitting the additional frames to the other computing device; and

processing more frames in the live video stream in real-time by detecting the face in the more frames and applying another visual effect to the more frame, said applying another visual effect to the more frame comprising morphing the face.

10. The non-transitory computer-readable medium of claim 9 , wherein the instructions further comprise adjusting lighting in the frame, removing noise from the frame, or removing blur from the frame.

11. The non-transitory computer-readable medium of claim 9 , wherein the instructions further comprise processing further frames in the live video stream in real-time by detecting the face in the further frames and applying a further visual effect to the further frames, wherein said applying a further visual effect to the further frames comprises retouching the face.

12. The non-transitory computer-readable medium of claim 9 , wherein processing a frame in the live video stream in real-time and processing additional frames in the live video stream in real time comprise detecting a gesture in the live video and generating the animated effect in response to the gesture, the gesture comprises a facial gesture, a hand gesture, or a movement of another body part, and the animated effect is applied in response to said detecting the gesture.

13. The non-transitory computer-readable medium of claim 9 , wherein the instructions further comprise processing further frames in the live video stream in real-time by detecting the face in the further frames and applying a further visual effect to the further frames, and said applying a further visual effect to the further frames comprises applying a cosmetic to the face.

14. A non-transitory computer-readable medium comprising instructions for a processor to enhance video chatting, the instructions comprising:

receiving a live video stream;

processing a frame in the live video stream in real-time, comprising:

detecting a person's face in the frame; and

applying a visual effect to the frame based on said detecting, wherein said applying a visual effect to the frame comprises completely obscuring a background in the frame of the live video stream in real-time;

transmitting the frame to an other computing device;

processing a next frame in the live video stream in real-time by repeating said detecting and said applying;

transmitting the additional frames to the other computing device; and

processing more frames in the live video stream in real-time by detecting the face in the more frames and applying another visual effect to the more frame, said applying another visual effect to the more frame comprising morphing the face.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 19, 2014
From: DENG, HUI; WANG, JIN; MAO, KAIXUAN
To: ARCSOFT, INC.
Reel/Frame 033138/0119 →
Continuity (1)
Related Publication 20150365627A1 · Dec 17, 2015