IP Library Granted Patent US 11,600,066
Granted Patent B2
US 11,600,066 · App. 16/962,433 · Granted Mar 7, 2023

Method, electronic device and social media server for controlling content in a video media stream using face detection

Inventors: Vishal Kondabathini (Lund, SE); Stellan Nordström (Lund, SE); Håkan Nygren (Lund, SE); Steven Guan (Lund, SE)
Assignee: Sony Group Corporation
G06V20/30G06Q50/01G06V40/161G06V40/168G06V40/173H04N21/4223H04N21/44008H04N21/4542
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,600,066
App. No.
16/962,433
Granted
Mar 7, 2023
Kind
B2
Abstract

Controlling content in a video media stream is presented. The controlling comprises: imaging a scene with a camera ( 42 ) of an electronic device ( 10 ); detecting, using a face detection function ( 22, 113 ), one or more faces present in the imaged scene; identifying, using an identity recognition function ( 23, 114 ), an individual having a face from among the one or more detected faces by determining that the face is a face of an individual having a social relationship on social media with a user of the electronic device ( 10 ); seeking approval, using an approval function ( 24, 115 ), from the identified individual to participate in the video media stream; and upon an approval from the identified individual to participate in the video media stream, generating the video media stream, using the camera ( 42 ) of the electronic device ( 10 ), with the face of the identified individual being visible.

Claims (32)

1. A method for controlling content in a video media stream, the method comprising:

imaging a scene with a camera of an electronic device;

detecting, using a face detection function, one or more faces present in the imaged scene;

identifying, using an identity recognition function, an individual having a face from among the one or more detected faces by determining that the face is a face of an individual having a social relationship on social media with a user of the electronic device;

in response to identifying the individual, seeking approval, using an approval function, from the identified individual to participate in the video media stream, by sending a request for explicit approval for such video media stream to an electronic device linked to the identified individual; and

upon receiving an explicit approval from the identified individual to participate in the video media stream, generating the video media stream, using the camera of the electronic device, with the face of the identified individual being visible, wherein the act of generating the video media stream comprises masking, using a mask function, faces present in the imaged scene, for which an explicit approval to participate in the video media stream has not been given, and upon receiving explicit approval from an individual in the imaged scene while generation of the video media stream is ongoing, stopping using the masking function to the face of the individual in the continued generation of the video media stream.

2. The method according to claim 1 , further comprising, upon a non-approval from the identified individual to participate in the video media stream, generating the video media stream with the face of the identified individual being masked using the masking function.

3. The method according to claim 1 , wherein the act of identifying an individual having a face from among the one or more detected faces is performed by accessing a database comprising facial features of individuals having a social relationship on social media with the user of the electronic device.

4. The method according to claim 3 , wherein the database is stored on a social media server, and wherein the act of identifying comprises:

sending an identity request from the electronic device to the social media server, the identity request comprises information pertaining to facial features of the detected face; and

determining, at the social media server, the identity of the individual having the detected face.

5. The method according to claim 1 , further comprising:

detecting, using the face detection function, a new face in the scene while generating the video media stream;

determining, using the identity recognition function, that the new face is a face of a new individual having a social relationship on social media with the user of the electronic device;

seeking approval, using an approval function, from the new individual having the new face to participate in the video media stream; and

upon an approval from the identified new individual having the new face to participate in the video media stream, generating the video media stream with the new face being visible.

6. An electronic device being linked to a user, the electronic device comprising:

a camera configured to image a scene; and

a control circuit configured to:

detect, using a face detection function, one or more faces present in the imaged scene;

identify, using an identity recognition function, an individual having a face from among the one or more detected faces by

determining that the face is a face of an individual having a social relationship on social media with the user of the electronic device;

in response to identifying the individual, seek approval, using an approval function, from the identified individual to participate in the video media stream, by sending a request for explicit approval for such video media stream to an electronic device linked to the identified individual;

upon finding an explicit approval from the identified individual to participate in the video media stream, generate a video media stream, using the camera of the electronic device, with the face of the identified individual being visible, wherein the act of generating the video media stream comprises masking, using a mask function, faces present in the imaged scene, for which an explicit approval to participate in the video media stream has not been given, and upon receiving explicit approval from an individual in the imaged scene while generation of the video media stream is ongoing, stopping using the masking function to the face of the individual in the continued generation of the video media stream.

7. A social media server comprising:

a database of social relationships, the database comprising a plurality of entries, wherein each entry comprises facial features and thereto linked data pertaining to an individual of the face, and data pertaining to social relationships between individuals in the database;

a transceiver configured to, from an electronic device, receive an approval request seeking approval for an individual to participate in a video media stream, wherein the approval request comprises information pertaining to facial features; and

a control circuit configured to:

identify, by using an identity recognition function and by accessing the database, an individual by determining that the information pertaining to facial features belongs to an individual having a social relationship on social media with the user of the electronic device;

in response to identifying the individual, seek approval from the identified individual to participate in a video media stream, by sending a request for explicit approval for such video media stream to an electronic device linked to the identified individual;

wherein, upon finding an explicit approval from the identified individual to participate in the video media stream, the transceiver is further configured to send an approval response to the electronic device instructing the electronic device to generate the ongoing video media stream with the face of the individual being visible.

8. The social media server according to claim 7 , wherein the approval request further comprises data pertaining to an identity of a user of the electronic device.

Assignments (3)
CHANGE OF NAME Recorded Feb 3, 2023
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 062648/0786 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 24, 2020
From: SONY MOBILE COMMUNICATIONS INC.
To: SONY CORPORATION
Reel/Frame 054454/0076 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 15, 2020
From: GUAN, STEVEN; KONDABATHINI, VISHAL; NORDSTRÖM, STELLAN; NYGREN, HÅKAN
To: SONY MOBILE COMMUNICATIONS INC.
Reel/Frame 053219/0762 →
Priority Claims (1)
SE 1850280-7 · Mar 14, 2018 · national
Continuity (1)
Related Publication 20200364460A1 · Nov 19, 2020
Cited By (1)
US 12,670,297