IP Library › Granted Patent US 12,598,265
Granted Patent B2
US 12,598,265 · App. 18/044,062 · Granted Apr 7, 2026

Cooperative photographing method and apparatus, electronic device, and computer-readable storage medium

Inventors: Panlong He (Beijing, CN); Lei Shi (Beijing, CN); Chenman Zhou (Beijing, CN); Fanhua Feng (Beijing, CN); Zhihao Zhang (Beijing, CN)
H04N5/272G06T7/70H04N5/265H04N23/62G06T2200/24G06T2207/20092G06T2207/20212
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,598,265
App. No.
18/044,062
Granted
Apr 7, 2026
Kind
B2
Abstract

A cooperative photographing method is provided, which includes: acquiring a first image captured by a first terminal and a second image captured by a second terminal, and composing a third image based on the first image and the second image. In the third image, a first object in the first image and a second object in the second image are used as foreground objects and superimposed on a specified background image. The first object is a foreground object of the first image, and the second object is a foreground object of the second image.

Claims (66)

1 . A cooperative photographing method, comprising:

acquiring a first image captured in real time by a first terminal and a second image captured in real time by a second terminal;

in real time, composing a third image based on the first image and the second image, the real-time composed third image being displayed, in real time, on the first terminal and the second terminal; and

generating a cooperative video based on the real-time composed third image,

wherein in the third image, a first object in the first image and a second object in the second image are used as foreground objects and superimposed on a specified background image, the first object is a foreground object of the first image, and the second object is a foreground object of the second image,

wherein the first object in the cooperative video is dynamic, and the second object in the cooperative video is dynamic,

wherein the first object is obtained based on an image recognition processing on the first image, and the second object is obtained based on an image recognition processing on the second image, and

wherein a superimposing position of the foreground object is determined according to an image recognition result of the background image.

2 . The method according to claim 1 , wherein the background image is a fourth image selected by a user.

3 . The method according to claim 1 , wherein the background image is a background image of the first image or a background image of the second image.

4 . The method according to claim 2 , wherein the composing a third image based on the first image and the second image comprises:

determining a first superimposing position corresponding to the first object and a second superimposing position corresponding to the second object according to a determined target cooperative photographing template; and

composing the third image by superimposing the first object in the first superimposing position on the background image and superimposing the second object in the second superimposing position on the background image.

5 . The method according to claim 3 , wherein the composing a third image based on the first image and the second image comprises:

determining a target superimposing position corresponding to a target object, wherein in a case that the background image is the background image of the first image, the target object is the second object, and in a case that the background image is the background image of the second image, the target object is the first object; and

composing the third image by superimposing the target object in the target superimposing position on the background image.

6 . The method according to claim 5 , wherein the determining a target superimposing position corresponding to a target object comprises:

determining the target superimposing position corresponding to the target object according to a determined target cooperative photographing template.

7 . The method according to claim 4 , wherein before the composing a third image based on the first image and the second image, the method further comprises:

obtaining a template selection instruction; and

determining, according to the template selection instruction, a target cooperative photographing template from a plurality of candidate cooperative photographing templates, wherein the target cooperative photographing template is used to determine a superimposing position where the foreground object is to be superimposed on the background image.

8 . The method according to claim 1 , further comprising:

acquiring a special effect input instruction, wherein the special effect input instruction comprises a target special effect to be added and a displaying position corresponding to the target special effect,

wherein after the composing a third image based on the first image and the second image, the method further comprises:

rendering the target special effect in the displaying position on the third image to obtain the third image subjected to a special effect process.

9 . The method according to claim 1 , wherein the method is applied to a first terminal, and before the acquiring a first image captured by a first terminal and a second image captured by a second terminal, the method further comprises:

generating a cooperative photographing request in responses to a received cooperative photographing trigger instruction inputted by a user; and

sending the cooperative photographing request to the second terminal, wherein the second image is sent by the second terminal to the first terminal in response to the cooperative photographing request.

10 . A cooperative photographing apparatus, comprising:

at least one processor, and

at least one memory communicatively coupled to the at least one processor and storing instructions that upon execution by the at least one processor cause the apparatus to:

acquire a first image captured in real time by a first terminal and a second image captured in real time by a second terminal;

in real time, compose a third image based on the first image and the second image, the real-time composed third image being displayed, in real time, on the first terminal and the second terminal; and

generate a cooperative video based on the real-time composed third image,

wherein in the third image, a first object in the first image and a second object in the second image are used as foreground objects and superimposed on a specified background image, the first object is a foreground object of the first image, and the second object is a foreground object of the second image,

wherein the first object in the cooperative video is dynamic, and the second object in the cooperative video is dynamic,

wherein the first object is obtained based on an image recognition processing on the first image, the second object is obtained based on an image recognition processing on the second image, and

wherein a superimposing position of the foreground object is determined according to an image recognition result of the background image.

11 . The apparatus of claim 10 , wherein the background image is a fourth image selected by a user.

12 . The apparatus of claim 10 , wherein the background image is a background image of the first image or a background image of the second image.

13 . The apparatus of claim 11 , the at least one memory further storing instructions that upon execution by the at least one processor cause the apparatus to:

determine a first superimposing position corresponding to the first object and a second superimposing position corresponding to the second object according to a determined target cooperative photographing template; and

compose the third image by superimposing the first object in the first superimposing position on the background image and superimposing the second object in the second superimposing position on the background image.

14 . The apparatus of claim 12 , the at least one memory further storing instructions that upon execution by the at least one processor cause the apparatus to:

determine a target superimposing position corresponding to a target object, wherein in a case that the background image is the background image of the first image, the target object is the second object, and in a case that the background image is the background image of the second image, the target object is the first object; and

compose the third image by superimposing the target object in the target superimposing position on the background image.

15 . The apparatus of claim 14 , the at least one memory further storing instructions that upon execution by the at least one processor cause the apparatus to:

determine the target superimposing position corresponding to the target object according to a determined target cooperative photographing template.

16 . The apparatus of claim 12 , the at least one memory further storing instructions that upon execution by the at least one processor cause the apparatus to:

obtain a template selection instruction; and

determine, according to the template selection instruction, a target cooperative photographing template from a plurality of candidate cooperative photographing templates, wherein the target cooperative photographing template is used to determine a superimposing position where the foreground object is to be superimposed on the background image.

17 . The apparatus of claim 10 , the at least one memory further storing instructions that upon execution by the at least one processor cause the apparatus to:

acquire a special effect input instruction, wherein the special effect input instruction comprises a target special effect to be added and a displaying position corresponding to the target special effect,

wherein after the composing a third image based on the first image and the second image, the method further comprises:

render the target special effect in the displaying position on the third image to obtain the third image subjected to a special effect process.

18 . The apparatus of claim 10 , wherein the apparatus is a first terminal, and before the acquiring a first image captured by a first terminal and a second image captured by a second terminal, the at least one memory further storing instructions that upon execution by the at least one processor cause the apparatus to:

generate a cooperative photographing request in responses to a received cooperative photographing trigger instruction inputted by a user; and

send the cooperative photographing request to the second terminal, wherein the second image is sent by the second terminal to the first terminal in response to the cooperative photographing request.

19 . A computer-readable non-transitory storage medium, bearing computer-readable instructions that upon execution on a computing device cause the computing device at least to:

acquire a first image captured in real time by a first terminal and a second image captured in real time by a second terminal;

in real time, compose a third image based on the first image and the second image, the real-time composed third image being displayed, in real time, on the first terminal and the second terminal; and

generate a cooperative video based on the real-time composed third image,

wherein in the third image, a first object in the first image and a second object in the second image are used as foreground objects and superimposed on a specified background image, the first object is a foreground object of the first image, and the second object is a foreground object of the second image,

wherein the first object in the cooperative video is dynamic, and the second object in the cooperative video is dynamic,

wherein the first object is obtained based on an image recognition processing on the first image, the second object is obtained based on an image recognition processing on the second image, and

wherein a superimposing position of the foreground object is determined according to an image recognition result of the background image.

Assignments (7)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 3, 2023
From: HE, PANLONG
To: DOUYIN VISION CO., LTD.
Reel/Frame 062881/0021 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 3, 2023
From: SHI, LEI; FENG, FANHUA
To: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 062881/0038 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 3, 2023
From: ZHOU, CHENMAN
To: SHANGHAI SUIXUNTONG ELECTRONIC TECHNOLOGY CO., LTD.
Reel/Frame 062881/0070 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 3, 2023
From: BEIJING DOUYIN INFORMATION SERVICE CO., LTD.
To: DOUYIN VISION CO., LTD.
Reel/Frame 062881/0083 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 3, 2023
From: ZHANG, ZHIHAO
To: BEIJING DOUYIN INFORMATION SERVICE CO., LTD.
Reel/Frame 062881/0100 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 3, 2023
From: SHANGHAI SUIXUNTONG ELECTRONIC TECHNOLOGY CO., LTD.
To: DOUYIN VISION CO., LTD.
Reel/Frame 062881/0109 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 3, 2023
From: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.
To: DOUYIN VISION CO., LTD.
Reel/Frame 062881/0120 →
Priority Claims (1)
CN 202010924413.4 · Sep 4, 2020 · national
Continuity (1)
Related Publication 20230336684A1 · Oct 19, 2023
References Cited (19)
US 11516521B2 · da Silva Pratas Gabriel · 2022 [cited by examiner]
US 20190116214A1 · Lal · 2019 [cited by examiner]
US 20200118343A1 · Koblin · 2020 [cited by examiner]
CN 107404617A · 2017 [cited by applicant]
CN 110111238A · 2019 [cited by applicant]
CN 110602396A · 2019 [cited by applicant]
CN 110992256A · 2020 [cited by applicant]
CN 111050072A · 2020 [cited by applicant]
CN 111210397A · 2020 [cited by applicant]
CN 112004034A · 2020 [cited by applicant]
JP H10164435A · 1998 [cited by applicant]
JP 2015012535A · 2015 [cited by applicant]
Intelligent group photo taking method and device (Wang Qianyi , Gao Yu) (Year: 2019). [cited by examiner]
Remote cooperative shooting method and device (Peng Dongwei) (Year: 2020). [cited by examiner]
China National Intellectual Property Administration, International Search Report Issued in Application No. PCT/CN/2021/116519, Nov. 24, 2021, WIPO, 7 pages. [cited by applicant]
China National Intellectual Property Administration, Office Action and Search Report Issued in Application No. 202010924413.4, Jul. 1, 2021, 10 pages. [cited by applicant]
China National Intellectual Property Administration, Office Action and Search Report Issued in Application No. 202010924413.4, Sep. 28, 2021, 8 pages. [cited by applicant]
Replaced Written Opinion for International Application No. PCT/CN2021/116519, mailed Nov. 24, 2021, 8 pages. [cited by applicant]
Written Opinion for International Application No. PCT/CN2021/116519, mailed Mar. 16, 2022, 9 pages. [cited by applicant]