IP Library Granted Patent US 12,536,617
Granted Patent B2
US 12,536,617 · App. 17/887,225 · Granted Jan 27, 2026

Fused images backgrounds

Inventors: Yezhi Shen (West Lafayette, IN); Weichen Xu (West Lafayette, IN); Qian Lin (Palo Alto, CA); Jan P. Allebach (West Lafayette, IN); Fengqing Zhu (West Lafayette, IN)
Assignees: Purdue Research Foundation; Hewlett-Packard Development Company, L.P.
G06T5/50G06T7/194G06T7/20G06T2207/20221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,536,617
App. No.
17/887,225
Granted
Jan 27, 2026
Kind
B2
Abstract

In some examples in accordance with the present description, an electronic device is provided. The electronic device includes an image sensor and a controller. The controller is to receive multiple images from the image sensor including respective foregrounds and backgrounds. The controller is also to segment the respective foregrounds from the backgrounds. The controller is also to combine the backgrounds to form a fused background. The controller is also to receive a new image including a new image foreground and a new image background. The controller is also to segment the new image foreground from the new image background.

Claims (39)

1 . An electronic device, comprising:

an image sensor; and

a controller to:

receive multiple images from the image sensor including respective foregrounds and backgrounds;

segment the respective foregrounds from the backgrounds;

combine the backgrounds to form a fused background that includes image data from the multiple images; and

perform an operational loop to:

receive a new image including a new image foreground and a new image background;

segment the new image foreground from the new image background, and

synthesize an image for transmission including the new image foreground and the fused background.

2 . The electronic device of claim 1 , wherein the controller is to refine the fused background by combining the new image background with the fused background.

3 . The electronic device of claim 2 , wherein the image for transmission includes the new image foreground and a blurred representation of the fused background.

4 . The device of claim 1 , wherein the multiple images correspond to different times.

5 . The device of claim 4 , wherein the respective foregrounds of the multiple images correspond to a subject, and wherein the subject is in different positions at the different times.

6 . The device of claim 1 , wherein a greater percentage of a background environment is visible in the fused background than is visible in the respective backgrounds of the multiple images.

7 . The electronic device of claim 1 , wherein the multiple images correspond to different image sensor viewpoints.

8 . The electronic device of claim 7 , wherein the controller is to combine the backgrounds to form the fused background by aligning the multiple images using image stitching.

9 . The electronic device of claim 3 , wherein the controller is to generate a video stream from a series of the synthesized images for transmission.

10 . The electronic device of claim 9 , wherein the video stream includes the image data from the multiple images and image data from the new image.

11 . A non-transitory computer-readable medium storing machine-readable instructions which, when executed by a controller of an electronic device, cause the controller to:

receive first and second images including respective first and second foregrounds and first and second backgrounds;

combine the first and second backgrounds to form a first fused background that includes image data from the first and second images;

process the first fused background to blur the first fused background;

provide a first image for transmission including the second foreground and the blurred first fused background; and

perform an operational loop to:

receive a third image including a third foreground and a third background; and

provide a second image for transmission including the third foreground.

12 . The computer-readable medium of claim 11 , wherein execution of the executable code causes the controller to, in the operational loop:

combine the first fused background and the third background to form a second fused background; and

process the second fused background to blur the second fused background;

wherein the image for transmission-including the third foreground and the blurred second fused background.

13 . The computer-readable medium of claim 11 , wherein the second image is taken at a time subsequent to the first image.

14 . The computer-readable medium of claim 13 , wherein the first fused background includes data not present in at least one of the first background or the second background.

15 . The computer-readable medium of claim 11 , wherein execution of the executable code causes the controller to provide the first image for transmission by synthesizing the first image for transmission by overlaying the second foreground over the first blurred first fused background.

16 . The computer-readable medium of claim 11 , wherein the first and second images correspond to respective first and second camera viewpoints.

17 . The computer-readable medium of claim 16 , wherein execution of the executable code causes the controller to combine the first and second backgrounds by applying a stitching matrix to the first and second images.

18 . The computer-readable medium of claim 11 , wherein the first image for transmission includes image data from the first and second images.

19 . The computer-readable medium of claim 18 , wherein the first image for transmission includes the image data from the first image in both the second foreground and the blurred fused background, and includes the image data from the second image in the blurred fused background.

20 . The computer-readable medium of claim 11 , wherein execution of the executable code causes the controller to generate a video stream including the first image for transmission and a series of the second images for transmission.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 9, 2025
From: LIN, QIAN
To: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
Reel/Frame 073155/0256 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 16, 2023
From: ALLEBACH, JAN P; ZHU, FENGQING MAGGIE; SHEN, YEZHI; XU, WEICHEN
To: PURDUE RESEARCH FOUNDATION
Reel/Frame 062715/0718 →
Continuity (1)
Related Publication 20240054608A1 · Feb 15, 2024
References Cited (66)
US 5914748A · Parulski · 1999 [cited by examiner]
US 6141435A · Naoi · 2000 [cited by examiner]
US 6184858B1 · Christian · 2001 [cited by examiner]
US 6430303B1 · Naoi · 2002 [cited by examiner]
US 6546115B1 · Ito · 2003 [cited by examiner]
US 7783075B2 · Zhang · 2010 [cited by examiner]
US 8073247B1 · Sandrew · 2011 [cited by examiner]
US 9078048B1 · Gargi · 2015 [cited by examiner]
US 10121229B2 · Gray · 2018 [cited by examiner]
US 10311579B2 · Yun · 2019 [cited by examiner]
US 11276177B1 · Tsai · 2022 [cited by examiner]
US 20030090751A1 · Itokawa · 2003 [cited by examiner]
US 20040151342A1 · Venetianer · 2004 [cited by examiner]
US 20060285747A1 · Blake · 2006 [cited by examiner]
US 20070133880A1 · Sun · 2007 [cited by examiner]
US 20070286520A1 · Zhang · 2007 [cited by examiner]
US 20090087096A1 · Eaton · 2009 [cited by examiner]
US 20110285748A1 · Slatter et al. · 2011 [cited by applicant]
US 20120050323A1 · Baron, Jr. · 2012 [cited by examiner]
US 20120140066A1 · Lin · 2012 [cited by examiner]
US 20120207345A1 · Tang · 2012 [cited by examiner]
US 20120327172A1 · El-Saban · 2012 [cited by examiner]
US 20130101208A1 · Feris · 2013 [cited by examiner]
US 20140003720A1 · Seow · 2014 [cited by examiner]
US 20140132789A1 · Koyama · 2014 [cited by examiner]
US 20150003675A1 · Nakagami · 2015 [cited by examiner]
US 20150221066A1 · Kobayashi · 2015 [cited by examiner]
US 20150310297A1 · Li · 2015 [cited by examiner]
US 20160125268A1 · Ebiyama · 2016 [cited by examiner]
US 20170161905A1 · Reyzin · 2017 [cited by examiner]
US 20170263037A1 · Maruyama · 2017 [cited by examiner]
US 20170330050A1 · Baltsén · 2017 [cited by examiner]
US 20170358094A1 · Sun · 2017 [cited by examiner]
US 20180144476A1 · Smith · 2018 [cited by examiner]
US 20180255326A1 · Oya · 2018 [cited by examiner]
US 20180365809A1 · Cutler · 2018 [cited by examiner]
US 20190052868A1 · Na · 2019 [cited by examiner]
US 20190104253A1 · Kawai · 2019 [cited by examiner]
US 20190180107A1 · Pham · 2019 [cited by examiner]
US 20190347776A1 · Chou · 2019 [cited by examiner]
US 20200273152A1 · Lin · 2020 [cited by examiner]
US 20200402243A1 · Benou · 2020 [cited by examiner]
US 20210004943A1 · Fukasawa · 2021 [cited by examiner]
US 20210166399A1 · Stephens · 2021 [cited by examiner]
US 20210209734A1 · Simhadri et al. · 2021 [cited by applicant]
US 20210243383A1 · Huang · 2021 [cited by examiner]
US 20220109838A1 · Guruva Reddiar · 2022 [cited by examiner]
US 20220215531A1 · Azernikov et al. · 2022 [cited by applicant]
US 20220256116A1 · Chu · 2022 [cited by examiner]
US 20230014805A1 · Verma · 2023 [cited by examiner]
US 20230026038A1 · Iwakiri · 2023 [cited by examiner]
US 20230044969A1 · Yang et al. · 2023 [cited by applicant]
US 20230063678A1 · Janus · 2023 [cited by examiner]
US 20230224582A1 · Awasthi · 2023 [cited by examiner]
US 20240029472A1 · Shen · 2024 [cited by examiner]
US 20240031517A1 · Liu · 2024 [cited by examiner]
US 20240054608A1 · Shen · 2024 [cited by examiner]
US 20240104742A1 · Xu · 2024 [cited by examiner]
US 20240153038A1 · Duan · 2024 [cited by examiner]
US 20240404017A1 · Xiang · 2024 [cited by examiner]
CN 110232326A · 2019 [cited by applicant]
A machine translated English version of document CN 110232326 (Year: 2019). [cited by applicant]
Howard, Andrew et al, “Searching for MobileNetV3”, arXiv:1905.02244v5, Nov. 20, 2019, 11 pages. [cited by applicant]
Mingyang et al, “An End-to-End Atrous Spatial Pyramid Pooling and Skip-Connections Generative Adversarial Segmentation Network for Building Extraction from High-Resolution Aerial Images”, vol. 12, 5151, Applied Sciences… [cited by applicant]
Goswami, G., et al., “RGB-D face recognition with texture and attribute features.”, IEEE Transactions on Information Forensics and Security, vol. 9, No. 10, 2014, pp. 1629-1640. [cited by applicant]
Jiang, L., et al., “Robust RGB-D face recognition using attribute-aware loss.”, IEEE transactions on pattern analysis and machine intelligence, vol. 42, No. 10, Oct. 2020, pp. 2552-2566. [cited by applicant]