IP Library Granted Patent US 12,406,753
Granted Patent B2
US 12,406,753 · App. 18/834,427 · Granted Sep 2, 2025

Diagnostic laboratory systems and methods of imaging tube assemblies

Inventors: Yao-Jen Chang (Princeton, NJ); Vivek Singh (Princeton, NJ); Boris Mailhe (Plainsboro, NJ); Benjamin S. Pollack (Jersey City, NJ); Ankur Kapoor (Plainsboro, NJ)
Assignee: Siemens Healthcare Diagnostics Inc.
G16H10/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,406,753
App. No.
18/834,427
Granted
Sep 2, 2025
Kind
B2
Abstract

A method of synthesizing an image of a tube assembly includes capturing an image of the tube assembly, wherein the capturing generates a captured image. The captured image is decomposed into a plurality of features in latent space using a trained image decomposition model. One or more of the features in the latent space is manipulated into one or more manipulated features. A synthesized tube assembly image is generated with at least one of the manipulated features using a trained image composition model. Other methods and systems are disclosed.

Claims (34)

1. A method of synthesizing an image of a tube assembly, comprising:

capturing an image of a tube assembly, the capturing generating a captured image;

decomposing the captured image into a plurality of features in latent space using a trained image decomposition model;

manipulating one or more of the features in the latent space into manipulated features; and

generating a synthesized tube assembly image with at least one of the manipulated features using a trained image composition model.

2. The method of claim 1 , further comprising training an image decomposition model and an image composition model using at least an image of a first tube assembly and an image of a second tube assembly, wherein there are one or more known variations between the image of the first tube assembly and the image of the second tube assembly, the training producing the trained mage image decomposition model and the trained image composition model.

3. The method of claim 2 , wherein the training the decomposition model is at least partially based on a reconstruction loss between synthesized images and input images.

4. The method of claim 1 , wherein the tube assembly comprises a tube and a cap and at least one of the plurality of features is tube geometry, tube color, tube surface property, cap geometry, cap color, or lighting condition.

5. The method of claim 1 , wherein the tube assembly comprises a tube and at least one of the plurality of features is tube geometry, tube material, sample fluid in the tube, label affixed to the tube, or lighting condition of the tube.

6. A method of synthesizing images of tube assemblies, comprising:

constructing an image decomposition model configured to receive input images of tube assemblies and to decompose the input images into a plurality of features in a latent space;

constructing an image composition model configured to compose synthetic tube assembly images based on the plurality of features in the latent space; and

training the image decomposition model and the image composition model using at least an image of a first tube assembly and an image of a second tube assembly with one or more known variations between the image of the first tube assembly and the image of the second tube assembly, wherein the training produces a trained image decomposition model and a trained image composition model.

7. The method of claim 6 , further comprising:

capturing an image of a tube assembly, the capturing generating a captured image;

decomposing the captured image into a plurality of decomposed features in the latent space using the trained image decomposition model;

manipulating one or more of the decomposed features in the latent space into manipulated features; and

generating a synthesized tube assembly image with at least one of the manipulated features using the trained image composition model.

8. The method of claim 6 , wherein the training the decomposition model is at least partially based on a reconstruction loss between synthesized images and input images.

9. The method of claim 6 , wherein the image composition model is trained based on a reconstruction loss between synthesized images and input images.

10. The method of claim 6 , wherein at least one of the features in the latent space is generated using computer-generated imagery.

11. The method of claim 6 , wherein images of at least two of the tube assemblies differ from each other with one or more controlled attributes.

12. The method of claim 6 , wherein images of at least two tube assemblies share one or more attributes in common.

13. The method of claim 6 , wherein at least one of the image decomposition model or the image composition model is trained based on a reconstruction loss without the images of the tube assemblies.

14. The method of claim 6 , wherein the tube assemblies comprise a tube and a cap and at least one of the plurality of features in the latent space is tube geometry, tube color, tube surface property, cap color, cap geometry, or lighting condition.

15. The method of claim 6 , wherein the tube assemblies comprise a tube and at least one of the plurality of features in the latent space is tube geometry, tube material, sample fluid in the tube, label affixed to the tube, or lighting condition of the tube.

16. The method of claim 6 , wherein one or more features in the latent space include a fluid property in a tube assembly.

17. A diagnostic laboratory system, comprising:

an image decomposition model configured to receive input images of tube assemblies and to decompose the input images into a plurality of features in a latent space; and

an image composition model configured to compose synthetic tube assembly images based on the plurality of features in the latent space,

wherein the image decomposition model and the image composition model are trained using at least an image of a first tube assembly and an image of a second tube assembly with one or more known variations between the image of the first tube assembly and the image of the second tube assembly.

18. The diagnostic laboratory system of claim 17 , wherein the image decomposition model is trained at least partially based on a reconstruction loss between synthesized images and input images.

19. The diagnostic laboratory system of claim 17 , wherein the image composition model is trained based on a reconstruction loss between synthesized images and input images.

20. The diagnostic laboratory system of claim 17 , wherein the tube assemblies comprise a tube and a cap and at least one of the plurality of features in the latent space is tube geometry, tube color, tube surface property, cap color, cap geometry, or lighting condition.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 31, 2024
From: CHANG, YAO-JEN; SINGH, VIVEK; MAILHE, BORIS; KAPOOR, ANKUR
To: SIEMENS MEDICAL SOLUTIONS USA, INC.
Reel/Frame 068141/0231 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 31, 2024
From: POLLACK, BENJAMIN S.
To: SIEMENS HEALTHCARE DIAGNOSTICS INC.
Reel/Frame 068141/0318 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 31, 2024
From: SIEMENS MEDICAL SOLUTIONS USA, INC.
To: SIEMENS HEALTHCARE DIAGNOSTICS INC.
Reel/Frame 068141/0407 →
Continuity (2)
Provisional Application 63268846 · Mar 3, 2022
Related Publication 20250166748A1 · May 22, 2025
References Cited (56)
US 9704054B1 · Tappen · 2017 [cited by examiner]
US 10140705B2 · Wu et al. · 2018 [cited by applicant]
US 10207402B2 · Levine et al. · 2019 [cited by applicant]
US 10290090B2 · Chang et al. · 2019 [cited by applicant]
US 10319092B2 · Wu et al. · 2019 [cited by applicant]
US 10325182B2 · Soomro et al. · 2019 [cited by applicant]
US 10668622B2 · Pollack · 2020 [cited by examiner]
US 10725060B2 · Chang et al. · 2020 [cited by applicant]
US 10974394B2 · Benaim et al. · 2021 [cited by applicant]
US 20150278625A1 · Finkbeiner et al. · 2015 [cited by applicant]
US 20170285122A1 · Kaditz et al. · 2017 [cited by applicant]
US 20190294923A1 · Riley · 2019 [cited by examiner]
US 20200051017A1 · Dujmic · 2020 [cited by applicant]
US 20210125065A1 · Turcot et al. · 2021 [cited by applicant]
US 20210303818A1 · Randolph et al. · 2021 [cited by applicant]
US 20210374519A1 · Chen et al. · 2021 [cited by applicant]
US 20220076395A1 · Amthor et al. · 2022 [cited by applicant]
US 20220114725A1 · Amthor et al. · 2022 [cited by applicant]
CN 114065874A · 2022 [cited by applicant]
EP 1394727B1 · 2011 [cited by applicant]
JP 2009223437A · 2009 [cited by applicant]
JP 2021107810A · 2021 [cited by applicant]
WO 2020027923A1 · 2020 [cited by applicant]
WO 2020070876A1 · 2020 [cited by applicant]
WO 2021086725A1 · 2021 [cited by applicant]
WO 2021188596A1 · 2021 [cited by applicant]
WO 2021225876A1 · 2021 [cited by applicant]
WO 2022174240A1 · 2022 [cited by applicant]
WO 2022174241A1 · 2022 [cited by applicant]
WO 2022254600A1 · 2022 [cited by applicant]
WO 2022266628A1 · 2022 [cited by applicant]
WO 2023283583A1 · 2023 [cited by applicant]
WO WO2023168366A2 · 2023 [cited by examiner]
Bochkovskiy, Alexey, et al. “Yolov4: Optimal speed and accuracy of object detection.” arXiv preprint arXiv:2004.10934, 2020. [cited by applicant]
Kupyn, Orest, et al. “Deblurgan-v2: Deblurring (orders-of-magnitude) faster and better.” Proceedings of the IEEE/CVF international conference on computer vision. pp. 8878-8887. 2019. [cited by applicant]
Wojke, Nicolai, et al. “Simple online and realtime tracking with a deep association metric.” 2017 IEEE international conference on image processing (ICIP). IEEE, 2017. [cited by applicant]
International Search Report and Written Opinion of International Application No. PCT/US2023/063622 dated Oct. 4, 2023. [cited by applicant]
Gat et al., “Latent Space Explanation by Intervention”; published: 2021; pp. 1-9; Retrieved from the Internet:<URL: https://arxiv.org/pdf/2112.04895.pdf>. [cited by applicant]
Tiu et al., “Understanding Latent Space in Machine Learning”; Towards Data Science; published: Feb. 4, 2020; pp. 2-6; Retrieved from the Internet:<https://towardsdatascience.com/understanding-latent-space-in-machine-lea… [cited by applicant]
Liu et al., “Latent Space Cartography: Visual Analysis of Vector Space Embeddings”; pp. 1-12; Computer Graphics Forum: Eurographics Conference on Visualization (EuroVis) 2019; vol. 38; nr. 3; published: 2019. [cited by applicant]
Sengupta et al. “SfSNet: Learning Shape, Reflectance and Illuminance of Faces in the Wild,” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018, pp. 6296-6305. [cited by applicant]
Shoshan et al., “GAN-Control: Explicitly Controllable GANs,” arXiv:2101.02477, v1, Jan. 2021. [cited by applicant]
Lee et al., “Diverse Image-to-Image Translation via Disentangled Representations,” ECCV 2018. [cited by applicant]
Arash Vahdat, Jan Kautz, “NVAE: A Deep Hierarchical Variational Autoencoder” 34th Conference on Neural Information Processing Systems (NeurIPS 2020), pp. 1-21. [cited by applicant]
Razavi et al., “Generating diverse high-fidelity images with vq-vae-2.” Advances in neural information processing systems 32 (2019). [cited by applicant]
Chen, Fu Shang et al.:; “Representation Decomposition for Image Manipulation and Beyond”; https://doi. org/10.48550/arXiv.2011.00788; Published at IEEE International Conference in Image Processing (ICIP) 2021; 19.09.201… [cited by applicant]
Kazemi, Hadi et al.:; “Style and Content Disentanglement in Generative Adversarial Networks”; Computer Vision and Pattern Recognition (cs.CV); pp. 848-856; XP033525705; 07.01.2019. [cited by applicant]
Awiszus Maren et al.:; “Learning Disentangled Representations via Independent Subspaces”; Accepted at ICCV 2019 Workshop on Robust Subspace Learning and Applications in Computer Vision; pp. 560-568; 27.10.2019; XP033732… [cited by applicant]
Chen, T., Kornblith, S., Norouzi, M., & Hinton, G. (Oct. 26, 2020). A simple framework for contrastive learning of visual representations. In International conference on machine learning (pp. 1597-1607). PMLR. [cited by applicant]
Chen, T., Kornblith, S., Swersky, K., Norouzi, M., & Hinton, G. E. (Jul. 1, 2020). Big self-supervised models are strong semi-supervised learners. Advances in neural information processing systems, 33, 22243-22255. [cited by applicant]
Grill, J.B., Strub, F., Altche, F., Tallec, C., Richemond, P., Buchatskaya, E., Doersch, C., Avila Pires, B., Guo, Z., Gheshlaghi Azar, M. and Piot, B., (Sep. 10, 2020). Bootstrap your own latent-a new approach to self-… [cited by applicant]
He, K., Fan, H., Wu, Y., Xie, S., & Girshick, R. (Mar. 23, 2020). Momentum contrast for unsupervised visual representation learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (… [cited by applicant]
Tan, M., & Le, Q. (Jun. 23, 2021). EfficientNetV2: Smaller models and faster training. In International conference on machine learning (pp. 10096-10106). PMLR. [cited by applicant]
Zbontar, J., Jing, L., Misra, I., LeCun, Y., & Deny, S. (Jun. 14, 2021). Barlow twins: Self-supervised learning via redundancy reduction. In International conference on machine learning (pp. 12310-12320). PMLR. [cited by applicant]
Beck Michael A et al: “An embedded system for the automated generation of labeled plant images to enable machine learning applications, in agriculture”, Arxiv.Org, Cornell University Library, 201 Olin Library Cornell Un… [cited by applicant]
Marion Pat et al: “Label Fusion: A Pipeline for Generating Ground Truth Labels for Real RGBD Data of Cluttered Scenes”, 2018 IEEE International Conference On Robotics and Automation (ICRA) , IEEE, May 21, 2018 (May 21, … [cited by applicant]