IP Library Granted Patent US 12,406,320
Granted Patent B2
US 12,406,320 · App. 17/468,185 · Granted Sep 2, 2025

Image-based pose determination

Inventors: Geoffrey B. Rhoads (West Linn, OR); Tony F. Rodriguez (Portland, OR); Ravi K. Sharma (Portland, OR); Tomas Filler (Beaverton, OR); Vahid Sedighianaraki (Portland, OR)
Assignee: Digimarc Corporation
G06T1/0092G06T1/0064G06T3/02G06T7/32G06T7/74G06T2201/0051G06T2201/0052G06T2201/0061G06T2201/0065G06T2201/0601G06T2207/20021G06T2207/20048G06T2207/20081G06T2207/30244
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,406,320
App. No.
17/468,185
Granted
Sep 2, 2025
Kind
B2
Abstract

A steganographic digital watermark signal is decoded from host imagery without requiring a domain transformation for signal synchronization, thereby speeding and simplifying the decoding operation. In time-limited applications, such as in supermarket point-of-sale scanners that attempt watermark decode operations on dozens of video frames every second, the speed improvement allows a greater percentage of each image frame to be analyzed for watermark data. In battery-powered mobile devices, avoidance of repeated domain transformations extends battery life. A great variety of other features and arrangements, including machine learning aspects, are also detailed.

Claims (31)

1. A method comprising the acts:

applying data associated with input image data to a convolutional neural network;

receiving pose information output from the convolutional neural network; and

extracting a previously-encoded data payload from a pattern depicted in the input image data using the pose information to yield an extracted data payload.

2. The method of claim 1 in which said data associated with the input image data comprises pixel data, histogram data, L-tuple data, or oct-axis data.

3. The method of claim 2 that includes deriving histogram data from the data associated with the input image data, and applying said histogram data to the convolutional neural network.

4. The method of claim 2 that includes deriving L-tuple data from the data associated with the input image data, and applying said L-tuple data to the convolutional neural network.

5. The method of claim 2 that includes deriving oct-axis data from the data associated with the input image data, and applying said oct-axis data to the convolutional neural network.

6. The method of claim 1 in which the pose information indicates two more of rotation, scale or translation information.

7. The method of claim 1 that includes decoding a plural-bit payload from the extracted data payload.

8. The method of claim 1 that includes decoding a plural-bit payload from the extracted data payload.

9. The method of claim 8 that includes overlaying a visual augmentation on the input image data in accordance with the pose information and in accordance with the plural-bit payload.

10. The method of claim 1 that includes determining a distance to each of several patches on a surface of an object depicted in the input image data from the pose information.

11. The method of claim 10 that includes generating a 3D model of the object using said determined distances.

12. A non-transitory computer-readable medium having instructions that configure a programmable system to perform acts including:

applying data associated with input image data to a convolutional neural network;

receiving pose information output from the convolutional neural network; and

extracting a previously-encoded data payload from a pattern depicted in the input image data using the pose information to yield an extracted data payload.

13. A system including one or more hardware processors and associated memory, the one or more hardware processors being configured to:

apply data associated with input image data to a convolutional neural network;

receive pose information output from the convolutional neural network; and

extract a previously-encoded data payload from a pattern depicted in the input image data using the pose information to yield an extracted data payload.

14. The system of claim 13 in which the one or more hardware processors are further configured to implement said convolutional neural network, employing parameters and weights stored in said associated memory.

15. The system of claim 13 in which the data associated with the input image data comprises pixel data, histogram data, L-tuple data, or oct-axis data.

16. The system of claim 13 in which the one or more processors are configured to derive histogram data from the data associated with the input image data, and apply said histogram data to the convolutional neural network.

17. The system of claim 13 in which the one or more processors are configured to derive L-tuple data from the data associated with the input image data, and apply said L-tuple data to the convolutional neural network.

18. The system of claim 13 in which the one or more processors are configured to derive oct-axis data from the data associated with the input image data, and apply said oct-axis data to the convolutional neural network.

19. The system of claim 13 in which the pose information indicates two more of rotation, scale or translation information.

20. The system of claim 13 in which the one or more processors are configured to decode a plural-bit payload from the extracted data payload.

21. The system of claim 13 in which the one or more processors include an Application Specific Integrated Circuit (ASIC).

22. The system of claim 13 in which the one or more processors include a Field Programmable Gate Array (FPGA).

Assignments (3)
ARTICLES OF CONVERSION Recorded Jun 19, 2026
From: DIGIMARC CORPORATION
To: DIGIMARC LLC
Reel/Frame 075863/0211 →
ARTICLES OF AMENDMENT OFTHE ARTICLES OF ORGANIZATION OF DIGIMARC LLC Recorded Jun 19, 2026
From: DIGIMARC LLC
To: DMRC LLC
Reel/Frame 075863/0266 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 7, 2021
From: SEDIGHIANARAKI, VAHID; SHARMA, RAVI K.; RODRIGUEZ, TONY F.; RHOADS, GEOFFREY B.; FILLER, TOMAS
To: DIGIMARC CORPORATION
Reel/Frame 057402/0166 →
Continuity (8)
Division 16714384 · Dec 13, 2019
Continuation 15641081 · Jul 3, 2017
Provisional Application 62379578 · Aug 25, 2016
Provisional Application 62371601 · Aug 5, 2016
Provisional Application 62366571 · Jul 25, 2016
Provisional Application 62363152 · Jul 15, 2016
Provisional Application 62357879 · Jul 1, 2016
Related Publication 20220114693A1 · Apr 14, 2022
References Cited (77)
US 5862260A · Rhoads · 1999 [cited by applicant]
US 6442284B1 · Gustafson · 2002 [cited by applicant]
US 6483927B2 · Brunk · 2002 [cited by applicant]
US 6516079B1 · Rhoads · 2003 [cited by applicant]
US 6580809B2 · Stach · 2003 [cited by applicant]
US 6590996B1 · Reed · 2003 [cited by applicant]
US 6614914B1 · Rhoads · 2003 [cited by applicant]
US 6625297B1 · Bradley · 2003 [cited by applicant]
US 6631198B1 · Hannigan · 2003 [cited by applicant]
US 6700991B1 · Wu · 2004 [cited by applicant]
US 6724914B2 · Brundage · 2004 [cited by applicant]
US 6912295B2 · Reed · 2005 [cited by applicant]
US 7013021B2 · Sharma · 2006 [cited by applicant]
US 7058979B1 · Baudry · 2006 [cited by applicant]
US 7072490B2 · Stach · 2006 [cited by applicant]
US 7231061B2 · Bradley · 2007 [cited by applicant]
US 7688996B2 · Bradley · 2010 [cited by applicant]
US 8199969B2 · Reed · 2012 [cited by applicant]
US 8983120B2 · Reed · 2015 [cited by applicant]
US 9325878B2 · Reed · 2016 [cited by applicant]
US 9594983B2 · Alattar · 2017 [cited by applicant]
US 9690967B1 · Brundage · 2017 [cited by applicant]
US 9716807B2 · Holub · 2017 [cited by applicant]
US 10594689B1 · Weaver · 2020 [cited by applicant]
US 10902539B2 · Rodriguez · 2021 [cited by applicant]
US 11102201B2 · Weaver · 2021 [cited by applicant]
US 11270103B2 · Rhoads · 2022 [cited by applicant]
US 11625805B2 · Alattar · 2023 [cited by applicant]
US 11704765B2 · Kamath · 2023 [cited by applicant]
US 11979399B2 · Weaver · 2024 [cited by applicant]
US 20030081810A1 · Bradley · 2003 [cited by applicant]
US 20030123698A1 · Murakami · 2003 [cited by examiner]
US 20050018871A1 · Pun · 2005 [cited by applicant]
US 20060013395A1 · Brundage · 2006 [cited by applicant]
US 20070230740A1 · Asano · 2007 [cited by applicant]
US 20090021793A1 · Lu · 2009 [cited by examiner]
US 20090060258A1 · Wang · 2009 [cited by examiner]
US 20100165158A1 · Rhoads · 2010 [cited by applicant]
US 20100325117A1 · Sharma · 2010 [cited by applicant]
US 20120128199A1 · Ono · 2012 [cited by examiner]
US 20120218444A1 · Stach · 2012 [cited by applicant]
US 20130114847A1 · Petrovic · 2013 [cited by applicant]
US 20130183952A1 · Davis · 2013 [cited by applicant]
US 20130314541A1 · Lord · 2013 [cited by applicant]
US 20140023225A1 · Chalamala · 2014 [cited by examiner]
US 20140029809A1 · Rhoads · 2014 [cited by applicant]
US 20140071268A1 · Lord · 2014 [cited by applicant]
US 20140119593A1 · Filler · 2014 [cited by examiner]
US 20140304122A1 · Rhoads · 2014 [cited by applicant]
US 20150030201A1 · Holub · 2015 [cited by applicant]
US 20150055855A1 · Rodriguez · 2015 [cited by applicant]
US 20160055606A1 · Petrovic · 2016 [cited by examiner]
US 20160063359A1 · Szegedy · 2016 [cited by examiner]
US 20160174902A1 · Georgescu · 2016 [cited by examiner]
US 20160189381A1 · Rhoads · 2016 [cited by applicant]
US 20160217547A1 · Stach · 2016 [cited by applicant]
US 20170329942A1 · Choi · 2017 [cited by examiner]
US 20200184592A1 · Baluja · 2020 [cited by applicant]
US 20210233204A1 · Alattar · 2021 [cited by applicant]
US 20220270199A1 · Rodriguez · 2022 [cited by applicant]
US 20230325960A1 · Rodriguez · 2023 [cited by applicant]
US 20240104682A1 · Kamath · 2024 [cited by applicant]
Artificial Neural Network, Wikipedia article archived Jul. 2, 2017. [cited by applicant]
Backpropagation, Wikipedia article archived Jul. 2, 2017. [cited by applicant]
Supervised Learning, Wikipedia article archived Jun. 30, 2017. [cited by applicant]
Kernel (Image Processing), Wikipedia article archived Jun. 24, 2017. [cited by applicant]
International Search Report and Written Opinion dated Jan. 16, 2018 in counterpart application PCT/US2017/040610. [cited by applicant]
Kouskouridas, et al, Efficient representation and feature extraction for neural network-based 3D object pose estimation. Neurocomputing, 2013; 120:90-100. [cited by applicant]
Melekhov, et al, Relative Camera Pose Estimation Using Convolutional Neural Networks. arXiv e-prints, May 2017, arXiv-1702.01381v2. [cited by applicant]
Shalnov, et al, Convolutional neural network for camera pose estimation from object detections. The International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, May 2017; 42:1. [cited by applicant]
Wohlhart, et al, Learning descriptors for object recognition and 3d pose estimation. Proceedings of the IEEE conference on computer vision and pattern recognition, 2015, pp. 3109-3118. [cited by applicant]
Ahmadi, Mahdi, et al. “ReDMark: Framework for residual diffusion watermarking on deep networks.” arXiv preprint arXiv:1810.07248v1, Oct. 16, 2018. 14 pages. [cited by applicant]
F. Zhu et al., “Hidden: Hiding Data with Deep Networks,” arXiv preprint arXiv:1807.09937, Jul. 26, 2018. 22 pages. [cited by applicant]
Isac, B., Santhi, V.: A study on digital image and video watermarking schemes using neural networks. International Journal of Computer Applications 12(9) (2011) 1-6. [cited by applicant]
J. Hayes and G. Danezis, “Generating steganographic images via adversarial training” arXiv preprint arXiv:1703.00371v3, Jul. 24, 2017. 9 pages. [cited by applicant]
S. Baluja , “Hiding images in plain sight : Deep steganography” in Advances in Neural Information Processing Systems , pp. 2006-2076, Dec. 4, 2017. [cited by applicant]
Wang, Zihan, et al. “Data hiding with deep learning: A survey unifying digital watermarking and steganography.” arXiv preprint arXiv:2107.09287, Jul. 20, 2021. 35 pages. [cited by applicant]