IP Library › Granted Patent US 12,548,176
Granted Patent B2
US 12,548,176 · App. 17/675,461 · Granted Feb 10, 2026

System and method of calibrating a virtual asset for display in an application

Inventors: Glen Siver (Victoria, AU); David Gregory Jones (Medway, MA)
Assignee: BLINXEL PTY LTD
G06T7/521G01B11/24G01S13/08G01S13/867G01S15/08G01S17/08G01S17/89G06T7/251G06T7/80G06T7/90G06V20/20G06V20/64G06V30/142G06V40/103H04N13/189H04N13/271H04N13/344G06T2207/10024G06T2207/10028G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,548,176
App. No.
17/675,461
Granted
Feb 10, 2026
Kind
B2
Abstract

Embodiments generally relate to a machine-implemented method of automatically adjusting the range of a depth data recording executed by at least one processing device. The method comprises determining, by the at least one processing device, at least one positions of a subject to be recorded; determining, by the at least one processing device, at least one spatial range based on the positions of the subject; receiving depth information; and constructing, by the at least one processing device, a depth data recording based on the received depth information limited by the at least one spatial range.

Claims (33)

1 . A machine-implemented method of calibrating content captured during a recording executed by at least one processing device, the method comprising:

displaying, by the processing device during a calibration phase of a recording process, a representation of the content to be recorded in a user interface of a display of the processing device;

displaying, by the processing device, an alignment guide superimposed on the representation of the content in the user interface, the alignment guide providing a visual indication of at least one of a desired scale, a desired location or a desired orientation of the representation of the content with respect to a virtual world;

displaying, by the processing device, input controls on the user interface;

obtaining, by the processing device, user input via the input controls, the user input being indicative of a desired change in alignment of the representation of the content with respect to the virtual world;

determining, by the processing device, a three-dimensional transformation of the representation of the content with respect to the virtual world, the three-dimensional transformation being determined based on the user input;

calibrating, by the processing device, the representation of the content by transferring the three-dimensional transformation to a relationship between the representation of the content and a background scene in a player application in accordance with the user input; and,

providing, by the processing device, the relationship to thereby allow display of the calibrated representation of the content with respect to the background scene in the player application.

2 . The method of claim 1 , wherein the representation of the content includes at least one of a volumetric video recording, a depth data recording, a colour data recording, three-dimensional content, a recorded image, and a texture.

3 . The method of claim 1 , wherein the player application comprises any one of a virtual reality application and an augmented reality application.

4 . The method of claim 1 , wherein the representation of the content includes colour data and depth data.

5 . The method of claim 1 , wherein the calibrating includes updating the three-dimensional transformation in accordance with further user input.

6 . The method of claim 1 , further comprising displaying on the display of the processing device a prompt, wherein the prompt encourages lining up the representation of the content with the alignment guide.

7 . The method of claim 1 , wherein the calibrating further comprises aligning the representation of the content with a previously calibrated scale, location and orientation.

8 . The method of claim 1 , wherein the representation of the content is pre-recorded.

9 . The method of claim 1 , wherein the relationship defines a calibrated transformation of the representation of the content with respect to the background scene in the player application.

10 . The method of claim 1 , wherein the alignment guide comprises a two-dimensional scale element, and a two-dimensional rotate/translate element oriented perpendicularly to the two-dimensional scale element.

11 . The method of claim 10 , wherein the scale element shows a scale of the representation of the content with respect to the background scene which the representation of the content is configured to be inserted against.

12 . The method of claim 10 , wherein the rotate/translate element shows a rotation of the representation of the content with respect to the background scene which the representation of the content is configured to be inserted against.

13 . The method of claim 10 , wherein the rotate/translate element shows a position of the representation of the content with respect to the background scene which the representation of the content is configured to be inserted against.

14 . The method of claim 1 , wherein the alignment guide comprises a three-dimensional element.

15 . The method of claim 1 , wherein the representation of the content is a three-dimensional video recording of a human subject.

16 . The method of claim 1 , wherein the three-dimensional transformation comprises at least one of a translation, rotation, scale, skew, oblique and perspective transformations.

17 . The method of claim 1 , wherein the three-dimensional recording is a holographic recording.

18 . The method of claim 17 , wherein the holographic recording includes a human subject isolated from any environment.

19 . A machine-implemented method of calibrating a content captured during a recording of a subject executed by at least one processing device, the method comprising:

displaying, by the processing device during a calibration phase of a recording process, a representation of the subject to be recorded in a user interface of a display of the processing device;

displaying, by the processing device, an alignment guide superimposed on the representation of the subject in the user interface, the alignment guide providing a visual indication of at least one of a desired scale, a desired location or a desired orientation of the representation of the subject with respect to a virtual world;

displaying, by the processing device, input controls on the user interface;

obtaining, by the processing device, user input via the input controls, the user input being indicative of a desired three-dimensional transformation of the representation of the subject with respect to the alignment guide;

calibrating, by the processing device, the representation of the subject by applying the three-dimensional transformation in accordance with the user input; and,

providing, by the processing device, the applied transformation to thereby allow display of the calibrated representation of the subject with respect to a background scene in a player application.

20 . The method of claim 19 , wherein the representation of the subject includes at least one of a volumetric video recording, three-dimensional content, a depth data recording, a colour data recording, a recorded image, and a texture.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 25, 2022
From: SIVER, GLEN; JONES, DAVID GREGORY
To: BLINXEL PTY LTD
Reel/Frame 060905/0057 →
Priority Claims (1)
AU 2015904066 · Oct 6, 2015 · national
Continuity (3)
Continuation 16888229 · May 29, 2020
Continuation 15766697
Related Publication 20230045393A1 · Feb 9, 2023
References Cited (23)
US 9754167B1 · Holz · 2017 [cited by examiner]
US 10699428B2 · Siver · 2020 [cited by applicant]
US 20100278431A1 · Mathe et al. · 2010 [cited by applicant]
US 20120113141A1 · Zimmerman · 2012 [cited by examiner]
US 20120306907A1 · Huston · 2012 [cited by applicant]
US 20120308115A1 · Sun · 2012 [cited by examiner]
US 20130033582A1 · Sun · 2013 [cited by examiner]
US 20140063061A1 · Reitan · 2014 [cited by examiner]
US 20140176530A1 · Pathre · 2014 [cited by examiner]
US 20140306866A1 · Miller · 2014 [cited by examiner]
US 20150249817A1 · Roelen · 2015 [cited by examiner]
US 20150304531A1 · Rodriguez Garcia · 2015 [cited by examiner]
US 20160037152A1 · Kim et al. · 2016 [cited by applicant]
US 20170249503A1 · Guo et al. · 2017 [cited by applicant]
US 20180053309A1 · Maani et al. · 2018 [cited by applicant]
US 20180275848A1 · Tuukkanen · 2018 [cited by examiner]
US 20190019303A1 · Siver et al. · 2019 [cited by applicant]
US 20200402248A1 · Siver et al. · 2020 [cited by applicant]
Han, J. et al., “Enhanced computer vision with Microsoft Kinect Sensor: A review”, IEEE Transactions on cybernetics 2013, vol. 43, No. 5, pp. 1318-1334. [cited by applicant]
Office Action for U.S. Appl. No. 16/888,229, mailed on 06/189/2021, Siver, “Volumetric depth video recording and playback ”, 12 Pages. [cited by applicant]
Non Final Office Action dated Sep. 12, 2019 for U.S. Appl. No. 15/766,697 “Volumetric depth video recording and playback” Siver, 17 pages. [cited by applicant]
PCT Search Report for corresponding International Application No. PCT/AU2016/050938 dated Feb. 2, 2017, 7 pages. [cited by applicant]
Zhang, C. et al., “Calibration between depth and color sensors for commodity depth cameras”, Proc. IEEE EMBC (2011), pp. 1-6. [cited by applicant]