IP Library › Granted Patent US 12,198,249
Granted Patent B2
US 12,198,249 · App. 17/552,997 · Granted Jan 14, 2025

Method and device for displaying details of a texture of a three-dimensional object

Inventor: Martin Enthed (Steninge, SE)
Assignee: Inter IKEA Systems B.V.
G06T15/04G06N3/08G06T15/205G06T17/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,198,249
App. No.
17/552,997
Granted
Jan 14, 2025
Kind
B2
Abstract

A computer implemented method for displaying details of a texture of a three-dimensional, 3D, object, wherein the texture comprises a periodic pattern, is provided. The method comprises, while zooming in on the 3D object: determining a portion of the 3D object, wherein the determined portion of the 3D object corresponds to a zoom level; displaying the determined portion of the 3D object including a corresponding portion of the texture. The method further comprises, upon the zoom level reaching a zoom-in threshold, executing a 3D to 2D transition comprising: identifying a two-dimensional, 2D, image representing the texture of the currently displayed portion of the 3D object from a set of 2D images, each 2D image of the set of 2D images representing the texture of the 3D object at a specific of portion of the 3D object, wherein at least one 2D image of the set of 2D images represents the texture of the 3D object at a plurality of portions of the 3D object; wherein a resolution of the 2D image is higher than a resolution of the texture of the portion of the 3D object at the zoom-in threshold.

Claims (34)

1. A computer implemented method for displaying details of a texture of a three-dimensional, 3D, object, the texture comprising a periodic pattern, the method comprising:

providing a set of two-dimensional, 2D, images, wherein each 2D image of the set of 2D images represents the texture of the 3D object at a plurality of nonadjacent portions of the 3D object;

displaying a portion of the 3D object on a display;

zooming in on the 3D object, whereby the portion of the 3D object displayed on the display gradually decreases in size;

upon a size of the portion of the 3D object displayed on the display falling below a first threshold size, identifying a 2D image from the set of 2D images by finding a best correspondence between the texture of the portion of the 3D object displayed on the display and the 2D images of the set of 2D images, wherein a level of detail of the identified 2D image is larger than a level of detail of the texture of the portion of the 3D object displayed on the display; and

upon a size of the portion of the 3D object displayed on the display falling below a second threshold size, executing a 3D to 2D transition comprising:

hiding the 3D object and displaying the identified 2D image on the display.

2. The method according to claim 1 , wherein the 3D to 2D transition further comprises, prior to hiding the 3D object and displaying the identified 2D image, gradually shifting a view direction of the portion of the 3D object displayed on the display to be parallel with a surface normal of a surface of the portion of the 3D object displayed on the display.

3. The method according to claim 1 , further comprising determining an identifier of the 3D object, thereby determining the set of 2D images.

4. The method according to claim 1 , wherein finding the best correspondence between the texture of the portion of the 3D object displayed on the display and the images of the set of 2D images comprises inputting a sample of the texture of the portion of the 3D object displayed on the display in a neural network being trained to output a 2D image representing a best match.

5. The method according to claim 1 , wherein finding the best correspondence between the texture of the portion of the 3D object displayed on the display and the images of the set of 2D images comprises performing an image comparison between a sample of the texture of the portion of the 3D object and each 2D image in the set of 2D images.

6. The method according to claim 1 , wherein finding the best correspondence between the texture of the portion of the 3D object displayed on the display and the images of the set of 2D images comprises accessing a conversion table between specific portions of the 3D object and the 2D images in the set of 2D images.

7. The method according to claim 1 , wherein the 3D to 2D transition further comprises displaying a merge of the portion of the 3D object and the 2D image.

8. The method according to claim 7 , wherein the merge of the portion of the 3D object and the 2D image is set to gradually change from 100% of the portion of the 3D object to 100% of the 2D image.

9. The method according to claim 1 , further comprising zooming and/or panning in the 2D image.

10. The method according to claim 9 , further comprising, upon a zoom level in the 2D image reaches a zoom-out threshold, executing a 2D to 3D transition comprising displaying a portion of the 3D object corresponding to a currently displayed portion of the 2D image.

11. A non-transitory computer-readable storage medium having stored thereon program code portions which, when executed on a device having processing capabilities, cause the device to:

provide a set of two-dimensional, 2D, images, wherein each 2D image of the set of 2D images represents a texture of the 3D object at a plurality of nonadjacent portions of the 3D object;

display a portion of the 3D object on a display;

zoom in on the 3D object, whereby the portion of the 3D object displayed on the display gradually decreases in size;

upon a size of the portion of the 3D object displayed on the display falling below a first threshold size, identify a 2D image from the set of 2D images by finding a best correspondence between the texture of the portion of the 3D object displayed on the display and the 2D images of the set of 2D images, wherein a level of detail of the identified 2D image is larger than a level of detail of the texture of the portion of the 3D object displayed on the display; and

upon a size of the portion of the 3D object displayed on the display falling below a second threshold size, execute a 3D to 2D transition comprising:

hide the 3D object and display the identified 2D image on the display.

12. An electronic device comprising:

a display configured for displaying details of a texture of a three-dimensional, 3D, object, the texture comprising a periodic pattern; and

circuitry configured to:

provide a set of two-dimensional, 2D, images, wherein each 2D image of the set of 2D images represents the texture of the 3D object at a plurality of nonadjacent portions of the 3D object;

display a portion of the 3D object on the display;

zoom in on the 3D object, whereby the portion of the 3D object displayed on the display gradually decreases in size;

upon a size of the portion of the 3D object displayed on the display falling below a first threshold size, identify a 2D image from the set of 2D images by finding a best correspondence between the texture of the portion of the 3D object displayed on the display and the 2D images of the set of 2D images, wherein a level of details of the identified 2D image is larger than a level of details of the texture of the portion of the 3D object displayed on the display; and

upon a size of the portion of the 3D object displayed on the display falling below a second threshold size, execute a 3D to 2D transition comprising:

hide the 3D object and display the identified 2D image on the display.

13. The electronic device according to claim 12 , wherein the 3D to 2D transition further comprises, prior to hiding the 3D object and displaying the identified 2D image, gradually shifting a view direction of the 3D object to be parallel with a surface normal of the portion of a surface of the 3D object displayed on the display.

14. The electronic device according to claim 12 , wherein the display is one of: smartphone display, a computer display, a tablet display, a TV, smart glasses, an augmented reality device, or a virtual reality device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 16, 2021
From: ENTHED, MARTIN
To: INTER IKEA SYSTEMS B.V.
Reel/Frame 058409/0718 →
Priority Claims (1)
EP 20215009 · Dec 17, 2020 · regional
Continuity (1)
Related Publication 20220198737A1 · Jun 23, 2022
References Cited (24)
US 20030206176A1 · Ritter · 2003 [cited by examiner]
US 20100289825A1 · Shin · 2010 [cited by examiner]
US 20130162633A1 · Berger · 2013 [cited by examiner]
US 20140232734A1 · Nigam · 2014 [cited by examiner]
US 20140267346A1 · Ren · 2014 [cited by examiner]
US 20140323801A1 · Konno · 2014 [cited by examiner]
US 20140354628A1 · Lindberg · 2014 [cited by examiner]
US 20150121297A1 · Ying · 2015 [cited by examiner]
US 20150161823A1 · Anderson-Sprecher · 2015 [cited by examiner]
US 20150269785A1 · Bell · 2015 [cited by examiner]
US 20150325044A1 · Lebovitz · 2015 [cited by examiner]
US 20180075641A1 · Ceylan · 2018 [cited by examiner]
US 20180144547A1 · Shakib · 2018 [cited by examiner]
US 20180158246A1 · Grau · 2018 [cited by examiner]
US 20180247446A1 · Litvin · 2018 [cited by examiner]
US 20180329609A1 · De Swarte · 2018 [cited by examiner]
US 20190156459A1 · Chen · 2019 [cited by examiner]
US 20200005550A1 · Schneider · 2020 [cited by examiner]
US 20200341607A1 · Tandon · 2020 [cited by examiner]
US 20210182947A1 · Wade · 2021 [cited by examiner]
US 20210383115A1 · Alon · 2021 [cited by examiner]
WO 2015142649A1 · 2015 [cited by applicant]
Extended European Search Report for EP Application No. 20215009.0 mailed May 26, 2021 (8 pages). [cited by applicant]
PCT International Search Report and Written Opinion for PCT Application No. PCT/EP2021/086179 mailed Mar. 17, 2022 (13 pages). [cited by applicant]