IP Library Granted Patent US 12,340,010
Granted Patent B2
US 12,340,010 · App. 18/166,131 · Granted Jun 24, 2025

Method and apparatus for acquiring object's attention information and electronic device

Inventors: Guannan Zhang (Beijing, CN); Wanwan Zhao (Beijing, CN); Xiaoyan Zhang (Beijing, CN)
Assignee: LENOVO (BEIJING) LIMITED
G06F3/011G06T7/73G06T15/06G06T19/00G06Q30/0201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,340,010
App. No.
18/166,131
Granted
Jun 24, 2025
Kind
B2
Abstract

A method for acquiring an object's attention information includes: displaying a three-dimensional (3D) virtual image in a virtual scene, the 3D virtual image being a 3D image corresponding to a virtual object in the virtual scene mapped from a physical object; determining a target object of the 3D virtual image displayed in a display area; and based on the target object, determining an attention focus object of the 3D virtual image, the attention focus object belonging to at least a part of the 3D virtual image.

Claims (67)

1. A method for acquiring an object's attention information, comprising:

displaying, at a two-dimensional (2D) display area, a three-dimensional (3D) virtual image in a virtual scene, the 3D virtual image being a 3D image corresponding to a virtual object in the virtual scene mapped from a physical object, the displaying comprising mapping the 3D virtual image to the 2D display area from a viewpoint position in the virtual scene, one or more constituent components of the virtual object corresponding, one-to-one, to one or more constituent components of the physical object;

determining a target object of the 3D virtual image displayed in the 2D display area, the target object being at least a portion of the 3D virtual image displayed in the 2D display area representing a subset of the one or more constituent components of the virtual object; and

based on the target object, determining, without using an eye tracking device, an attention focus object of the 3D virtual image, the attention focus object belonging to at least a part of the 3D virtual image, the attention focus object representing at least one first constituent component of the subset of the one or more constituent components of the virtual object, the attention focus object being indicative of an attention focus of a user on a constituent component of the physical object corresponding to the at least one first constituent component of the virtual object.

2. The method according to claim 1 , wherein determining the target object of the 3D virtual image displayed in the 2D display area comprises:

determining the target object in a sampling area of the 3D virtual image displayed in the 2D display area.

3. The method according to claim 2 , wherein determining the target object in the sampling area of the 3D virtual image displayed in the 2D display area comprises:

determining a current position of a virtual camera in the virtual scene; and

using the current position of the virtual camera as the viewpoint position to determine the target object in the sampling area of the 3D virtual image displayed in the 2D display area.

4. The method according to claim 3 , wherein using the current position of the virtual camera as the viewpoint position to determine the target object in the sampling area of the 3D virtual image displayed in the 2D display area comprises:

determining an image mapping area where the 3D virtual image is mapped into the 2D display area;

using the current position of the virtual camera as an originating point, determining a plurality of rays from the originating point to pass through a plurality of sampling points in the 2D display area; and

based on a sub-mapping area identified by the plurality of rays in the image mapping area, determining the target object identified by the plurality of rays in the 3D virtual image.

5. The method according to claim 1 , wherein:

the target object includes at least one target object area in the 3D virtual image and a display feature of the at least one target object area; and

determining the attention focus object of the 3D virtual image based on the target object includes: determining the attention focus object in the at least one target object area based on the display feature of the at least one target object area.

6. The method according to claim 2 , wherein:

before determining the attention focus object of the 3D virtual image, the method further includes: determining a distribution feature of each part of the target object in the sampling area; and

determining the attention focus object of the 3D virtual image based on the target object includes: determining the attention focus object of the 3D virtual image based on the distribution.

7. The method according to claim 1 , wherein after determining the attention focus object of the 3D virtual image, the method further comprises:

counting a number of times of attention occurrence of the attention focus object; and

storing the number of times of attention occurrence of the attention focus object.

8. The method according to claim 1 , wherein after determining the attention focus object of the 3D virtual image, the method further comprises:

obtaining an attention duration of attention occurrence of the attention focus object; and

accumulating the attention duration of each attention occurrence of the attention focus object.

9. An apparatus for acquiring an object's attention information, comprising:

a memory storing a computer program; and

a processor coupled to the memory and configured to execute the computer program to:

display, at a two-dimensional (2D) display are, a three-dimensional (3D) virtual image in a virtual scene, the 3D virtual image being a 3D image corresponding to a virtual object in the virtual scene mapped from a physical object, the displaying comprising mapping the 3D virtual image to the 2D display area from a viewpoint position in the virtual scene, one or more constituent components of the virtual object corresponding, one-to-one, to one or more constituent components of the physical object;

determine a target object of the 3D virtual image displayed in the 2D display area, the target object being at least a portion of the 3D virtual image displayed in the 2D display area representing a subset of the one or more constituent components of the virtual object; and

based on the target object, determine, without using an eye tracking device, an attention focus object of the 3D virtual image, the attention focus object belonging to at least a part of the 3D virtual image, the attention focus object representing at least one first constituent component of the subset of the one or more constituent components of the virtual object, the attention focus object being indicative of an attention focus of a user on a constituent component of the physical object corresponding to the at least one first constituent component of the virtual object.

10. The apparatus according to claim 9 , wherein when determining the target object of the 3D virtual image displayed in the 2D display area, the processor is further configured to:

determine the target object in a sampling area of the 3D virtual image displayed in the 2D display area.

11. The apparatus according to claim 10 , wherein when determining the target object in the sampling area of the 3D virtual image displayed in the 2D display area, the processor is further configured to:

determine a current position of a virtual camera in the virtual scene; and

use the current position of the virtual camera as the viewpoint position to determine the target object in the sampling area of the 3D virtual image displayed in the 2D display area.

12. The apparatus according to claim 11 , wherein when using the current position of the virtual camera to determine the target object in the sampling area of the 3D virtual image displayed in the 2D display area, the processor is further configured to:

determine an image mapping area where the 3D virtual image is mapped into the 2D display area;

use the current position of the virtual camera as an originating point, determining a plurality of rays from the originating point to pass through a plurality of sampling points in the 2D display area; and

based on a sub-mapping area identified by the plurality of rays in the image mapping area, determine the target object identified by the plurality of rays in the 3D virtual image.

13. The apparatus according to claim 9 , wherein:

the target object includes at least one target object area in the 3D virtual image and a display feature of the at least one target object area; and

determining the attention focus object of the 3D virtual image based on the target object includes: determining the attention focus object in the at least one target object area based on the display feature of the at least one target object area.

14. The apparatus according to claim 10 , wherein:

before determining the attention focus object of the 3D virtual image, the method further includes: determining a distribution feature of each part of the target object in the sampling area; and

determining the attention focus object of the 3D virtual image based on the target object includes: determining the attention focus object of the 3D virtual image based on the distribution.

15. The apparatus according to claim 9 , wherein after determining the attention focus object of the 3D virtual image, the processor is further configured to:

count a number of times of attention occurrence of the attention focus object; and

store the number of times of attention occurrence of the attention focus object.

16. The apparatus according to claim 9 , wherein after determining the attention focus object of the 3D virtual image, the processor is further configured to:

obtain an attention duration of attention occurrence of the attention focus object; and

accumulate the attention duration of each attention occurrence of the attention focus object.

17. An electronic device, comprising an apparatus for acquiring an object's attention information, wherein the apparatus comprises:

a memory storing a computer program; and

a processor coupled to the memory and configured to execute the computer program to:

display, at a two-dimensional (2D) display area, a three-dimensional (3D) virtual image in a virtual scene, the 3D virtual image being a 3D image corresponding to a virtual object in the virtual scene mapped from a physical object, the displaying comprising mapping the 3D virtual image to the 2D display area from a viewpoint position in the virtual scene, one or more constituent components of the virtual object corresponding, one-to-one, to one or more constituent components of the physical object;

determine a target object of the 3D virtual image displayed in the 2D display area, the target object being at least a portion of the 3D virtual image displayed in the 2D display area representing a subset of the one or more constituent components of the virtual object; and

based on the target object, determine, without using an eye tracking device, an attention focus object of the 3D virtual image, the attention focus object belonging to at least a part of the 3D virtual image, the attention focus object representing at least one first constituent component of the subset of the one or more constituent components of the virtual object, the attention focus object being indicative of an attention focus of a user on a constituent component of the physical object corresponding to the at least one first constituent component of the virtual object.

18. The electronic device according to claim 17 , wherein when determining the target object of the 3D virtual image displayed in the 2D display area, the processor is further configured to:

determine the target object in a sampling area of the 3D virtual image displayed in the 2D display area.

19. The electronic device according to claim 18 , wherein when determining the target object in the sampling area of the 3D virtual image displayed in the 2D display area, the processor is further configured to:

determine a current position of a virtual camera in the virtual scene; and

use the current position of the virtual camera to determine the target object in the sampling area of the 3D virtual image displayed in the 2D display area.

20. The electronic device according to claim 19 , wherein when using the current position of the virtual camera to determine the target object in the sampling area of the 3D virtual image displayed in the 2D display area, the processor is further configured to:

determine an image mapping area where the 3D virtual image is mapped into the 2D display area;

use the current position of the virtual camera as an originating point, determining a plurality of rays from the originating point to pass through a plurality of sampling points in the 2D display area; and

based on a sub-mapping area identified by the plurality of rays in the image mapping area, determine the target object identified by the plurality of rays in the 3D virtual image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 8, 2023
From: ZHANG, GUANNAN; ZHAO, WANWAN; ZHANG, XIAOYAN
To: LENOVO (BEIJING) LIMITED
Reel/Frame 062627/0929 →
Priority Claims (1)
CN 202210118195.4 · Feb 8, 2022 · national
Continuity (1)
Related Publication 20230251706A1 · Aug 10, 2023
References Cited (36)
US 8542232B2 · Hyndman · 2013 [cited by examiner]
US 10055892B2 · Petrovskaya · 2018 [cited by examiner]
US 10095374B2 · Ren · 2018 [cited by examiner]
US 10262036B2 · Paine · 2019 [cited by examiner]
US 10395428B2 · Stafford · 2019 [cited by examiner]
US 10467809B2 · Khalid · 2019 [cited by examiner]
US 10565761B2 · DeLuca · 2020 [cited by examiner]
US 11010949B2 · DeLuca · 2021 [cited by examiner]
US 11281351B2 · Nguyen · 2022 [cited by examiner]
US 11568604B2 · Stafford · 2023 [cited by examiner]
US 11610381B2 · Mihara · 2023 [cited by examiner]
US 20010009418A1 · Hiroike · 2001 [cited by examiner]
US 20100164956A1 · Hyndman · 2010 [cited by examiner]
US 20150135128A1 · Ren · 2015 [cited by examiner]
US 20160070439A1 · Bostick · 2016 [cited by examiner]
US 20160357491A1 · Oya · 2016 [cited by examiner]
US 20170205892A1 · Petrovskaya · 2017 [cited by examiner]
US 20170358141A1 · Stafford · 2017 [cited by examiner]
US 20180189354A1 · Paine · 2018 [cited by examiner]
US 20180190010A1 · Sawaki · 2018 [cited by examiner]
US 20190180483A1 · DeLuca · 2019 [cited by examiner]
US 20190362528A1 · DeLuca · 2019 [cited by examiner]
US 20190371075A1 · Stafford · 2019 [cited by examiner]
US 20200402310A1 · Nidaira · 2020 [cited by examiner]
US 20210241534A1 · Avisar · 2021 [cited by examiner]
US 20220206298A1 · Goodman · 2022 [cited by examiner]
US 20220214743A1 · Dascola · 2022 [cited by examiner]
CN 109064390A · 2018 [cited by examiner]
CN 109191188A · 2019 [cited by examiner]
CN 109542226A · 2019 [cited by examiner]
CN 113470161A · 2021 [cited by examiner]
CN 113470161B · 2022 [cited by examiner]
CN 109064390B · 2023 [cited by examiner]
EP 3506210A1 · 2019 [cited by examiner]
JP 2001195611A · 2001 [cited by examiner]
WO WO2020218041A1 · 2020 [cited by examiner]