IP Library › Granted Patent US 12,236,023
Granted Patent B2
US 12,236,023 · App. 18/223,257 · Granted Feb 25, 2025

Electronic apparatus for identifying a control signal based on motion information and control method thereof

Inventors: Kunsok Kang (Suwon-si, KR); Anant Baijal (Suwon-si, KR); Hyunkyu Yun (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06F3/038G06F3/013G06F3/0346G09G3/002G06F2203/0384G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,236,023
App. No.
18/223,257
Granted
Feb 25, 2025
Kind
B2
Abstract

An electronic apparatus is disclosed. The electronic apparatus includes projection circuitry, a communication interface, and at least one processor connected with the projection circuitry and the communication interface and configure to control the electronic apparatus, and the processor is configured to control the projection circuitry to project an image towards a projection region, receive first motion information from each of a first portable device, a second portable device, and a wearable device through a communication interface after a first portable device, a second portable device, and a wearable device worn by a user are arranged to correspond to the image, identify orientations of each of the first portable device, the second portable device, and the wearable device based on the first motion information, and identify a location of the user based on identified orientations.

Claims (78)

1. An electronic apparatus, comprising:

projection circuitry;

a communication interface; and

at least one processor connected with the projection circuitry and the communication interface and configure to control the electronic apparatus,

wherein the at least one processor is configured to:

control the projection circuitry to project an image pattern towards a projection region,

receive first motion information from each of a first portable device, a second portable device, and a wearable device worn by a user through the communication interface after the first portable device, the second portable device, and the wearable device are arranged to correspond to a first part, a second part, and a third part, respectively, of the image pattern,

identify orientations of each of the first portable device, the second portable device, and the wearable device based on the first motion information, and

identify a location of the user based on the identified orientations by determining a distance between the user and the projection region based on the identified orientations.

2. The electronic apparatus of claim 1 , wherein

the at least one processor is configured to:

receive, after identification of the location of the user, second motion information from each of the first portable device, the second portable device, and the wearable device through the communication interface, and

update the location of the user based on the second motion information.

3. The electronic apparatus of claim 1 , further comprising:

a memory stored with a look-up table,

wherein the at least one processor is configured to:

identify a first angle formed by a first straight line moving from the user toward a front of the user and a second straight line parallel to an orientation of the first portable device and a second angle formed by a third straight line moving from the user toward the front of the user and the second straight line parallel with an orientation of the second portable device,

determine the distance between the projection region and the user based on identifying a distance corresponding to the first angle and the second angle based on the look-up table, and

identify the location of the user based on the identified distance.

4. The electronic apparatus of claim 1 , wherein

each of the first portable device, the second portable device, and the wearable device comprise an inertial measurement sensor, and

the first motion information comprises:

information about at least one of a roll, a pitch, or a yaw measured through the inertial measurement sensors of each of the first portable device, the second portable device, and the wearable device.

5. The electronic apparatus of claim 1 , wherein

the at least one processor is configured to:

control the projection circuitry to project a pointer towards one point of the projection region based on at least one orientation from among the first portable device or the second portable device.

6. The electronic apparatus of claim 5 , wherein

the at least one processor is configured to:

identify a gaze of the user based on the first motion information received from the wearable device, and

identify one region of the projection region corresponding to a field of view of the user based on the gaze of the user.

7. The electronic apparatus of claim 6 , wherein

the at least one processor is configured to:

control, based on the one point of the projection region corresponding to the at least one orientation from among the first portable device or the second portable device falling outside the one region, the projection circuitry to project the pointer towards an edge of the one region.

8. The electronic apparatus of claim 7 , wherein

the at least one processor is configured to:

change, based on a pre-set control signal being received from at least one of the first portable device or the second portable device through the communication interface while the pointer is in a projected state towards the edge of the one region, a size of the one region.

9. The electronic apparatus of claim 1 , wherein

the projection region is implemented as a screen with at least one projection surface having a size greater than or equal to a pre-set size or as an immersive screen comprising at least two projection surfaces.

10. The electronic apparatus of claim 1 , wherein

the first portable device and the second portable device are each grasped by the user, and

the wearable device is configured to be worn on a head of the user.

11. An electronic apparatus, comprising:

a display;

a communication interface; and

at least one processor connected with the display and the communication interface and configured to control the electronic apparatus,

wherein the at least one processor is configured to:

control the display to display an image pattern towards a projection region,

receive first motion information from each of a first portable device, a second portable device, and a wearable device worn by a user through the communication interface, after the first portable device, the second portable device, and the wearable device are arranged to correspond to a first part, a second part, and a third part respectively, of the image pattern,

identify orientations of each of the first portable device, the second portable device, and the wearable device based on the first motion information, and

identify a location of the user based on the identified orientations by determining a distance between the user and the projection region based on the identified orientations.

12. A control method of an electronic apparatus, the method comprising:

projecting an image pattern towards a projection region;

receiving first motion information from each of a first portable device, a second portable device, and a wearable device worn by a user after the first portable device, the second portable device, and the wearable device are arranged to correspond to a first part, a second part, and a third part, respectively, of the image pattern;

identifying orientations of each of the first portable device, the second portable device, and the wearable device based on the first motion information; and

identifying a location of the user based on the identified orientations by determining a distance between the user and the projection region based on the identified orientations.

13. The method of claim 12 , further comprising:

receiving, after identifying the location of the user, second motion information from each of the first portable device, the second portable device, and the wearable device; and

updating the location of the user based on the second motion information.

14. The method of claim 12 , wherein

the identifying the location of the user comprises:

identifying a first angle formed by a first straight line moving from the user toward a front of the user and a second straight line parallel to an orientation of the first portable device and a second angle formed by a third straight line moving from the user toward a front of the user and the second straight line parallel with an orientation of the second portable device,

determining the distance between the projection region and the user by identifying a distance corresponding to the first angle and the second angle based on a look-up table, and

identifying the location of the user based on the identified distance.

15. The method of claim 12 , wherein

the first motion information comprises information about at least one of a roll, a pitch, or a yaw measured through an inertial measurement sensor of each of the first portable device, the second portable device, and the wearable device.

16. The method of claim 12 , further comprising:

projecting a pointer towards one point of the projection region based on at least one orientation from among the first portable device or the second portable device.

17. The method of claim 16 , further comprising:

identifying a gaze of the user based on the first motion information received from the wearable device; and

identifying one region of the projection region corresponding to a field of view of the user based on the gaze of the user.

18. The method according to claim 17 , further comprising:

projecting, based on the one point of the projection region corresponding to the at least one orientation from among the first portable device or the second portable device falling outside the one region, the pointer towards an edge of the one region.

19. The method of claim 18 , further comprising:

changing, based on a pre-set control signal being received from at least one of the first portable device or the second portable device while the pointer is in a projected state towards the edge of the one region, a size of the one region.

20. The method of claim 12 , wherein

the projection region is implemented as a screen with at least one projection surface having a size greater than or equal to a pre-set size or as an immersive screen comprising at least two projection surfaces.

21. The electronic apparatus of claim 1 , wherein each of the first portable device, the second portable device, and the wearable device comprise a gyro sensor that generates the first motion information,

wherein the location of the user is determined based on the first motion information without using an optical sensor.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 18, 2023
From: KANG, KUNSOK; BAIJAL, ANANT; YUN, HYUNKYU
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 064300/0670 →
Priority Claims (2)
KR 10-2022-0098118 · Aug 5, 2022 · national
KR 10-2022-0120199 · Sep 22, 2022 · national
Continuity (2)
Continuation PCTKR2023006541 · May 15, 2023
Related Publication 20240045520A1 · Feb 8, 2024
References Cited (36)
US 8323106B2 · Zalewski · 2012 [cited by applicant]
US 8325138B2 · Touma et al. · 2012 [cited by applicant]
US 8784203B2 · Zalewski · 2014 [cited by applicant]
US 8896527B2 · Ahn · 2014 [cited by applicant]
US 9244539B2 · Venable et al. · 2016 [cited by applicant]
US 10279254B2 · Mikhailov et al. · 2019 [cited by applicant]
US 10554886B2 · Rydberg · 2020 [cited by applicant]
US 10629003B2 · Miller et al. · 2020 [cited by applicant]
US 10661183B2 · Ikeda et al. · 2020 [cited by applicant]
US 10712900B2 · Osman et al. · 2020 [cited by applicant]
US 10817047B2 · Chou et al. · 2020 [cited by applicant]
US 11016305B2 · Wan et al. · 2021 [cited by applicant]
US 11044402B1 · Rydberg · 2021 [cited by applicant]
US 11610371B2 · Powderly et al. · 2023 [cited by applicant]
US 20080261693A1 · Zalewski · 2008 [cited by applicant]
US 20130002550A1 · Zalewski · 2013 [cited by applicant]
US 20130072297A1 · Seegers · 2013 [cited by examiner]
US 20140306866A1 · Miller et al. · 2014 [cited by applicant]
US 20180304153A1 · Hohjoh · 2018 [cited by examiner]
US 20180350150A1 · Powderly et al. · 2018 [cited by applicant]
US 20190356848A1 · Rydberg · 2019 [cited by applicant]
US 20200155937A1 · Imai · 2020 [cited by examiner]
US 20200269130A1 · Provancher et al. · 2020 [cited by applicant]
US 20220342212A1 · Price · 2022 [cited by examiner]
US 20230010006A1 · Goff · 2023 [cited by examiner]
JP 2020521217A · 2020 [cited by applicant]
KR 1020110025674A · 2011 [cited by applicant]
KR 1020140068855A · 2014 [cited by applicant]
KR 1020180073120A · 2018 [cited by applicant]
KR 1020210010437A · 2021 [cited by applicant]
KR 102270699B1 · 2021 [cited by applicant]
KR 102358997B1 · 2022 [cited by applicant]
WO 2012178202A1 · 2012 [cited by applicant]
WO 2017213939A1 · 2017 [cited by applicant]
International Search Report dated Aug. 2, 2023, issued by the International Searching Authority in International Application No. PCT/KR2023/006541 (PCT/ISA/210). [cited by applicant]
Written Opinion dated Aug. 2, 2023, issued by the International Searching Authority in International Application No. PCT/KR2023/006541 (PCT/ISA/237). [cited by applicant]