IP Library Granted Patent US 12,354,483
Granted Patent B2
US 12,354,483 · App. 18/633,670 · Granted Jul 8, 2025

Information processing device, information processing method, program, and mobile device

Inventors: Masato Nishio (Tokyo, JP); Yuhei Yabe (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
G08G5/21B64C39/024G05D1/0016G05D1/1064G05D1/223G05D1/693G06T7/73G06V10/243G06V20/10G06V20/13G06V20/17G08G5/80H04N5/38H04N23/10B64U2101/30B64U2201/10B64U2201/20G06T2207/30204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,354,483
App. No.
18/633,670
Granted
Jul 8, 2025
Kind
B2
Abstract

It is intended to allow an orientation of a mobile device observed in imaging data to be more appropriately specified. There is provided an information processing device including an acquisition unit that acquires the imaging data and a direction specification unit that analyzes the imaging data to specify the orientation of the mobile device observed in the imaging data.

Claims (53)

1. An information processing method to be implemented by a first mobile device, the method comprising:

acquiring imaging data;

analyzing the imaging data to specify an orientation of a second mobile device observed in the imaging data;

analyzing the imaging data to specify the position of the second mobile device observed in the imaging data;

predicting, based on the orientation and the position, the orientation or the position of the second mobile device at a given future time point; and

controlling, based on a result of predicting the orientation or the position of the second mobile device, movement of the first mobile device.

2. The information processing method according to claim 1 , wherein

specifying, as the orientation of the second mobile device, at least one of a direction in which the second mobile device is moving, a direction in which the second mobile device is movable, and a direction in which the second mobile device is expected to move.

3. The information processing method according to claim 1 , wherein

specifying, as the orientation of the second mobile device, at least one of a two-dimensional direction and a three-dimensional direction in which the second mobile device is oriented.

4. The information processing method according to claim 1 , wherein

specifying the orientation of the second mobile device based on a feature of the second mobile device, the feature being observed in the imaging data.

5. The information processing method according to claim 1 , wherein

specifying the orientation of the second mobile device based on light emitted from the second mobile device, the light being observed in the imaging data.

6. The information processing method according to claim 5 , wherein

the light emitted from the second mobile device is a headlight of the second mobile device.

7. The information processing method according to claim 1 , wherein

specifying the orientation of the second mobile device based on an environment around the second mobile device, the environment being observed in the imaging data.

8. The information processing method according to claim 1 , wherein

specifying the orientation of the second mobile device based on a marker added to the second mobile device, the marker being observed in the imaging data.

9. The information processing method according to claim 1 , wherein

the first mobile device is a movable device including a camera that generates the imaging data.

10. The information processing method according to claim 9 , wherein

the camera that generates the imaging data is provided in an external device serving as a second movable device.

11. The information processing method according to claim 9 , wherein

recognizing that the specification of the orientation of the second mobile device is interrupted and controls the position to be moved forward/rearward, leftward/rightward, upward/downward, or a combination thereof.

12. The information processing method according to claim 1 , wherein

controlling, based on the result of predicting the orientation or the position of the second mobile device, the movement of the first mobile device to avoid a collision between the second mobile device and another object.

13. The information processing method according to claim 1 , wherein

at least one of the first mobile device or the second mobile device is an automobile.

14. A first mobile device comprising:

circuitry configured to

acquire imaging data,

analyze the imaging data to specify an orientation of a second mobile device observed in the imaging data,

analyze the imaging data to specify the position of the second mobile device observed in the imaging data,

predict, based on the orientation and the position, the orientation or the position of the second mobile device at a given future time point, and

control, based on a result of predicting the orientation or the position of the second mobile device, movement of the first mobile device.

15. The first mobile device according to claim 14 , wherein

the circuitry is configured to specify the orientation of the second mobile device based on light emitted from the second mobile device, the light being observed in the imaging data.

16. The first mobile device according to claim 15 , wherein

the light emitted from the second mobile device is a headlight of the second mobile device.

17. The first mobile device according to claim 14 , wherein

at least one of the first mobile device or the second mobile device is an automobile.

18. A non-transitory computer-readable storage medium including computer executable instructions, wherein the instructions, when executed by a first mobile device, cause the first mobile device to perform a method, the method comprising:

acquiring imaging data;

analyzing the imaging data to specify an orientation of a second mobile device observed in the imaging data;

analyzing the imaging data to specify the position of the second mobile device observed in the imaging data;

predicting, based on the orientation and the position, the orientation or the position of the second mobile device at a given future time point; and

controlling, based on a result of predicting the orientation or the position of the second mobile device, movement of the first mobile device.

19. The non-transitory computer-readable storage medium according to claim 18 , wherein the method further comprising:

specifying the orientation of the second mobile device based on light emitted from the second mobile device, the light being observed in the imaging data.

20. The non-transitory computer-readable storage medium according to claim 19 , wherein

the light emitted from the second mobile device is a headlight of the second mobile device.

Assignments (1)
CHANGE OF NAME Recorded Apr 12, 2024
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 067095/0730 →
Priority Claims (1)
JP 2018-165362 · Sep 4, 2018 · national
Continuity (2)
Continuation 17261577
Related Publication 20240257649A1 · Aug 1, 2024
References Cited (16)
US 9754165B2 · Mundhenk et al. · 2017 [cited by applicant]
US 10852364B2 · Kushleyev et al. · 2020 [cited by applicant]
US 20160291594A1 · Zhao et al. · 2016 [cited by applicant]
US 20170076175A1 · Sugaya · 2017 [cited by applicant]
CN 1782665A · 2006 [cited by applicant]
CN 105759834A · 2016 [cited by applicant]
EP 3614341 · 2020 [cited by examiner]
EP 3614341A1 · 2020 [cited by applicant]
JP H0626859A · 1994 [cited by applicant]
JP 2010015194A · 2010 [cited by applicant]
JP 2015095225A · 2015 [cited by applicant]
JP 2017058831A · 2017 [cited by applicant]
JP 2017529616A · 2017 [cited by applicant]
JP 2017207815A · 2017 [cited by applicant]
WO 2004081683A1 · 2004 [cited by applicant]
International Search Report and Written Opinion mailed on Oct. 1, 2019, received for PCT Application PCT/JP2019/026432, Filed on Jul. 3, 2019, 10 pages including English Translation. [cited by applicant]