IP Library › Granted Patent US 12,511,796
Granted Patent B2
US 12,511,796 · App. 18/232,850 · Granted Dec 30, 2025

Remote collaboration method, remote device and storage medium

Inventors: Hai-Ping Tang (Shenzhen, CN); Cheng-Ching Chien (New Taipei, TW)
Assignees: Fu Tai Hua Industry (Shenzhen) Co., Ltd.; HON HAI PRECISION INDUSTRY CO., LTD.
G06T11/00G06F3/14G06T7/70G06T2207/20104
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,511,796
App. No.
18/232,850
Granted
Dec 30, 2025
Kind
B2
Abstract

A remote collaboration method applied to a remote device is provided. In the method, the remote device receives a first image transmitted by a wearable device and determines a reference area based on the first image. The remote device further determines a position of a target object relative to the reference area and generates the indication information according to the position of the target object relative to the reference area and transmits the indication information to the wearable device. The method can provide a user with the indication information of the position of the target object in the eyesight through remote collaboration between the remote device and the wearable device, thereby improving the efficiency and accuracy of determining the position of the target object.

Claims (44)

1 . A remote collaboration method using a remote device, the remote device is communicatively connected to a wearable device, the method comprising:

receiving a first image transmitted by the wearable device;

determining a reference area based on the first image;

determining a position of a target object relative to the reference area, comprising:

determining whether the target object is located outside the reference area; calculating a relative angle between the target object and the reference area in response that the target object is located outside the reference area; and determining the position of the target object relative to the reference area based on the relative angle;

generating indication information according to the position of the target object relative to the reference area, wherein the indication information comprises: a graphic or text within the reference area for indicating the position of the target object, the text comprises the relative angle; and

transmitting the indication information to the wearable device.

2 . The remote collaboration method according to claim 1 , wherein determining the reference area based on the first image comprises:

receiving a second image transmitted by the wearable device, and the second image comprises an augmented reality image that is generated based on the first image; and

determining the reference area according to a position of the second image in the first image.

3 . The remote collaboration method according to claim 1 , wherein the method further comprises:

identifying the target object in the first image using an image recognition algorithm; and

determining the position of the target object in the first image.

4 . The remote collaboration method according to claim 1 , wherein the method further comprises:

in response to a selection operation of the target object by a user, determining the position of the target object in the first image.

5 . A remote device comprising:

a storage device;

at least one processor; and

the storage device storing one or more programs, which when executed by the at least one processor, cause the at least one processor to:

receive a first image transmitted by a wearable device;

determine a reference area based on the first image;

determine a position of a target object relative to the reference area, comprising: determining whether the target object is located outside the reference area; calculating a relative angle between the target object and the reference area in response that the target object is located outside the reference area; and determining the position of the target object relative to the reference area based on the relative angle;

generate indication information according to the position of the target object relative to the reference area, wherein the indication information comprises: a graphic or text within the reference area for indicating the position of the target object, the text comprises the relative angle; and

transmit the indication information to the wearable device.

6 . The remote device according to claim 5 , wherein the at least one processor determines the reference area based on the first image by:

receiving a second image transmitted by the wearable device, and the second image comprises an augmented reality image that is generated based on the first image; and

determining the reference area according to a position of the second image in the first image.

7 . The remote device according to claim 6 , wherein the at least one processor further caused to:

identify the target object in the first image using an image recognition algorithm; and

determine the position of the target object in the first image.

8 . The remote device according to claim 6 , wherein the at least one processor further caused to:

in response to a selection operation of the target object by a user, determine the position of the target object in the first image.

9 . A non-transitory storage medium having instructions stored thereon, when the instructions are executed by a processor of a remote device, the processor is caused to perform a remote collaboration method, wherein the method comprises:

receiving a first image transmitted by a wearable device;

determining a reference area based on the first image;

determining a position of a target object relative to the reference area, comprising: determining whether the target object is located outside the reference area; calculating a relative angle between the target object and the reference area in response that the target object is located outside the reference area; and determining the position of the target object relative to the reference area based on the relative angle;

generating indication information according to the position of the target object relative to the reference area, wherein the indication information comprises: a graphic or text within the reference area for indicating the position of the target object, the text comprises the relative angle; and

transmitting the indication information to the wearable device.

10 . The non-transitory storage medium according to claim 9 , wherein determining the reference area based on the first image comprises:

receiving a second image transmitted by the wearable device, and the second image comprises an augmented reality image that is generated based on the first image; and

determining the reference area according to a position of the second image in the first image.

11 . The non-transitory storage medium according to claim 9 , wherein the method further comprises:

identifying the target object in the first image using an image recognition algorithm; and

determining the position of the target object in the first image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 11, 2023
From: TANG, HAI-PING; CHIEN, CHENG-CHING
To: FU TAI HUA INDUSTRY (SHENZHEN) CO., LTD.; HON HAI PRECISION INDUSTRY CO., LTD.
Reel/Frame 065594/0462 →
Priority Claims (1)
CN 202310417583.7 · Apr 11, 2023 · national
Continuity (1)
Related Publication 20230386094A1 · Nov 30, 2023
References Cited (5)
US 9071709B2 · Wither · 2015 [cited by examiner]
US 10484824B1 · Gaeta · 2019 [cited by examiner]
US 12243268B2 · Bai · 2025 [cited by examiner]
US 20230251809A1 · Singh · 2023 [cited by examiner]
TW 202220438 · 2022 [cited by applicant]