IP Library Granted Patent US 9,906,702
Granted Patent B2
US 9,906,702 · App. 15/420,607 · Granted Feb 27, 2018

Non-transitory computer-readable storage medium, control method, and computer

Inventor: Takafumi Sakai (Kawasaki, JP)
Assignee: FUJITSU LIMITED
H04N5/23203G06F3/14G06T7/20G06T7/70G06T11/60H04N7/185
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,906,702
App. No.
15/420,607
Granted
Feb 27, 2018
Kind
B2
Abstract

A control method executed by a computer including acquiring a first image, acquiring a first location of the target by using a wireless positioning system, displaying the first image and display information that is superimposed on the first image, the display information being displayed with associating with a first location coordinate determined based on the first location of the target, acquiring a second image, acquiring a second location of the target when a specified period of time elapses after the first location is acquired, acquiring a distance of movement of the target during the specified period of time by using an inertial sensor, making a determination of whether the display information is to be displayed with associating with the first location coordinate or a second location coordinate based on the distance of movement, the second location coordinate being determined based on the second location.

Claims (47)

1. A non-transitory computer-readable storage medium storing a control program that causes a computer to execute a process, the process comprising:

acquiring a first image;

acquiring a first location of a target by using a wireless positioning system, the first location corresponding to the first image;

displaying the first image and display information that is superimposed on the first image, the display information being displayed with associating with a first location coordinate on the first image, the first location coordinate being determined based on the first location of the target;

acquiring a second image after the first image is acquired; acquiring a second location of the target by using the wireless positioning system when a specified period of time elapses after the first location is acquired, the second location corresponding to the second image;

acquiring a distance of movement of the target during the specified period of time by using an inertial sensor included in the target;

making a determination of whether the display information is to be displayed with associating with the first location coordinate or a second location coordinate on the second image data based on the distance of movement, the second location coordinate being determined based on the second location of the target; and

displaying the second image and the display information that is superimposed on the second image based on the determination.

2. The non-transitory computer-readable storage medium according to claim 1 , wherein

each of the first image and the second image is captured by the target.

3. The non-transitory computer-readable storage medium according to claim 1 , wherein the process comprises:

when the distance of movement is less than a first predetermined value, making a determination that the display information is to be displayed with associating with the first location coordinate.

4. The non-transitory computer-readable storage medium according to claim 3 , wherein

the first predetermined value is determined based on a speed at which a person walks or a distance which a person moves by walking in a predetermined period of time.

5. The non-transitory computer-readable storage medium according to claim 3 , wherein the process further comprises:

when a difference between the first location and the second location is greater than a second predetermined value greater than the first predetermined value, making the determination that the display information is to be displayed with associating with the first location coordinate.

6. The non-transitory computer-readable storage medium according to claim 3 , wherein

the second predetermined value is determined based on a speed at which a person walks or a distance which a person moves by walking in a predetermined period of time and based on tolerance of location measurement using the wireless positioning system.

7. The non-transitory computer-readable storage medium according to claim 3 , wherein the process comprises:

when the distance of movement is equal to or greater than the first predetermined value, making a determination that the display information is to be displayed with associating with the second location coordinate.

8. The non-transitory computer-readable storage medium according to claim 7 , wherein the process further comprises:

upon receipt of an operation designating a location coordinate on the first image data with the display information superposed and displayed thereon, displaying display information different from the display information before the reception of the operation on the image data; and

when a display position of the display information is updated from a position corresponding to the first location coordinate to a position corresponding to the second location coordinate, performing control such that the location coordinate with the display information displayed thereon is considered designated if a designated location coordinate corresponds to the second location coordinate and does not correspond to the first location coordinate, within a predetermined period of time following the update.

9. The non-transitory computer-readable storage medium according to claim 1 , wherein

the image data is a motion image captured by an imaging device.

10. The non-transitory computer-readable storage medium according to claim 1 , wherein

the inertial sensor includes at least one of a gyro sensor and an acceleration sensor.

11. The non-transitory computer-readable storage medium according to claim 1 , wherein

the target is the computer.

12. A control method executed by a computer, the control method comprising:

acquiring a first image;

acquiring a first location of a target by using a wireless positioning system, the first location corresponding to the first image;

displaying the first image and display information that is superimposed on the first image, the display information being displayed with associating with a first location coordinate on the first image, the first location coordinate being determined based on the first location of the target;

acquiring a second image after the first image is acquired; acquiring a second location of the target by using the wireless positioning system when a specified period of time elapses after the first location is acquired, the second location corresponding to the second image;

acquiring a distance of movement of the target during the specified period of time by using an inertial sensor included in the target;

making a determination of whether the display information is to be displayed with associating with the first location coordinate or a second location coordinate on the second image data based on the distance of movement, the second location coordinate being determined based on the second location of the target; and

displaying the second image and the display information that is superimposed on the second image based on the determination.

13. A computer comprising:

a memory; and

a processor coupled to the memory and the processor configured to:

acquire a first image;

acquire a first location of a target by using a wireless positioning system, the first location corresponding to the first image;

display the first image and display information that is superimposed on the first image, the display information being displayed with associating with a first location coordinate on the first image, the first location coordinate being determined based on the first location of the target;

acquire a second image after the first image is acquired; acquire a second location of the target by using the wireless positioning system when a specified period of time elapses after the first location is acquired, the second location corresponding to the second image;

acquire a distance of movement of the target during the specified period of time by using an inertial sensor included in the target;

make a determination of whether the display information is to be displayed with associating with the first location coordinate or a second location coordinate on the second image data based on the distance of movement, the second location coordinate being determined based on the second location of the target; and

display the second image and the display information that is superimposed on the second image based on the determination.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 2, 2017
From: SAKAI, TAKAFUMI
To: FUJITSU LIMITED
Reel/Frame 041591/0960 →
Priority Claims (1)
JP 2016-027438 · Feb 16, 2016 · national
Continuity (1)
Related Publication 20170237892A1 · Aug 17, 2017