IP Library Granted Patent US 9,509,867
Granted Patent B2
US 9,509,867 · App. 12/169,143 · Granted Nov 29, 2016

Methods and apparatus for collecting image data

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,509,867
App. No.
12/169,143
Granted
Nov 29, 2016
Kind
B2
Abstract

An image processing system identifies desired views of a particular subject and triggers a mobile camera device in proximity to the subject to capture a digital image, thus collecting new image data to augment an existing database. In an exemplary method, location data for a camera-equipped mobile communication device in visual proximity to a subject of interest is received at an image collection server. Upon determining whether the location data corresponds to a desired view of the subject of interest, the image collection server sends an image capture request to the mobile device, triggering the user of the device to capture an image of the subject. Finally, digital image data is received from the mobile communication device in response to the image capture request. The digital image data may then be used for assembling a composite representation of the subject of interest, such as a 3D model of the subject.

Claims (42)

1. A method of modifying a three-dimensional model of a real-world subject of interest, comprising:

determining that a database of digital image data used for building the three-dimensional model of the real-world subject of interest sparsely represents a desired view of the real-world subject of interest;

receiving location data by an image collection server for a mobile communication device in visual proximity to the real-world subject of interest;

determining that the location data corresponds to the desired view of the real-world subject of interest;

sending an image capture request from the image collection server to the mobile communication device responsive to said determining, said image capture request requesting the mobile communication device to capture an image of the desired view; and

receiving digital image data that corresponds to the image of the desired view of the real-world subject of interest from the mobile communication device in response to the image capture request;

modifying the three-dimensional model of the real-world subject of interest based on the received digital image data;

wherein the image collection server is a master device configured to coordinate collection of images by one or more slave devices including the mobile communication device in response to the image collection server being within radio communication range of the real-world subject of interest, the mobile communication device, or both.

2. The method of claim 1 , further comprising:

receiving camera position data corresponding to the digital image data; and

storing the camera position data in association with the digital image data for use in assembling the three-dimensional model of the real-world subject of interest.

3. The method of claim 2 , wherein the camera position data comprises camera location data, indicating a location for the mobile communication device at the time the digital image data was captured, or camera orientation data, indicating an orientation for the mobile communication device at the time the digital image data was captured, or both.

4. The method of claim 1 , further comprising:

determining a desired reference position with respect to the real-world subject of interest;

forming a positioning instruction by the image collection server based on the desired reference position; and

sending the positioning instruction from the image collection server to the mobile communication device.

5. The method of claim 4 , wherein the positioning instruction comprises reference location data, reference orientation data, or both, for use in capturing the digital image data.

6. The method of claim 1 , wherein the image collection server:

is configured to coordinate the collection of images in further response to the image collection server being in visual proximity to the real-world subject of interest; and

comprises a camera configured to capture images.

7. An image collection server comprising:

a communication network interface configured to exchange signals with a network; and

one or more processing circuits communicatively coupled to the communication network interface and configured to:

determine that a database of digital image data used for building a three-dimensional model of the real-world subject of interest sparsely represents a desired view of the real-world subject of interest;

receive, via the communication network interface, location data for a mobile communication device in visual proximity to the real-world subject of interest;

determine that the location data corresponds to the desired view of the real-world subject of interest;

send, using the communication network interface, an image capture request to the mobile communication device responsive to said determining, said image capture request requesting the mobile communication device to capture an image of the desired view; and

receive, via the communication network interface, digital image data that corresponds to the image of the desired view of the real-world subject of interest from the mobile communication device in response to the image capture request;

modifying the three-dimensional model of the real-world subject of interest based on the received digital image data;

wherein the image collection server is a master device that coordinates collection of images by one or more slave devices including the mobile communication device in response to the image collection server being within radio communication range of the real-world subject of interest, the mobile communication device, or both.

8. The image collection server of claim 7 , wherein the one or more processing circuits are further configured to:

receive camera position data corresponding to the digital image data; and

store the camera position data in association with the digital image data for use in assembling the three-dimensional model of the real-world subject of interest.

9. The image collection server of claim 8 , wherein the camera position data comprises camera location data, indicating a location for the mobile communication device at the time the digital image data was captured, or camera orientation data, indicating an orientation for the mobile communication device at the time the digital image data was captured, or both.

10. The image collection server of claim 7 , wherein the one or more processing circuits are further configured to:

determine a desired reference position with respect to the real-world subject of interest;

form a positioning instruction based on the desired reference position; and

send the positioning instruction to the mobile communication device, using the communication network interface.

11. The image collection server of claim 10 , wherein the positioning instruction comprises reference location data, reference orientation data, or both, for use in capturing the digital image data.

12. The image collection server of claim 7 , wherein the image collection server:

is configured to coordinate the collection of images in further response to the image collection server being in visual proximity to the real-world subject of interest; and

comprises a camera configured to capture images.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 25, 2019
From: SONY MOBILE COMMUNICATIONS, INC.
To: SONY CORPORATION
Reel/Frame 048691/0134 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2017
From: SONY CORPORATION
To: SONY MOBILE COMMUNICATIONS INC.
Reel/Frame 043943/0631 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 7, 2016
From: SONY MOBILE COMMUNICATIONS INC
To: SONY CORPORATION; SONY MOBILE COMMUNICATIONS INC
Reel/Frame 039099/0144 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 21, 2016
From: SONY MOBILE COMMUNICATIONS AB
To: SONY MOBILE COMMUNICATIONS INC
Reel/Frame 038966/0730 →
CHANGE OF NAME Recorded Jun 10, 2016
From: SONY ERICSSON MOBILE COMMUNICATIONS AB
To: SONY MOBILE COMMUNICATIONS AB
Reel/Frame 038956/0420 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 8, 2008
From: CAMP, WILLIAM O., JR.; KOKES, MARK GAVIN; BOWEN, TOBY JOHN; MARCINKIEWICZ, WALTER M.
To: SONY ERICSSON MOBILE COMMUNICATIONS AB
Reel/Frame 021204/0961 →