IP Library Patent Application 18459206
Patent Application
App. No. 18/459,206

SYSTEM AND METHOD FOR CAPTURE OF PHYSICAL OBJECT DATA FOR ENVIRONMENT MODELING

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
18/459,206
Abstract

A system and method for captures of physical object data for environment modeling is provided. Mesh data is displayed over an image of a physical space for which a floorplan is to be generated. Instructions to mark an object are received and the instructions include a voice command and eye gaze or gesture. The mesh data is annotated with a marker based on the instructions by placing the marker at a location at which an object is to be identified. A floorplan of the space is generated based on the mesh data. The marker is placed in the floorplan.

Claims (43)

1 . A system for capture of physical object data for environment modeling, comprising:

a display of mesh data over an image of a physical space for which a floorplan is to be generated;

a mobile computing device configured to perform the following:

receive instructions to mark an object, wherein the instructions comprise one or more of a voice command and eye gaze or gesture; and

annotate the floorplan with a marker based on the instructions by placing the marker at a location at which an object is to be identified;

a server comprising a central processing unit, memory, an input port configured to receive the mesh data and annotations from the mobile computing device, and an output port, wherein the central processing unit is configured to:

generate a floorplan of the space based on the mesh data; and

place the marker in the floorplan.

2 . A system according to claim 1 , wherein the mobile computing device adjusts a location of the marker in the floorplan based on further instructions.

3 . A system according to claim 1 , wherein the mobile computing device lays trace lines as the marker, wherein the trace lines each comprise a short line extending from a surface of the object.

4 . A system according to claim 1 , wherein the mobile computing device generates a reference marker and assigns the reference marker to the object and at least one other object in the space to be linked.

5 . A system according to claim 4 , wherein the mobile computing device generates a link marker indicating a location between entrances and egresses between rooms in the space, associates the link marker with the reference markers, and associates the link marker with other reference markers in another space associated with a same link marker.

6 . A system according to claim 1 , wherein the mobile computing device captures media comprising one or more of audio, images, and video at points of interest in the physical space and associates the captured media with the marker.

7 . A system according to claim 1 , wherein the mesh data can be temporarily removed from the image.

8 . A system according to claim 1 , wherein the mobile computing device adds a note represented by a box filled with text and associates the notice with the marker.

9 . A system according to claim 1 , wherein the floor plan is a drafting-style floor plan.

10 . A system according to claim 1 , wherein the object comprise one or more of a thermostat, sensor, furniture, corner, door, window, pipe, wire, and water tank.

11 . A method for capture of physical object data for environment modeling, comprising:

displaying mesh data over an image of a physical space for which a floorplan is to be generated;

receiving instructions to mark an object, wherein the instructions comprise one or more of a voice command and eye gaze or gesture; and

annotating the floorplan with a marker based on the instructions by placing the marker at a location at which an object is to be identified; and

generating a floorplan of the space based on the mesh data; and

placing the marker in the floorplan.

12 . A method according to claim 11 , further comprising:

adjusting a location of the marker in the floorplan based on further instructions.

13 . A method according to claim 11 , further comprising:

laying trace lines as the marker, wherein the trace lines each comprise a short line extending from a surface of the object.

14 . A method according to claim 11 , further comprising:

generating a reference marker; and

assigning the reference marker to the object and at least one other object in the space to be linked.

15 . A method according to claim 14 , further comprising:

generating a link marker indicating a location between entrances and egresses between rooms in the space;

associating the link marker with the reference markers; and

associating the link marker with other reference markers in another space associated with a same link marker.

16 . A method according to claim 11 , further comprising:

capturing media comprising one or more of audio, images, and video at points of interest in the physical space; and

associating the captured media with the marker.

17 . A method according to claim 11 , wherein the mesh data can be temporarily removed from the image.

18 . A method according to claim 11 , further comprising:

adding a note represented by a box filled with text; and

associating the notice with the marker.

19 . A method according to claim 11 , wherein the floor plan is a drafting-style floor plan.

20 . A method according to claim 11 , wherein the object comprise one or more of a thermostat, sensor, furniture, corner, door, window, pipe, wire, and water tank.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 31, 2025
From: XEROX CORPORATION
To: GENESEE VALLEY INNOVATIONS, LLC
Reel/Frame 073225/0116 →
SECOND LIEN NOTES PATENT SECURITY AGREEMENT Recorded Jul 2, 2025
From: XEROX CORPORATION
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 071785/0550 →
FIRST LIEN NOTES PATENT SECURITY AGREEMENT Recorded Apr 11, 2025
From: XEROX CORPORATION
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 070824/0001 →
SECURITY INTEREST Recorded Feb 13, 2024
From: XEROX CORPORATION
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 066741/0001 →
SECURITY INTEREST Recorded Nov 20, 2023
From: XEROX CORPORATION
To: JEFFERIES FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 065628/0019 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 11, 2023
From: NELSON, LESTER D.; BIER, ERIC A.; BRITO, ALEJANDRO E.
To: XEROX CORPORATION
Reel/Frame 065187/0737 →