IP Library Granted Patent US 11,550,401
Granted Patent B2
US 11,550,401 · App. 17/734,909 · Granted Jan 10, 2023

Virtual or augmediated topological sculpting, manipulation, creation, or interaction with devices, objects, materials, or other entities

Inventors: Meron Gribetz (Belmont, CA); W. Steve G. Mann (Toronto, CA)
Assignee: Campfire 3D, Inc.
G06F3/017G02B27/017G06F3/011G06F3/013G06F3/0482G06F3/04815G06F3/04842G02B2027/014G02B2027/0178G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,550,401
App. No.
17/734,909
Granted
Jan 10, 2023
Kind
B2
Abstract

A sensing and display apparatus, comprising: a first phenomenon interface configured to operatively interface with a first augmediated-reality space, and a second phenomenon interface configured to operatively interface with a second augmediated-reality space, is implemented as an extramissive spatial imaging digital eye glass.

Claims (83)

1. An apparatus, comprising:

at least one light receiver configured to sense light in a real-world environment of the apparatus;

at least one head-mounted output display;

at least one computational device communicatively coupled to at least one spatial imaging device and the at least one head-mounted output display, wherein the at least one computational device is configured to execute program instructions that cause the at least one computational device to perform a method comprising:

receiving data representing the light sensed by the at least one light receiver from a plurality of locations on a moving object in the real-world environment at multiple locations of the moving object;

generating a virtual object representing the light sensed from the plurality of locations on the moving object at the multiple locations of the moving object;

generating an image of the virtual object; and

displaying the image of the virtual object on the at least one head-mounted output display.

2. The apparatus of claim 1 , the method further comprising:

determining positions of the moving object in the real-world environment with respect to a fixed object in the real-world environment;

determining a position of the apparatus with respect to the fixed object in the real-world environment;

generating a coordinate transformation between the positions of the moving object in the real-world environment and the position of the apparatus based on the determined positions of the moving object in the real-world environment with respect to the fixed object in the real-world environment and the determined position of the apparatus with respect to the fixed object in the real-world environment; and

generating the image of the virtual object according to the generated coordinate transformation.

3. The apparatus of claim 1 , wherein the data representing light sensed by the at least one light receiver from the plurality of locations on the moving object in the real-world environment at multiple locations of the moving object is first data representing first light in a first frequency band, the method further comprising:

receiving second data representing second light sensed by the at least one light receiver from a plurality of locations on a second moving object in the real-world environment at multiple locations of the second moving object, wherein the second frequency band is different from the first frequency band;

generating a second virtual object representing the second light sensed from the plurality of locations on the second moving object at the multiple locations of the second moving object;

generating an image of the second virtual object; and

displaying the image of the second virtual object on the at least one head-mounted output display.

4. The apparatus of claim 3 , the method further comprising:

generating the image of the virtual object in a first color; and

generating the image of the second virtual object in a second color;

wherein the second color is different from the first color.

5. The apparatus of claim 1 , wherein the virtual object comprises at least one of:

text;

graphics; or

shapes.

6. The apparatus of claim 1 , wherein the virtual object is a virtual N-dimensional manifold.

7. The apparatus of claim 1 , wherein the light sensed by the at least one light receiver is at least one of:

visible light; and

infrared light.

8. The apparatus of claim 1 , wherein the plurality of locations on the moving object are sources of the light.

9. The apparatus of claim 1 , the method further comprising:

at least one light source;

wherein the plurality of locations on the moving object are reflectors; and

wherein the light sensed by the at least one light receiver is light transmitted by the at least one light source and reflected by the reflectors.

10. A method, comprising:

sensing, by at least one light receiver, light in a real-world environment of the light receiver;

receiving, by at least one computational device communicatively coupled to at least one spatial imaging device and at least one head-mounted output display, data representing the light sensed by the at least one light receiver from a plurality of locations on a moving object in the real-world environment at multiple locations of the moving object;

generating, by the at least one computational device, a virtual object representing the light sensed from the plurality of locations on the moving object at the multiple locations of the moving object;

generating, by the at least one computational device, an image of the virtual object; and

displaying, by the at least one head-mounted output display, the image of the virtual object on the at least one head-mounted output display.

11. The method of claim 10 , further comprising:

determining, by the at least one computational device, positions of the moving object in the real-world environment with respect to a fixed object in the real-world environment;

determining, by the at least one computational device, a position of the apparatus with respect to the fixed object in the real-world environment;

generating, by the at least one computational device, a coordinate transformation between the positions of the moving object in the real-world environment and the position of the apparatus based on the determined positions of the moving object in the real-world environment with respect to the fixed object in the real-world environment and the determined position of the apparatus with respect to the fixed object in the real-world environment; and

generating, by the at least one computational device, the image of the virtual object according to the generated coordinate transformation.

12. The method of claim 10 , wherein the data representing light sensed by the at least one light receiver from the plurality of locations on the moving object in the real-world environment at multiple locations of the moving object is first data representing first light in a first frequency band, the method further comprising:

receiving, by the at least one computational device, second data representing second light sensed by the at least one light receiver from a plurality of locations on a second moving object in the real-world environment at multiple locations of the second moving object, wherein the second frequency band is different from the first frequency band;

generating, by the at least one computational device, a second virtual object representing the second light sensed from the plurality of locations on the second moving object at the multiple locations of the second moving object;

generating, by the at least one computational device, an image of the second virtual object; and

displaying, by the at least one head-mounted output display, the image of the second virtual object on the at least one head-mounted output display.

13. The method of claim 12 , further comprising:

generating, by the at least one computational device, the image of the virtual object in a first color; and

generating, by the at least one computational device, the image of the second virtual object in a second color;

wherein the second color is different from the first color.

14. The method of claim 10 , wherein the virtual object comprises at least one of:

text;

graphics; or

shapes.

15. The method of claim 10 , wherein the virtual object is a virtual N-dimensional manifold.

16. A non-transitory machine-readable storage medium encoded with instructions executable by one or more hardware processors of at least one computational device communicatively coupled to at least one spatial imaging device and at least one head-mounted output display, the machine-readable storage medium comprising instructions to cause the one or more hardware processors to perform operations comprising:

receiving data representing light sensed by at least one light receiver from a plurality of locations on a moving object in a real-world environment of the at least one light receiver at multiple locations of the moving object;

generating a virtual object representing the light sensed from the plurality of locations on the moving object at the multiple locations of the moving object;

generating an image of the virtual object; and

causing the at least one head-mounted output display to display the image of the virtual object on the at least one head-mounted output display.

17. The medium of claim 16 , the method further comprising:

determining positions of the moving object in the real-world environment with respect to a fixed object in the real-world environment;

determining a position of the apparatus with respect to the fixed object in the real-world environment;

generating a coordinate transformation between the positions of the moving object in the real-world environment and the position of the apparatus based on the determined positions of the moving object in the real-world environment with respect to the fixed object in the real-world environment and the determined position of the apparatus with respect to the fixed object in the real-world environment; and

generating the image of the virtual object according to the generated coordinate transformation.

18. The medium of claim 16 , wherein the data representing light sensed by the at least one light receiver from the plurality of locations on the moving object in the real-world environment at multiple locations of the moving object is first data representing first light in a first frequency band, the method further comprising:

receiving second data representing second light sensed by the at least one light receiver from a plurality of locations on a second moving object in the real-world environment at multiple locations of the second moving object, wherein the second frequency band is different from the first frequency band;

generating a second virtual object representing the second light sensed from the plurality of locations on the second moving object at the multiple locations of the second moving object;

generating an image of the second virtual object; and

causing the at least one head-mounted output display to display the image of the second virtual object on the at least one head-mounted output display.

19. The medium of claim 18 , the method further comprising:

generating the image of the virtual object in a first color; and

generating the image of the second virtual object in a second color;

wherein the second color is different from the first color.

20. The medium of claim 16 , wherein the virtual object comprises at least one of:

text;

graphics; or

shapes.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 24, 2024
From: CAMPFIRE 3D, INC.
To: QUALCOMM INCORPORATED
Reel/Frame 067209/0066 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THE NATURE OF CONVEYANCE, THE ASSIGNOR NAME AND THE ASSIGNEE NAME PREVIOUSLY RECORDED ON REEL 66812 FRAME 477. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 4, 2024
From: VENTURE LENDING & LEASING VIII, INC.; VENTURE LENDING & LEASING VII, INC.
To: META VIEW, INC.
Reel/Frame 067022/0623 →
SECURITY INTEREST Recorded Mar 18, 2024
From: META VIEW, INC.
To: VENTURE LENDING & LEASING VII, INC.; VENTURE LENDING & LEASING VIII, INC.
Reel/Frame 066812/0477 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 5, 2023
From: META VIEW, INC.
To: CAMPFIRE 3D, INC.
Reel/Frame 063230/0859 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2023
From: GRIBETZ, MERON; MANN, W. STEVE G.
To: META COMPANY
Reel/Frame 063217/0456 →