Granted Patent B2

US 12,204,235 · App. 18/390,608 · Granted Jan 21, 2025

Inventors: Simon Saito Haagen Nielsen (Beverly Hills, CA); Zachary Collins Conatser (Santa Monica, CA)

Assignee: Snap Inc.

G03B21/14G05D1/0202G06F9/3004G06T7/194B64U10/13B64U2101/20B64U2101/30B64U2201/10

Abstract

Claims (65)

1. A system comprising:

a first drone and a second drone, each drone including a respective projector configured to project an image and a respective navigation unit configured to determine location information;

a processing system coupled to the first drone and the second drone;

a memory accessible to the processing system; and

programming in the memory, wherein execution of the programming by the processing system configures the processing system to perform functions, including functions to:

receive a change in location information for a moving object having a first portion and a second portion;

receive a change in first location information for the first drone and a change in second location information for the second drone from the respective navigation units;

adapt first relationship data responsive to changes in the location information for the moving object and the change in the first location information and second relationship data responsive to changes in the location information for the moving object and the change in the second location information;

adjust the first image for projection on the first portion using the first location information and the first relationship data and the second image for projection on the second portion using the second location information and the second relationship data; and

project the adjusted first image onto the first portion and the adjusted second image onto the second portion using the respective projector.

2. The system of claim 1 , wherein each projector has a respective projection origin from which the images are projected and wherein the location information is associated with the respective projection origin.

3. The system of claim 2 , wherein the moving object has a projection surface architecture including reference points that correspond to physical locations on the moving object, each reference point association with relationship data with respect to an architecture origin, and wherein each of the first and the second relationship data is one of a distance between the respective projection origin and the architecture origin of one or more of the reference points, an orientation of the drone with respect to the architecture origin of one or more of the reference points, or combinations thereof.

4. The system of claim 3 , wherein the first drone comprises a camera and wherein the execution of the programming by the processing system further configures the processing system to perform additional functions, including functions to:

capture one or more image of the moving object; and

develop the projection surface architecture for the moving object from the one or more images.

5. The system of claim 4 , wherein the execution of the programming by the processing system further configures the processing system to perform additional functions, including functions to:

position the first drone relative to the projection surface such that the projection origin of the first drone is within a field of view of the imager; and

identify distinct areas on the projection surface as the reference points for the projection surface from the one or more images.

6. The system of claim 3 , wherein the execution of the programming by the processing system further configures the processing system to perform additional functions, including functions to:

capture one or more images of the moving object;

identify the moving object in the one or more images; and

retrieve the projection surface architecture for the identified moving object from the memory.

7. The system of claim 1 , wherein the execution of the programming by the processing system further configures the processing system to perform additional functions, including functions to:

send speed and direction of the moving object to the first and second drones.

8. The system of claim 7 , wherein the execution of the programming by the processing system further configures the processing system to perform additional functions, including functions to:

receive the speed and direction of the moving object from the moving object.

9. The system of claim 1 , wherein the first and second drones each include an iterative predictor configured to predict speed and direction of the moving object.

10. A method for projecting a first image and a second image onto a moving object, the method comprising:

receiving a change in location information for a moving object having a first portion and a second portion;

receiving a change in first location information for a first drone and a change in second location information for a second drone from respective navigation units of the first and second drones;

adapting first relationship data responsive to changes in the location information for the moving object and the change in the first location information and second relationship data responsive to changes in the location information for the moving object and the change in the second location information;

adjusting the first image for projection on the first portion using the first location information and the first relationship data and the second image for projection on the second portion using the second location information and the second relationship data; and

projecting the adjusted first image onto the first portion and the adjusted second image onto the second portion using respective projectors of the first and second drones.

11. The method of claim 10 , wherein each projector has a respective projection origin from which the images are projected, the location information is associated with the respective projection origin, the moving object has a projection surface architecture including reference points that correspond to physical locations on the moving object, each reference point association with relationship data with respect to an architecture origin, each of the first and the second relationship data is one of a distance between the respective projection origin and the architecture origin of one or more of the reference points, an orientation of the drone with respect to the architecture origin of one or more of the reference points, or combinations thereof, the method further comprises:

capturing one or more image of the moving object; and

developing the projection surface architecture for the moving object from the one or more images.

12. The method of claim 11 , further comprising:

positioning the first drone relative to the projection surface such that the projection origin of the first drone is within a field of view of the imager; and

identifying distinct areas on the projection surface as the reference points for the projection surface from the one or more images.

13. The method of claim 11 , further comprising:

capturing one or more images of the moving object;

identifying the moving object in the one or more images; and

retrieving the projection surface architecture for the identified moving object from a memory.

14. The method of claim 10 , further comprising:

sending speed and direction of the moving object to the first and second drones.

15. The method of claim 14 , further comprising:

receiving the speed and direction of the moving object from the moving object.

16. A non-transitory computer-readable medium including instructions for execution by a processor of a system to projecting a first image and a second image onto a moving object, the instructions, when executed by the processor, configuring the system to:

receive a change in location information for a moving object having a first portion and a second portion;

receive a change in first location information for a first drone and a change in second location information for a second drone from respective navigation units of the first and second drones;

adapt first relationship data responsive to changes in the location information for the moving object and the change in the first location information and second relationship data responsive to changes in the location information for the moving object and the change in the second location information;

adjust the first image for projection on the first portion using the first location information and the first relationship data and the second image for projection on the second portion using the second location information and the second relationship data; and

project the adjusted first image onto the first portion and the adjusted second image onto the second portion using respective projectors of the first and second drones.

17. The non-transitory computer-readable medium of claim 16 , wherein each projector has a respective projection origin from which the images are projected, the location information is associated with the respective projection origin, the moving object has a projection surface architecture including reference points that correspond to physical locations on the moving object, each reference point association with relationship data with respect to an architecture origin, each of the first and the second relationship data is one of a distance between the respective projection origin and the architecture origin of one or more of the reference points, an orientation of the drone with respect to the architecture origin of one or more of the reference points, or combinations thereof, the instructions, when executed by the processor, further configuring the system to:

capture one or more image of the moving object; and

develop the projection surface architecture for the moving object from the one or more images.

18. The non-transitory computer-readable medium of claim 17 , the instructions, when executed by the processor, further configuring the system to:

position the first drone relative to the projection surface such that the projection origin of the first drone is within a field of view of the imager; and

identify distinct areas on the projection surface as the reference points for the projection surface from the one or more images.

19. The non-transitory computer-readable medium of claim 17 , the instructions, when executed by the processor, further configuring the system to:

capture one or more images of the moving object;

identify the moving object in the one or more images; and

retrieve the projection surface architecture for the identified moving object from a memory.

20. The non-transitory computer-readable medium of claim 16 , the instructions, when executed by the processor, further configuring the system to:

send speed and direction of the moving object to the first and second drones.

Assignments (1)

Continuity (4)

References Cited (13)

Cited By (1)

US 12,344,412