IP Library Granted Patent US 12,056,933
Granted Patent B2
US 12,056,933 · App. 17/322,618 · Granted Aug 6, 2024

Creating highlight reels of user trips

Inventors: Katherine Mary Stumpf (San Francisco, CA); Andrew David Acosta (San Francisco, CA); Alexander Willem Gerrese (San Francisco, CA); Jeremy Stephen Juel (San Francisco, CA)
Assignee: GM Cruise Holdings LLC
G06V20/56B60W60/00G06V20/59B60W2420/403B60W2540/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,056,933
App. No.
17/322,618
Granted
Aug 6, 2024
Kind
B2
Abstract

Systems and methods for generating images from an autonomous vehicle ride. The images can include images from inside the vehicle and outside the vehicle, and can be used to create a highlight reel of the ride. The images can be captured automatically and include images of passengers during the ride. The highlight reel is provided to a user who can choose to share it with others.

Claims (52)

1. A method for providing photos from an autonomous vehicle ride, comprising:

receiving approval for capturing images of one or more passengers in a first autonomous vehicle;

receiving, at the first autonomous vehicle, live data from a second autonomous vehicle at a first location, wherein the live data indicates one or more parameters are met at the first location;

capturing a plurality of images during the autonomous vehicle ride, wherein the plurality of images includes at least a first image of the one or more passengers inside the first autonomous vehicle and a second image in which the one or more passengers posed for the second image outside the first autonomous vehicle at the first location;

detecting an audio cue inside the first autonomous vehicle and, based on the audio cue, automatically capturing a third image including the one or more passengers;

capturing a fourth image while capturing, using an exterior vehicle camera of the first autonomous vehicle, a view behind the first autonomous vehicle, wherein greenscreen effects are layered into the fourth image to generate a different background view, the different background view based on the captured view behind the first autonomous vehicle;

selecting a first subset of the plurality of images including the first, second, and third images, and generating a highlight reel of the ride including the first subset; and

transmitting the highlight reel from the first autonomous vehicle to the one or more passengers after completion of the autonomous vehicle ride.

2. The method of claim 1 , wherein transmitting includes transmitting the highlight reel to at least one of a passenger data storage, a passenger message address, and a social media site.

3. The method of claim 2 , further comprising providing a rebate code for new users with the highlight reel.

4. The method of claim 1 , wherein detecting the audio cue inside the vehicle includes detection laughter inside the vehicle, and automatically capturing the third image-based on the laughter.

5. The method of claim 1 , further comprising receiving a passenger request for a photo, wherein the passenger request includes at least one of a verbal request and a selection on an in-vehicle tablet.

6. The method of claim 1 , wherein capturing the plurality of images includes capturing at least one image of a view outside the vehicle.

7. The method of claim 1 , wherein the highlight reel includes at least one of:

a video clip of the autonomous vehicle ride from a third autonomous vehicle's perspective, and

ride statistics for the ride including ride distance and ride duration.

8. The method of claim 1 , further comprising identifying, via machine learning, at least one special moment during the autonomous vehicle ride, and, based on identification of the at least one special moment, automatically capturing a fourth image.

9. The method of claim 1 , further comprising detecting a passenger smile, and, based on detection of the passenger smile, automatically capturing a fourth image including the passenger and the passenger smile.

10. The method of claim 1 , wherein the greenscreen effects that are layered into the fourth image further include LIDAR points from external sensors.

11. A first autonomous vehicle for capturing images during an autonomous vehicle ride, comprising:

an onboard computer configured to receive live data from a second autonomous vehicle at a first location, wherein the live data indicates one or more parameters are met at the first location;

a sensor suite on the first autonomous vehicle configured to capture a first set of images during the autonomous vehicle ride, wherein the first set of images include views outside the first autonomous vehicle at the first location;

a plurality of sensors inside the first autonomous vehicle, wherein at least one of the sensors is configured to capture a second set of images during the autonomous vehicle ride,

wherein the second set of images include views inside the autonomous vehicle,

wherein the second set of images include a first image of a passenger inside the autonomous vehicle, and

wherein the plurality of sensors inside the autonomous vehicle includes a microphone configured to detect an audio cue, and wherein the audio cue triggers an image capture event,

wherein the onboard computer is configured to create a highlight reel including a first subset of the first set of images and a second subset of the second set of images; and

a transmitter configured to transmit the highlight reel from the autonomous vehicle to the passenger via a remote computer system, after completion of the autonomous vehicle ride,

wherein at least one of the first and second sets of images include a second image including the passenger in which the passenger posed for the second image,

wherein the second set of images includes a third image captured when capturing, using an exterior camera of the sensor suite, a view behind the first autonomous vehicle, wherein greenscreen effects are layered into the third image to generate a different background view, the different background view based on the captured view behind the first autonomous vehicle.

12. The autonomous vehicle of claim 11 , further comprising a screen configured to display ones of the first and second sets of images during the ride.

13. The autonomous vehicle of claim 12 , wherein the screen is further configured to display a machine-readable code, wherein the machine-readable code is configured to link to the highlight reel.

14. The autonomous vehicle of claim 11 , wherein the audio cue is laughter, and wherein detection of the laughter triggers the image capture event.

15. The autonomous vehicle of claim 11 , wherein the plurality of sensors inside the vehicle includes a microphone configured to record an audio clip corresponding to a respective image from one of the first and second sets of images.

16. A system for capturing images during an autonomous vehicle ride, comprising:

a first autonomous vehicle including:

an onboard computer configured to receive live data from a second autonomous vehicle at a first location, wherein the live data indicates one or more parameters are met at the first location;

a sensor suite on the first autonomous vehicle configured to capture a first set of images during the autonomous vehicle ride, wherein the first set of images include views outside the first autonomous vehicle at the first location;

a plurality of sensors inside the first autonomous vehicle, wherein at least one of the sensors is configured to capture a second set of images during the autonomous vehicle ride,

wherein the second set of images include views inside the first autonomous vehicle,

wherein the second set of images include a first image of a passenger inside the first autonomous vehicle, and

wherein the plurality of sensors inside the first autonomous vehicle includes a microphone configured to detect an audio cue, and wherein the audio cue triggers an image capture event; and

a transmitter configured to transmit the first and second sets of images from the first autonomous vehicle to a remote computer system after completion of the autonomous vehicle ride; and

a central computing system configured to:

receive the first and second sets of images from the first autonomous vehicle,

layer a greenscreen effect into the first image to generate a different background view, the different background view based on a view behind the first autonomous vehicle captured by an exterior camera of the sensor suite when the first image was captured by the at least one of the plurality of sensors,

create a highlight reel from the first and second sets of images, including at least one of a first subset of images from the first set of images and a second subset of images from the second set of images, and

link the highlight reel with a user account for the passenger.

17. The system of claim 16 , further comprising a third autonomous vehicle configured to capture a third set of images during a second autonomous vehicle ride in the third autonomous vehicle, and wherein the central computing system is configured to receive the third set of images and create the highlight reel including at least a third subset of images from the third set of images.

18. The system of claim 16 , wherein the central computing system is configured to communicate with a user device via a rideshare application, and wherein the first and second sets of images are viewable on the user device via the rideshare application.

19. The system of claim 18 , wherein the central computing system is configured to transmit respective images from the first and second sets of images to a social media platform upon receiving a user request to share the respective images.

20. The system of claim 16 , further comprising a third autonomous vehicle, wherein the second autonomous vehicle is configured to capture an image of the first autonomous vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2021
From: STUMPF, KATHERINE MARY; ACOSTA, ANDREW DAVID; GERRESE, ALEXANDER WILLEM; JUEL, JEREMY STEPHEN
To: GM CRUISE HOLDINGS LLC
Reel/Frame 056264/0679 →
Continuity (1)
Related Publication 20220366172A1 · Nov 17, 2022