IP Library Granted Patent US 11,041,733
Granted Patent B2
US 11,041,733 · App. 16/166,612 · Granted Jun 22, 2021

Determining a pickup location for a vehicle based on real-time contextual information

Inventors: Eric V. Kline (Rochester, MN); Sarbajit K. Rakshit (Kolkata, IN)
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
G01C21/3438G01C21/32G01C21/3461G01C21/3484G05D1/0088G06F16/29G07C5/008G05D2201/0213
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,041,733
App. No.
16/166,612
Granted
Jun 22, 2021
Kind
B2
Abstract

A computer-implemented method includes capturing an original image. In the original image, a plurality of potential pickup locations are identified. Each potential pickup location of the plurality of potential pickup locations is associated with a respective metadata set of a plurality of metadata sets. An annotated image is generated based on the original image, where the annotated image indicates the plurality of potential pickup locations and the respective metadata set associated with each potential pickup location. A selection of a pickup location, from among the plurality of potential pickup locations, is received. The pickup location is transmitted to a remote server to facilitate a ride beginning at the pickup location.

Claims (60)

1. A computer-implemented method comprising:

capturing an original image by a mobile device requesting a ride for a user in order to identify, in the original image, a plurality of potential pickup locations, the plurality of potential pickup locations being recommended based on whether a street has to be crossed to reach a potential pickup location and a proximity of crosswalks for crossing any street that needs to be crossed;

associating each potential pickup location of the plurality of potential pickup locations with a respective metadata set of a plurality of metadata sets, wherein the plurality of metadata sets comprise static metadata and dynamic metadata, the static metadata and the dynamic metadata being associated with a field of view of the mobile device requesting the ride for the user, the static metadata comprising disability access, traffic laws, and allowed stopping time;

generating an annotated image, for display on the mobile device, based on the original image associated with the field of view of the mobile device requesting the ride for the user, wherein the annotated image indicates the plurality of potential pickup locations and the respective metadata set associated with each potential pickup location thereby providing situational awareness to the user, wherein the annotated image highlights all the plurality of potential pickup locations;

receiving, by the mobile device, a selection of a pickup location from among the plurality of potential pickup locations; and

transmitting, by the mobile device, the pickup location to a remote server to facilitate the ride beginning at the pickup location, a perspective of the field of view of the mobile device of the user being available to a remote driver application.

2. The computer-implemented method of claim 1 , further comprising presenting one or more recommendations in the annotated image, wherein the presenting the one or more recommendations comprises:

determining a respective user score for each of the plurality of potential pickup locations, based on a set of user factors associated with a user; and

applying a first set of highlighting, in the annotated image, to at least one potential pickup location based on the respective user score of the at least one potential pickup location.

3. The computer-implemented method of claim 2 , wherein the presenting the one or more recommendations further comprises:

determining a respective driver score for each of the plurality of potential pickup locations, based on a set of driver factors associated with a driver, wherein the driver is distinct from the user; and

applying a second set of highlighting, in the annotated image, to the at least one potential pickup location based on the respective driver score of the at least one potential pickup location;

wherein the first set of highlighting is combined with the second set of highlighting.

4. The computer-implemented method of claim 3 , further comprising:

receiving, from the remote driver application assigned to the ride, a selection of a first potential pickup location from among the plurality of potential pickup locations;

displaying, in the annotated image, the selection of the first potential pickup location; and

approving the selection of the first potential pickup location.

5. The computer-implemented method of claim 3 , wherein the receiving the selection of the pickup location from among the plurality of potential pickup locations comprises facilitating a negotiation with the remote driver application.

6. The computer-implemented method of claim 1 , wherein the static metadata does not change or changes infrequently relative to the dynamic metadata, the static metadata and the dynamic metadata both being associated with a location of the user awaiting the ride.

7. The computer-implemented method of claim 1 , wherein the annotated image is a panoramic image.

8. A system comprising: a memory having computer-readable instructions; and

one or more processors for executing the computer-readable instructions, the computer-readable instructions comprising:

capturing an original image by a mobile device requesting a ride for a user in order to identify, in the original image, a plurality of potential pickup locations, the plurality of potential pickup locations being recommended based on whether a street has to be crossed to reach a potential pickup location and a proximity of crosswalks for crossing any street that needs to be crossed;

associating each potential pickup location of the plurality of potential pickup locations with a respective metadata set of a plurality of metadata sets, wherein the plurality of metadata sets comprise static metadata and dynamic metadata, the static metadata and the dynamic metadata associated with a field of view of the mobile device requesting the ride for the user, the static metadata comprising disability access, traffic laws, and allowed stopping time;

generating an annotated image, for display on the mobile device, based on the original image, wherein the annotated image indicates the plurality of potential pickup locations and the respective metadata set associated with each potential pickup location thereby providing situational awareness to the user, wherein the annotated image highlights all or a subset of the plurality of potential pickup locations;

receiving a selection of a pickup location from among the plurality of potential pickup locations; and

transmitting the pickup location to a remote server to facilitate a ride beginning at the pickup location, a perspective of the field of view of the mobile device of the user being available to a remote driver application.

9. The system of claim 8 , the computer-readable instructions further comprising presenting one or more recommendations in the annotated image, wherein the presenting the one or more recommendations comprises:

determining a respective user score for each of the plurality of potential pickup locations, based on a set of user factors associated with a user; and

applying a first set of highlighting, in the annotated image, to at least one potential pickup location based on the respective user score of the at least one potential pickup location.

10. The system of claim 9 , wherein the presenting the one or more recommendations further comprises:

determining a respective driver score for each of the plurality of potential pickup locations, based on a set of driver factors associated with a driver, wherein the driver is distinct from the user; and

applying a second set of highlighting, in the annotated image, to the at least one potential pickup location based on the respective driver score of the at least one potential pickup location;

wherein the first set of highlighting is combined with the second set of highlighting.

11. The system of claim 10 , the computer-readable instructions further comprising:

receiving, from the remote driver application assigned to the ride, a selection of a first potential pickup location from among the plurality of potential pickup locations;

displaying, in the annotated image, the selection of the first potential pickup location; and

approving the selection of the first potential pickup location.

12. The system of claim 10 , wherein the receiving the selection of the pickup location from among the plurality of potential pickup locations comprises facilitating a negotiation with the remote driver application.

13. The system of claim 8 , wherein the static metadata does not change or changes infrequently relative to the dynamic metadata, the static metadata and the dynamic metadata both being associated with a location of the user awaiting the ride.

14. The system of claim 8 , wherein the annotated image is a panoramic image.

15. A computer-program product for determining a pickup location, the computer-program product comprising a computer-readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to perform a method comprising:

capturing an original image by a mobile device requesting a ride for a user in order to identify, in the original image, a plurality of potential pickup locations, the plurality of potential pickup locations being recommended based on whether a street has to be crossed to reach a potential pickup location and a proximity of crosswalks for crossing any street that needs to be crossed;

associating each potential pickup location of the plurality of potential pickup locations with a respective metadata set of a plurality of metadata sets, wherein the plurality of metadata sets comprise static metadata and dynamic metadata, the static metadata and the dynamic metadata being associated with a field of view of the mobile device requesting the ride for the user, the static metadata comprising disability access, traffic laws, and allowed stopping time;

generating an annotated image, for display on the mobile device, based on the original image, wherein the annotated image indicates the plurality of potential pickup locations and the respective metadata set associated with each potential pickup location thereby providing situational awareness to the user, wherein the annotated image highlights all or a subset of the plurality of potential pickup locations;

receiving a selection of a pickup location from among the plurality of potential pickup locations; and

transmitting the pickup location to a remote server to facilitate a ride beginning at the pickup location, a perspective of the field of view of the mobile device of the user being available to a remote driver application.

16. The computer-program product of claim 15 , the method further comprising presenting one or more recommendations in the annotated image, wherein the presenting the one or more recommendations comprises:

determining a respective user score for each of the plurality of potential pickup locations, based on a set of user factors associated with a user; and

applying a first set of highlighting, in the annotated image, to at least one potential pickup location based on the respective user score of the at least one potential pickup location.

17. The computer-program product of claim 16 , wherein the presenting the one or more recommendations further comprises:

determining a respective driver score for each of the plurality of potential pickup locations, based on a set of driver factors associated with a driver, wherein the driver is distinct from the user; and

applying a second set of highlighting, in the annotated image, to the at least one potential pickup location based on the respective driver score of the at least one potential pickup location;

wherein the first set of highlighting is combined with the second set of highlighting.

18. The computer-program product of claim 17 , the method further comprising:

receiving, from the remote driver application assigned to the ride, a selection of a first potential pickup location from among the plurality of potential pickup locations;

displaying, in the annotated image, the selection of the first potential pickup location; and

approving the selection of the first potential pickup location.

19. The computer-program product of claim 15 , wherein the static metadata does not change or changes infrequently relative to the dynamic metadata, the static metadata and the dynamic metadata both being associated with a location of the user awaiting the ride, the plurality of potential pickup locations being recommended based on current traffic on each street that needs to be crossed, obstacles that need to be navigated on a route to the potential pickup location, whether weather shields are present between a user's current location and the potential pickup location, whether the user has luggage that would need to be carried with the user to the potential pickup location, a length of time available for loading or onboarding at the potential pickup location, whether disability access is available, and whether there exists an indoor waiting area for the potential pickup location.

20. The computer-implemented method of claim 1 , wherein the dynamic metadata is selected from the group consisting of weather conditions, event information, and temporary blockages.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 22, 2018
From: KLINE, ERIC V.; RAKSHIT, SARBAJIT K.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 047264/0727 →
Continuity (1)
Related Publication 20200124427A1 · Apr 23, 2020
Cited By (2)
US 12,422,266 US 12,669,344