A “smart city” initiative has received data from the Washington DC bike sharing system. They want to use this data to gain a better understanding of the usage patterns across the city. Any discovered patterns can be used to improve the bike sharing system for customers and the city’s overall transit efforts.
As a first step towards this goal, we will try to identify clusters of “similar” bike stations. Station similarity will be based on the types of users beginning trips from each station.
This use case incorporates the following data sources:
Capital Bikeshare provides data on each bike trip, including an index of the available data. We will use a Download recipe in the walkthrough to create datasets from 2016 and 2017 files.
Capital Bikeshare provides an XML file with the list of bike stations and associated information about each station. We will use a Download recipe in the walkthrough to create a dataset from this file.
We can use US census data to enrich the bike stations dataset with demographic information at the “block group” geographic level. Its archive can be downloaded here.
The final Dataiku DSS pipeline appears below. You can also find a completed version of the project in the Dataiku gallery.
The Flow has the following high-level steps:
Collect the data to form the input datasets
Clean the datasets
Join the datasets based on census blocks and station IDs
Create and deploy a clustering model
Update the model based upon new data
You should be familiar with:
The Basics courses,
The Pivot recipe,
Machine Learning in Dataiku DSS