This talk will introduce pipe, an in-house Machine Learning Pipeline that has the capability to power thousands of ML models built on top of user data at Automattic, the company behind WordPress.com. A generalised machine learning pipeline, pipe serves the entire company and helps Automatticians seamlessly build and deploy machine learning models to predict the likelihood that a given event may occur, e.g., installing a plugin, purchasing a plan, or churning. The case studies will demonstrate how predictive models are used in marketing campaigns, discuss experiment setups for online evaluation, touch on uplift modeling, and most importantly, plot a journey to building models that are useful as opposed to just accurate.