How Booking.com serves Deep Learning model predictions

With so many machine learning frameworks and libraries available, writing a model isn’t a bottleneck anymore while putting your models in production is still a challenge.

In this talk, you will learn how we deploy the python deep learning models in production at Booking.com.

Topics will include:

• Deep Learning model training in Docker containers
• Automated retraining of models
• Deployment of models using Kubernetes
• Serving model predictions in containerized environment
• Optimising serving predictions for latency and throughput