CatBoost — A new game of Machine Learning

Why CatBoost?

Better Results

GBDT Algorithms Benchmark

Faster Predictions

Left: CPU, Right: GPU

Batteries Included

GBDT Algorithms with default parameters Benchmark

Battle Tested

The Algorithm

Classic Gradient Boosting

Gradient Boosting on Wikipedia

CatBoost Secret Sauce

Categorical Feature Handling

Ordered Target Statistic

One Hot Encoding

CatBoost’s Secret Sauce

Ordered Boosting

Catboost Ordered Boosting and Tree Building

Tuning Catboost

Important Parameters

Model Exploration with Catboost

Catboost’s Feature Importance
Catboost’s Feature Interactions
Catboost’s Object Importance
SHAP values can be used for other ensembles as well
Image taken from CatBoost official documentation:

Building highly accurate models at blazing speeds



Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store


Affine is a provider of analytics solutions, working with global organizations solving their strategic and day to day business problems