Supported Versions

This article describes the supported versions and compatibility with supported ML frameworks. For some frameworks, links to example repositories on Gitlab are included. These example repositories can be used to create example deployments on Deeploy.

Deeploy	1.29.x - 1.31.x	1.32.x - 1.37.x	1.38.x +
KServe	0.9.0	0.11.0	0.12.0
Python	3.7 - 3.9	3.8 - 3.11	3.8 - 3.11

Model Frameworks

The versions described in the following sections are the recommended versions on which the model images have been built. If you deviate from the version, check for potential compatibility issues.

PyTorch

• Example: https://gitlab.com/deeploy-ml/sample-models/example-pytorch-agenet
• Expected pre-trained model artefact: Model Archive

Pytorch default image	pytorch/torchserve-kfs:0.6.0	pytorch/torchserve-kfs:0.8.0	pytorch/torchserve-kfs:0.9.0
torch	1.7.1	2.0.0	2.1.0
torchserve	0.7.0	0.8.0	0.9.0
torch-model-archiver	0.7.0	0.8.0	0.9.0

Tensorflow

• Example: https://gitlab.com/deeploy-ml/sample-models/imdb
• Expected pre-trained model artefact: SavedModel

Tensorflow default image	tensorflow/serving:2.6.2	tensorflow/serving:2.6.2
tensorflow	2.6.2	2.6.2

XGBoost

• Example: https://gitlab.com/deeploy-ml/sample-models/iris-proba
• Expected pre-trained model artefact: Booster (model.bst)

XGBoost default image	kserve/xgbserver:v0.9.0	kserve/xgbserver:v0.11.0	kserve/xgbserver:v0.12.0
xgboost	1.5.0	1.7.5	2.0.2

Scikit-learn

• Example: https://gitlab.com/deeploy-ml/sample-models/example-sklearn-census
• Expected pre-trained model artefact: Joblib (model.joblib)

Scikit-learn default image	kserve/sklearnserver:v0.9.0	kserve/sklearnserver:v0.11.0
scikit-learn	1.0.1	1.3.0
joblib	1.1.0	1.3.1

LightGBM

• Example: https://gitlab.com/deeploy-ml/sample-models/example-sklearn-census
• Expected pre-trained model artefact: Booster (model.bst)

LightGBM default image	kserve/lgbserver:v0.9.0	kserve/lgbserver:v0.11.0
lightgbm	3.3.2	3.3.5

Custom model Docker images

• Example: https://gitlab.com/deeploy-ml/sample-models/example-custom-image

Deeploy version	Private Cloud < v1.32.0	Private Cloud >= v1.32.0, < v1.38.0	Cloud & Private Cloud >= v1.38.0
deeploy-cli	-	> 1.35.0	> 1.38.0
kserve	0.9.0	0.11.0	0.12.0

Standard Explainers

Tree SHAP

Deploy a tree SHAP explainer without training it yourself. Available only for tree-based classification models when using the XGBoost, Scikit-learn, or LightGBM model frameworks.

Saliency

Deploy a saliency based explainer without training it yourself. Available only for text generation and text-to-text generation models when using the Hugging Face model framework.

Attention

Deploy a attention based explainer without training it yourself. Available only for text generation and text-to-text generation models when using the Hugging Face model framework.

Trained Explainer Frameworks

The versions described in the following sections are the recommended versions for the specific frameworks to use. If you deviate from the version, check for potential compatibility issues.

SHAP

• Example: https://gitlab.com/deeploy-ml/sample-models/example-sklearn-census
• Expected pre-trained explainer artefact: dill (explainer.dill)

Deeploy version	Private Cloud < v1.32.0	Cloud & Private Cloud >= v1.32.0
shap	0.36.0	0.42.1
dill	0.3.3	0.3.7

Anchors

• Example: https://gitlab.com/deeploy-ml/sample-models/income
• Expected pre-trained explainer artefact: dill (explainer.dill)

Deeploy version	Private Cloud < v1.32.0	Cloud & Private Cloud >= v1.32.0
alibi	0.6.4	0.9.4
dill	0.3.3	0.3.7

MACE

• Example: https://gitlab.com/deeploy-ml/sample-models/example-fraud-detection
• Expected pre-trained explainer artefact: dill (explainer.dill)

Deeploy version	Private Cloud < v1.32.0	Cloud & Private Cloud >= v1.32.0
omnixai	1.1.4	1.3.1
dill	0.3.3	0.3.7

PDP

• Expected pre-trained explainer artefact: dill (explainer.dill)

Deeploy version	Private Cloud < v1.32.0	Cloud & Private Cloud >= v1.32.0
omnixai	1.1.4	1.3.1
dill	0.3.3	0.3.7

Custom explainer Docker images

Deeploy version	Private Cloud < v1.32.0	Private Cloud >= v1.32.0, < v1.38.0	Cloud & Private Cloud >= v1.38.0
deeploy-cli	-	> 1.35.0	>= 1.38.0
kserve	0.9.0	0.11.0	0.12.0

Transformer Frameworks

Custom transformer Docker images

Deeploy version	Private Cloud < v1.32.0	Private Cloud >= v1.32.0, < v1.38.0	Cloud & Private Cloud >= v1.38.0
deeploy-cli	-	> 1.35.0	>= 1.38.0
kserve	0.9.0	0.11.0	0.12.0