Inferencing

The Python client can make predictions and get explanations for a certain Deployment.

Predict & Explain

request_body = {
    "instances": [
        [39, 7, 1, 1, 1, 1, 4,
         1, 2174, 0, 40, 9]
    ]
}

prediction = client.predict(deployment_id, request_body)
explanation = client.explain(deployment_id, request_body)

Note: with the current pre-build explainer images it is not possible to do semi-batch explanations (i.e. multiple predictions per request).