Notebooks

Prepackaged Inference Server Examples

• Deploy a Scikit-learn Model Binary
• Deploy a Tensorflow Exported Model
• MLflow Pre-packaged MOdel Server A/B Test
• Deploy a XGBoost Model Binary

Python Language Wrapper Examples

• Scikit-learn Spacy Reddit Text Classification Tutorial
• SKLearn Iris Classifier
• Sagemaker SKLearn Example
• TFserving MNIST

Specialised Framework Examples

• NVIDIA TensorRT MNIST
• OpenVINO ImageNet
• OpenVINO ImageNet Ensemble

Incubating Projects Examples

• Kubeflow Seldon E2E Pipeline
• H2O Java MoJo
• Outlier Detection with Combiner

Cloud-Specific Examples

• AWS EKS Tensorflow Deep MNIST
• Azure AKS Tensorflow Deep MNIST
• GKE with GPU Tensorflow Deep MNIST
• Alibaba Cloud Tensorflow Deep MNIST

Advanced Machine Learning Insights

• Tabular, Text and Image Model Explainers
• Outlier Detection Seq2Seq LSTM
• Outlier Detection Variational AutoEncoder
• Outlier Detection Isolation Forest
• Outlier Detection Mahalanobis

MLOps: Scaling and Monitoring and Observability

• Request Payload Logging with ELK
• Custom Metrics with Grafana & Prometheus
• Distributed Tracing with Jaeger
• CI / CD with Jenkins Classic
• CI / CD with Jenkins X

Production Configurations and Integrations

• Autoscaling Example
• Example Helm Deployments
• Max gRPC Message Size
• REST timeouts
• Deploy Multiple Seldon Core Operators
• Protocol Examples

Complex Graph Examples

• Chainer MNIST Model Deployment
• Test using Minikube
• Spam Classification TRANSFORMER
• Spam Classification Model (Sklearn)
• Spam Classification Model (keras)

Ingress

• Ambassador Canary
• Ambassador Shadow
• Ambassador Headers
• Ambassador Custom Config
• Istio Canary
• Istio Examples