Command Line Scripts
Seldon provides several scripts to aid starting Seldon, provisioning services and stopping Seldon.
Create Seldon on a running kubernetes cluster.
To launch seldon with all components run
To start with GlusterFS run
To start without a Spark cluster
Shutdown Seldon running on a Kubernetes cluster
See the detailed seldon-cli documentation.
Start one or more microservices for a particular client. The microservices can be REST or for predictions also gRPC based.
The script allows you to start microservices of two types:
- Microservices already package as a Docker image
- Microservices started from a saved python scikit-learn pipeline using pyseldon
Start a recommendation microservice from a built Docker image exposed as REST endpoint for the client “reuters”. See the worked Reuters content recommendation example.
Start a prediction REST microservice from a saved pipeline previously saved to /seldon-data/seldon-models/finefoods/1 for client “test”. See the worked sentiment analysis demo.
Start a prediction microservice from an xgboost mode exposed as a REST service and packaged in a docker image. See worked example in the Iris prediction demo.
Start and AB test with two microservices.
Start gRPC microservice for Iris demo
Create a locust loadtest. Presently for prediction services only. Handles REST and gRPC