Seldon Core Roadmap¶
The high level roadmap for Seldon Core. Feedback and additions very welcome.
Core (required for 1.0)¶
- SeldonDeployment K8S CRD stability
- API stability
- External API (predict, feedback endpoints)
- Internal microservice API (predict, transform, route etc.)
- Wrapper stability for core wrappers
- Python reference wrapper
- Metrics and logging stability
- Benchmarks for ongoing optimisation
Reference Examples (desired for 1.0)¶
- ML Examples for various toolkits
- Core components
- Outlier Detection
- Concept drift
- Model Explanation
- E2E pipeline examples
- Kubeflow/Kubeflow Pipelines
- CI/CD
- GPU/TPU
- Deployment
- Rolling, Canary, Red-Green
Developer (required for 1.0)¶
- Unit Test Coverage
- E2E tests
- CI pipelines (Prow)
- Automated release process
- Core, Python PyPI, AWS Marketplace, Google Marketplace, Kubeflow, helm charts, ksonnet
- New Documentation site
Specific Functionality¶
Please provide feedback and additions for helping us decide priorities.
- Autoscaling
- Kubeflow Pipelines integration
- No service orchestrator for single model deployments
- Wider range of image build integrations: e.g., Kaniko, img, GCB
- NVIDIA Rapids, Dali integration
- Julia, C++ wrappers
- Shadow deployments
- Edge deployments
- Use of Apache Arrow for zero-copy, zero bandwidth RPC
- Further Istio integration
- Nginx-ingress
- Openshift integration
- Serverless/KNative