Using Istio for TF Serving
Version v0.6 of the documentation is no longer actively maintained. The site that you are currently viewing is an archived snapshot. For up-to-date documentation, see the latest version.
Model serving using Seldon
Model serving using TRT Inference Server
Serving TensorFlow models
Batch prediction for TensorFlow models
Instructions for serving a PyTorch model with Seldon
Was this page helpful?
Glad to hear it! Please tell us how we can improve.
Sorry to hear that. Please tell us how we can improve.