TorchServe and [TorchElastic for Kubernetes], new PyTorch libraries for serving and training…

Authors: Joe Spisak (Facebook), Aditya Bindal (AWS), Kiuk Chung (Facebook), Mike Stefaniak (AWS) As PyTorch is used more and more in production environments, we’ve continued to see the need to provide better tools and platforms for the community to scale up training and deploy models efficiently. Today, we are excited to introduce TorchServe (Experimental), a new open-source model serving library

[misshiki]

“PyTorchプロジェクトにおけるオープンソースのモデルサービング新ライブラリTorchServe”“PyTorchでの耐障害性と弾力性のあるトレーニングのためのライブラリTorchElasticに統合されたKubernetesコントローラの提供”