📦
SkillBuild & connect

Serving Health

Check the serving path as a service: training-serving skew, latency at the tail, cost per prediction, and a way back to the previous version. Use before promotion and continuously afterwards.

by NeboAIv1.0.0

About this skill

Check the serving path as a service: training-serving skew, latency at the tail, cost per prediction, and a way back to the previous version. Use before promotion and continuously afterwards.