Anyone who’s ever deployed on the edge has had this hope before: “It ran perfectly on my cloud environment, it’ll surely work when I deploy it across these other different environments”. Unfortunately, much of the time, this hope falls flat. This is frustratingly true for those deploying machine learning models on the edge. These models are often painstakingly trained and fine-tuned over months and days to achieve those extra few percentage points of accuracy… Only to see performance drop by over 10% once deployed to an edge device. This session will cover common problems encountered when deploying machine learning models on the edge, and how MLExray, an open-source observability framework created at Stanford, can be used to help debug these issues when they inevitably occur. *MLExray has been accepted into MLSys 2022: https://arxiv.org/pdf/2111.04779.pdf
Click here to view captioning/translation in the MeetingPlay platform!
