Monitor embedding drift for LLMs deployed from Amazon SageMaker JumpStart
AWS Machine Learning Blog
FEBRUARY 2, 2024
In this post, you’ll see an example of performing drift detection on embedding vectors using a clustering technique with large language models (LLMS) deployed from Amazon SageMaker JumpStart. Then we use K-Means to identify a set of cluster centers. A visual representation of the silhouette score can be seen in the following figure.
108 
Let's personalize your content