Monitor embedding drift for LLMs deployed from Amazon SageMaker JumpStart
AWS Machine Learning Blog
FEBRUARY 2, 2024
Because embeddings are an important source of data for NLP models in general and generative AI solutions in particular, we need a way to measure whether our embeddings are changing over time (drifting). Then we use K-Means to identify a set of cluster centers.
Let's personalize your content