AWS Machine Learning Blog

APRIL 4, 2025

When we launched LLM-as-a-judge (LLMaJ) and Retrieval Augmented Generation (RAG) evaluation capabilities in public preview at AWS re:Invent 2024 , customers used them to assess their foundation models (FMs) and generative AI applications, but asked for more flexibility beyond Amazon Bedrock models and knowledge bases. Original price: $153.15

AWS 111

AWS AI AI ML 111

Flipboard

DECEMBER 2, 2024

Today at AWS re:Invent 2024, we are excited to announce a new feature for Amazon SageMaker inference endpoints: the ability to scale SageMaker inference endpoints to zero instances. This long-awaited capability is a game changer for our customers using the power of AI and machine learning (ML) inference in the cloud.

ML 149

ML ML AWS Machine Learning 149

AWS Machine Learning Blog

OCTOBER 29, 2024

This solution uses decorators in your application code to capture and log metadata such as input prompts, output results, run time, and custom metadata, offering enhanced security, ease of use, flexibility, and integration with native AWS services.

AWS 109

AWS AI AI Data Scientist 109

AWS Machine Learning Blog

NOVEMBER 29, 2024

About the Authors Shreyas Subramanian is a Principal Data Scientist and helps customers by using generative AI and deep learning to solve their business challenges using AWS services. Shreyas has a background in large-scale optimization and ML and in the use of ML and reinforcement learning for accelerating optimization tasks.

AI 128

AI AI ML ML 128

AWS Machine Learning Blog

APRIL 29, 2024

For AWS and Outerbounds customers, the goal is to build a differentiated machine learning and artificial intelligence (ML/AI) system and reliably improve it over time. First, the AWS Trainium accelerator provides a high-performance, cost-effective, and readily available solution for training and fine-tuning large models.

AWS 123

AWS ML ML Python 123

AWS Machine Learning Blog

DECEMBER 4, 2024

Building generative AI applications presents significant challenges for organizations: they require specialized ML expertise, complex infrastructure management, and careful orchestration of multiple services. You can obtain the SageMaker Unified Studio URL for your domains by accessing the AWS Management Console for Amazon DataZone.

AWS 104

AWS AI AI SQL 104

AWS Machine Learning Blog

AUGUST 5, 2024

This post demonstrates how to seamlessly automate the deployment of an end-to-end RAG solution using Knowledge Bases for Amazon Bedrock and AWS CloudFormation , enabling organizations to quickly and effortlessly set up a powerful RAG system. On the AWS CloudFormation console, create a new stack. txt,md,html,doc/docx,csv,xls/.xlsx,pdf).

AWS 124

AWS Natural Language Processing Machine Learning Machine Learning 124

AWS Machine Learning Blog

JUNE 26, 2024

Capital markets operation teams face numerous challenges throughout the post-trade lifecycle, including delays in trade settlements, booking errors, and inaccurate regulatory reporting. Artificial intelligence and machine learning (AI/ML) technologies can assist capital market organizations overcome these challenges.

AWS 111

AWS ML ML AI 111

How to Learn Machine Learning

APRIL 10, 2025

Introduction Machine learning (ML) in 2025 will be continuously evolving because businesses from all industries will utilize artificial intelligence to achieve market superiority. The decision you must now make concerns whether to choose AWS SageMaker, a managed service platform or develop an ML solution exclusively.

52

52

AWS Machine Learning Blog

NOVEMBER 30, 2023

The number of companies launching generative AI applications on AWS is substantial and building quickly, including adidas, Booking.com, Bridgewater Associates, Clariant, Cox Automotive, GoDaddy, and LexisNexis Legal & Professional, to name just a few. Innovative startups like Perplexity AI are going all in on AWS for generative AI.

AWS 142

AWS AI AI ML 142

Flipboard

DECEMBER 18, 2024

Amazon OpenSearch Service Amazon OpenSearch Service is a fully managed service that simplifies the deployment, operation, and scaling of OpenSearch in the AWS Cloud to provide powerful search and analytics capabilities. Teams can use OpenSearch Service ML connectors which facilitate access to models hosted on third-party ML platforms.

K-nearest Neighbors 121

K-nearest Neighbors AWS ML ML 121

AWS Machine Learning Blog

MAY 30, 2024

Because Amazon Bedrock is serverless, you don’t have to manage infrastructure, and you can securely integrate and deploy generative AI capabilities into your applications using the AWS services you are already familiar with. AWS Prototyping developed an AWS Cloud Development Kit (AWS CDK) stack for deployment following AWS best practices.

AWS 128

AWS SQL Database AI 128

AWS Machine Learning Blog

MARCH 14, 2024

Generative AI with AWS The emergence of FMs is creating both opportunities and challenges for organizations looking to use these technologies. Beyond hardware, data cleaning and processing, model architecture design, hyperparameter tuning, and training pipeline development demand specialized machine learning (ML) skills.

AWS 130

AWS AI AI ML 130

AWS Machine Learning Blog

MAY 4, 2023

This post provides an overview of generative AI with a real customer use case, provides a concise description and outlines its benefits, references an easy-to-follow demo of AWS DeepComposer for creating new musical compositions, and outlines how to get started using Amazon SageMaker JumpStart for deploying GPT2, Stable Diffusion 2.0,

AWS 98

AWS AI AI ML 98

AWS Machine Learning Blog

JULY 10, 2024

During the last 18 months, we’ve launched more than twice as many machine learning (ML) and generative AI features into general availability than the other major cloud providers combined. Each application can be immediately scaled to thousands of users and is secure and fully managed by AWS, eliminating the need for any operational expertise.

AWS 135

AWS AI AI Machine Learning 135

AWS Machine Learning Blog

AUGUST 15, 2024

With over 50 connectors, an intuitive Chat for data prep interface, and petabyte support, SageMaker Canvas provides a scalable, low-code/no-code (LCNC) ML solution for handling real-world, enterprise use cases. Afterward, you need to manage complex clusters to process and train your ML models over these large-scale datasets.

ML 123

ML ML Data Preparation AWS 123

AWS Machine Learning Blog

DECEMBER 11, 2024

In this post, we illustrate how EBSCOlearning partnered with AWS Generative AI Innovation Center (GenAIIC) to use the power of generative AI in revolutionizing their learning assessment process. This correctly reflects the assertion of the Consumer Relevancy model as described in the Book Summary. Sonnet model in Amazon Bedrock.

AI 82

AI AI AWS Machine Learning 82

Flipboard

NOVEMBER 28, 2023

While it might be easier to start looking at an individual machine learning (ML) model and the associated risks in isolation, it’s important to consider the details of the specific application of such a model and the corresponding use case as part of a complete AI system. In this post, we focus on AI system risk, primarily.

AWS 173

AWS AI AI ML 173

AWS Machine Learning Blog

OCTOBER 23, 2024

The solution’s scalability quickly accommodates growing data volumes and user queries thanks to AWS serverless offerings. It also uses the robust security infrastructure of AWS to maintain data privacy and regulatory compliance. Amazon API Gateway routes the incoming message to the inbound message handler, executed on AWS Lambda.

AWS 93

AWS Natural Language Processing AI AI 93

AWS Machine Learning Blog

MAY 7, 2024

Solution overview The entire infrastructure of the solution is provisioned using the AWS Cloud Development Kit (AWS CDK), which is an infrastructure as code (IaC) framework to programmatically define and deploy AWS resources. AWS CDK version 2.0

AWS 129

AWS ML ML Machine Learning 129

AWS Machine Learning Blog

AUGUST 28, 2024

This post demonstrates how to seamlessly automate the deployment of an end-to-end RAG solution using Knowledge Bases for Amazon Bedrock and the AWS Cloud Development Kit (AWS CDK), enabling organizations to quickly set up a powerful question answering system. The AWS CDK already set up. txt,md,html,doc/docx,csv,xls/.xlsx,pdf).

AWS 92

AWS Natural Language Processing Machine Learning Machine Learning 92

AWS Machine Learning Blog

NOVEMBER 22, 2023

For decades, Amazon has pioneered and innovated machine learning (ML), bringing delightful experiences to its customers. From the earliest days, Amazon has used ML for various use cases such as book recommendations, search, and fraud detection. To use accelerators, you need a software layer to support them.

AWS 112

AWS ML ML Deep Learning 112

AWS Machine Learning Blog

MAY 15, 2024

We cover the technical implementation using the Anthropic Claude large language model (LLM) on Amazon Bedrock and AWS Lambda deployed with the AWS Serverless Application Model (AWS SAM). It is typically helpful when working with lengthy documents such as entire books. The S3 bucket is configured using event notification.

AWS 136

AWS AI AI Artificial Intelligence 136

AWS Machine Learning Blog

JULY 26, 2023

Generative AI Foundations on AWS is a new technical deep dive course that gives you the conceptual fundamentals, practical advice, and hands-on guidance to pre-train, fine-tune, and deploy state-of-the-art foundation models on AWS and beyond. Feel free to reach out to me on Medium, LinkedIn , GitHub , or through your AWS teams.

AWS 96

AWS AI AI Machine Learning 96

AWS Machine Learning Blog

JULY 26, 2023

In this post, we show how you can run Stable Diffusion models and achieve high performance at the lowest cost in Amazon Elastic Compute Cloud (Amazon EC2) using Amazon EC2 Inf2 instances powered by AWS Inferentia2. versions on AWS Inferentia2 cost-effectively. You can run both Stable Diffusion 2.1 The Stable Diffusion 2.1

AWS 95

AWS Deep Learning Deep Learning ML 95

AWS Machine Learning Blog

MAY 8, 2023

With Amazon SageMaker , you can manage the whole end-to-end machine learning (ML) lifecycle. It offers many native capabilities to help manage ML workflows aspects, such as experiment tracking, and model governance via the model registry. To automate the infrastructure deployment, we use the AWS Cloud Development Kit (AWS CDK).

AWS 88

AWS Data Science Machine Learning Machine Learning 88

AWS Machine Learning Blog

MARCH 29, 2023

In this post, we discuss how the IEO developed UNDP’s artificial intelligence and machine learning (ML) platform—named Artificial Intelligence for Development Analytics (AIDA)— in collaboration with AWS, UNDP’s Information and Technology Management Team (UNDP ITM), and the United Nations International Computing Centre (UNICC).

AWS 87

AWS ML ML Data Classification 87

AWS Machine Learning Blog

AUGUST 7, 2024

Innovations in artificial intelligence (AI) and machine learning (ML) are causing organizations to take a fresh look at the possibilities these technologies can offer. ML models in production are not static artifacts. In this post, we refer to the advanced analytics governance account as the AI/ML governance account.

Machine Learning 116

Machine Learning Machine Learning AWS ML 116

AWS Machine Learning Blog

NOVEMBER 22, 2023

The AWS Well-Architected Framework provides a systematic way for organizations to learn operational and architectural best practices for designing and operating reliable, secure, efficient, cost-effective, and sustainable workloads in the cloud. These resources introduce common AWS services for IDP workloads and suggested workflows.

AWS 115

AWS ML ML Machine Learning 115

AWS Machine Learning Blog

APRIL 23, 2024

The AWS Well-Architected Framework provides best practices and guidelines for designing and operating reliable, secure, efficient, and cost-effective systems in the cloud. This post explores the new enterprise-grade features for Knowledge Bases on Amazon Bedrock and how they align with the AWS Well-Architected Framework.

AWS 126

AWS AI AI Machine Learning 126

AWS Machine Learning Blog

FEBRUARY 14, 2024

We build a personalized generative AI travel itinerary planner as part of this example and demonstrate how we can personalize a travel itinerary for a user based on their booking and user profile data stored in Amazon Redshift. An SSL certificate created and imported into AWS Certificate Manager (ACM).

AWS 137

AWS AI AI Database 137

AWS Machine Learning Blog

OCTOBER 23, 2024

SnapLogic uses Amazon Bedrock to build its platform, capitalizing on the proximity to data already stored in Amazon Web Services (AWS). At its core, Amazon Bedrock provides the foundational infrastructure for robust performance, security, and scalability for deploying machine learning (ML) models.

AI 80

AI AI AWS Database 80

Towards AI

JUNE 18, 2024

Many of you asked for an electronic version of our new book, so after working out the kinks, we are finally excited to release the electronic version of “Building LLMs for Production.” We’ve heard many feedback from you guys wanting to have both the e-book and book for different occasions. We listened.

AI 79

AI AI Data Engineering Data Engineering 79

AWS Machine Learning Blog

NOVEMBER 22, 2023

Building a production-ready solution in AWS involves a series of trade-offs between resources, time, customer expectation, and business outcome. The AWS Well-Architected Framework helps you understand the benefits and risks of decisions you make while building workloads on AWS.

AWS 107

AWS ML ML Machine Learning 107

AWS Machine Learning Blog

JULY 24, 2023

In this post we walk you through the process of deploying FastAPI model servers on AWS Inferentia devices (found on Amazon EC2 Inf1 and Amazon EC Inf2 instances). Each AWS Inferentia1 device contains four NeuronCores-v1 and each AWS Inferentia2 device contains two NeuronCores-v2. For example, NEURON_RT_NUM_CORES=2 myapp.py

AWS 90

AWS Deep Learning Deep Learning Python 90

O'Reilly Media

OCTOBER 19, 2021

This is both frustrating for companies that would prefer making ML an ordinary, fuss-free value-generating function like software engineering, as well as exciting for vendors who see the opportunity to create buzz around a new category of enterprise software. What does a modern technology stack for streamlined ML processes look like?

ML 145

ML ML Data Scientist AWS 145

AWS Machine Learning Blog

MARCH 18, 2024

NIM is available as a paid offering as part of the NVIDIA AI Enterprise software subscription available on AWS Marketplace. He works with Amazon.com to design, build, and deploy technology solutions on AWS, and has a particular interest in AI and machine learning. Qing Lan is a Software Development Engineer in AWS.

Deep Learning 126

Deep Learning Deep Learning AWS Machine Learning 126