AWS Machine Learning Blog

DECEMBER 9, 2024

With access to a wide range of generative AI foundation models (FM) and the ability to build and train their own machine learning (ML) models in Amazon SageMaker , users want a seamless and secure way to experiment with and select the models that deliver the most value for their business.

AWS 92

AWS ML ML Data Scientist 92

KDnuggets

NOVEMBER 10, 2021

Data Scientist Career Path: from Novice to First Job; Understand Neural Networks from a Bayesian Perspective; The Best Ways for Data Professionals to Market AWS Skills; Build Your Own Automated Machine Learning App.

Data Scientist 202

Data Scientist Machine Learning Machine Learning AWS 202

AWS Machine Learning Blog

DECEMBER 24, 2024

To simplify infrastructure setup and accelerate distributed training, AWS introduced Amazon SageMaker HyperPod in late 2023. In this blog post, we showcase how you can perform efficient supervised fine tuning for a Meta Llama 3 model using PEFT on AWS Trainium with SageMaker HyperPod. architectures/5.sagemaker-hyperpod/LifecycleScripts/base-config/

AWS 102

AWS Clustering Deep Learning Deep Learning 102

AWS Machine Learning Blog

NOVEMBER 26, 2024

Amazon SageMaker Studio is the first integrated development environment (IDE) purposefully designed to accelerate end-to-end machine learning (ML) development. You can create multiple Amazon SageMaker domains , which define environments with dedicated data storage, security policies, and networking configurations.

AWS 87

AWS Data Scientist ML ML 87

AWS Machine Learning Blog

OCTOBER 22, 2024

Amazon SageMaker is a cloud-based machine learning (ML) platform within the AWS ecosystem that offers developers a seamless and convenient way to build, train, and deploy ML models. By using a combination of AWS services, you can implement this feature effectively, overcoming the current limitations within SageMaker.

AWS 109

AWS ML ML Machine Learning 109

AWS Machine Learning Blog

OCTOBER 16, 2024

The company developed an automated solution called Call Quality (CQ) using AI services from Amazon Web Services (AWS). It uses deep learning to convert audio to text quickly and accurately. AWS Lambda is used in this architecture as a transcription processor to store the processed transcriptions into an Amazon OpenSearch Service table.

AWS 82

AWS AI AI Machine Learning 82

AWS Machine Learning Blog

MARCH 15, 2023

Tens of thousands of AWS customers use AWS machine learning (ML) services to accelerate their ML development with fully managed infrastructure and tools. We demonstrate how two different personas, a data scientist and an MLOps engineer, can collaborate to lift and shift hundreds of legacy models.

Machine Learning 140

Machine Learning AWS Machine Learning Data Scientist 140

Dataconomy

APRIL 28, 2023

Machine learning deployment is a crucial step in bringing the benefits of data science to real-world applications. With the increasing demand for machine learning deployment, various tools and platforms have emerged to help data scientists and developers deploy their models quickly and efficiently.

Machine Learning 193

Machine Learning Machine Learning Data Science Data Scientist 193

AWS Machine Learning Blog

OCTOBER 29, 2024

Recently, we’ve been witnessing the rapid development and evolution of generative AI applications, with observability and evaluation emerging as critical aspects for developers, data scientists, and stakeholders. This feature allows you to separate data into logical partitions, making it easier to analyze and process data later.

AWS 109

AWS AI AI Data Scientist 109

AWS Machine Learning Blog

FEBRUARY 21, 2025

The Hadoop environment was hosted on Amazon Elastic Compute Cloud (Amazon EC2) servers, managed in-house by Rockets technology team, while the data science experience infrastructure was hosted on premises. Communication between the two systems was established through Kerberized Apache Livy (HTTPS) connections over AWS PrivateLink.

Data Science 71

Data Science AWS Hadoop Data Scientist 71

AWS Machine Learning Blog

OCTOBER 16, 2024

Amazon SageMaker supports geospatial machine learning (ML) capabilities, allowing data scientists and ML engineers to build, train, and deploy ML models using geospatial data. See Amazon SageMaker geospatial capabilities to learn more. About the Author Xiong Zhou is a Senior Applied Scientist at AWS.

ML 108

ML ML Clustering Machine Learning 108

AWS Machine Learning Blog

OCTOBER 29, 2024

Refer to Supported Regions and models for batch inference for current supporting AWS Regions and models. To address this consideration and enhance your use of batch inference, we’ve developed a scalable solution using AWS Lambda and Amazon DynamoDB. Amazon S3 invokes the {stack_name}-create-batch-queue-{AWS-Region} Lambda function.

AWS 120

AWS Data Scientist AI AI 120

Flipboard

JANUARY 6, 2025

(Precise), an Amazon Web Services (AWS) Partner , participated in the AWS Think Big for Small Business Program (TBSB) to expand their AWS capabilities and to grow their business in the public sector. This customer wanted to use machine learning as a tool to digitize images and recognize handwriting.

AWS 65

AWS ML ML Machine Learning 65

AWS Machine Learning Blog

MARCH 10, 2025

We walk through the journey Octus took from managing multiple cloud providers and costly GPU instances to implementing a streamlined, cost-effective solution using AWS services including Amazon Bedrock, AWS Fargate , and Amazon OpenSearch Service. Along the way, it also simplified operations as Octus is an AWS shop more generally.

AWS 98

AWS Database AI AI 98

AWS Machine Learning Blog

DECEMBER 19, 2023

Artificial intelligence (AI) and machine learning (ML) are becoming an integral part of systems and processes, enabling decisions in real time, thereby driving top and bottom-line improvements across organizations. Machine learning operations (MLOps) applies DevOps principles to ML systems.

Machine Learning 128

Machine Learning Machine Learning AWS Analytics 128

Data Science Dojo

FEBRUARY 20, 2023

These tools will help you streamline your machine learning workflow, reduce operational overheads, and improve team collaboration and communication. Machine learning (ML) is the technology that automates tasks and provides insights. It allows data scientists to build models that can automate specific tasks.

Machine Learning 195

Machine Learning Machine Learning AWS Azure 195

Flipboard

NOVEMBER 22, 2024

This post is part of an ongoing series about governing the machine learning (ML) lifecycle at scale. This post dives deep into how to set up data governance at scale using Amazon DataZone for the data mesh. To view this series from the beginning, start with Part 1.

Data Governance 132

Data Governance ML ML Data Lakes 132

AWS Machine Learning Blog

MARCH 21, 2025

JupyterLab applications flexible and extensive interface can be used to configure and arrange machine learning (ML) workflows. Amazon Simple Storage Service (Amazon S3) Amazon S3 is an object storage service built to store and protect any amount of data. We use JupyterLab to run the code for processing formulae and charts.

AWS 113

AWS AI AI Data Scientist 113

AWS Machine Learning Blog

NOVEMBER 14, 2024

Streamlit is an open source framework for data scientists to efficiently create interactive web-based data applications in pure Python. Prerequisites To perform this solution, complete the following: Create and activate an AWS account. Make sure your AWS credentials are configured correctly. Install Python 3.7

AWS 105

AWS Python AI AI 105

AWS Machine Learning Blog

JULY 8, 2024

As industries begin adopting processes dependent on machine learning (ML) technologies, it is critical to establish machine learning operations (MLOps) that scale to support growth and utilization of this technology. AWS CloudTrail – Monitors and records account activity across AWS infrastructure.

AWS 115

AWS ML ML Data Scientist 115

AWS Machine Learning Blog

OCTOBER 1, 2024

Over the last 18 months, AWS has announced more than twice as many machine learning (ML) and generative artificial intelligence (AI) features into general availability than the other major cloud providers combined. The following figure highlights where AWS lands in the DSML Magic Quadrant.

Machine Learning 95

Machine Learning Machine Learning AWS Data Science 95

AWS Machine Learning Blog

FEBRUARY 27, 2024

In this post, we share how Axfood, a large Swedish food retailer, improved operations and scalability of their existing artificial intelligence (AI) and machine learning (ML) operations by prototyping in close collaboration with AWS experts and using Amazon SageMaker.

Machine Learning 135

Machine Learning Machine Learning ML ML 135

IBM Data Science in Practice

APRIL 4, 2023

Introduction This article shows how to monitor a model deployed on AWS Sagemaker for quality, bias and explainability, using IBM Watson OpenScale on the IBM Cloud Pak for Data platform. This article shows how to use the endpoint generated from that tutorial to demonstrate how to monitor the AWS deployment with Watson OpenScale.

AWS 130

AWS Machine Learning Machine Learning Data Science 130

AWS Machine Learning Blog

DECEMBER 4, 2024

Businesses are under pressure to show return on investment (ROI) from AI use cases, whether predictive machine learning (ML) or generative AI. Generate accurate training data for SageMaker models – For model training, data scientists can use Tecton’s SDK within their SageMaker notebooks to retrieve historical features.

ML 93

ML ML AWS AI 93

Flipboard

NOVEMBER 20, 2024

Prerequisites Before proceeding with this tutorial, make sure you have the following in place: AWS account – You should have an AWS account with access to Amazon Bedrock. She leads machine learning projects in various domains such as computer vision, natural language processing, and generative AI. model in Amazon Bedrock.

AWS 161

AWS Natural Language Processing Machine Learning Machine Learning 161

AWS Machine Learning Blog

AUGUST 5, 2024

This post demonstrates how to seamlessly automate the deployment of an end-to-end RAG solution using Knowledge Bases for Amazon Bedrock and AWS CloudFormation , enabling organizations to quickly and effortlessly set up a powerful RAG system. On the AWS CloudFormation console, create a new stack. txt,md,html,doc/docx,csv,xls/.xlsx,pdf).

AWS 124

AWS Natural Language Processing Machine Learning Machine Learning 124

AWS Machine Learning Blog

JANUARY 29, 2025

In this post, we explore how to deploy distilled versions of DeepSeek-R1 with Amazon Bedrock Custom Model Import, making them accessible to organizations looking to use state-of-the-art AI capabilities within the secure and scalable AWS infrastructure at an effective cost. You can monitor costs with AWS Cost Explorer.

AWS 128

AWS AI ML ML 128

AWS Machine Learning Blog

AUGUST 21, 2024

Amazon DataZone is a data management service that makes it quick and convenient to catalog, discover, share, and govern data stored in AWS, on-premises, and third-party sources. Solution overview In this section, we provide an overview of three personas: the data admin, data publisher, and data scientist.

Machine Learning 117

Machine Learning Machine Learning Data Governance ML 117

AWS Machine Learning Blog

JANUARY 5, 2024

This post was written in collaboration with Bhajandeep Singh and Ajay Vishwakarma from Wipro’s AWS AI/ML Practice. Many organizations have been using a combination of on-premises and open source data science solutions to create and manage machine learning (ML) models.

AWS 132

AWS Data Science ML ML 132

AWS Machine Learning Blog

OCTOBER 28, 2024

Real-world applications vary in inference requirements for their artificial intelligence and machine learning (AI/ML) solutions to optimize performance and reduce costs. aws s3 rm s3://{bucket}/{prefix_name}/model-monitor/data-capture/{predictor.endpoint_name} --recursive ! Data Scientist with AWS Professional Services.

ML 106

ML ML AWS AI 106

Data Science Dojo

AUGUST 24, 2023

While DevOps and MLOps share many similarities, MLOps requires a more specialized set of tools and practices to address the unique challenges posed by data-driven and computationally intensive ML workflows. AWS Integration : As Netflix developed Metaflow, it closely integrates with Amazon Web Services (AWS) infrastructure.

Machine Learning 195

Machine Learning Machine Learning ML ML 195

AWS Machine Learning Blog

APRIL 29, 2024

This is a guest post co-authored with Ville Tuulos (Co-founder and CEO) and Eddie Mattia (Data Scientist) of Outerbounds. For AWS and Outerbounds customers, the goal is to build a differentiated machine learning and artificial intelligence (ML/AI) system and reliably improve it over time.

AWS 123

AWS ML ML Python 123

IBM Data Science in Practice

MARCH 8, 2023

Introduction This article shows how to build a machine learning model on a Watson Studio platform running on IBM Cloud Pak for Data (CPD). You can then export the model and deploy it on Amazon Sagemaker on Amazon Web Server (AWS). environment running on IBM Cloud Pak for Data 4.5.x,

AWS 130

AWS Machine Learning Machine Learning Algorithm 130

Towards AI

JANUARY 29, 2025

Generative AI is powered by advanced machine learning techniques, particularly deep learning and neural networks, such as Generative Adversarial Networks (GANs) and Variational Autoencoders (VAEs). Roles like AI Engineer, Machine Learning Engineer, and Data Scientist are increasingly requiring expertise in Generative AI.

Deep Learning 98

Deep Learning Deep Learning Machine Learning Machine Learning 98

AWS Machine Learning Blog

NOVEMBER 14, 2024

We recently announced the general availability of cross-account sharing of Amazon SageMaker Model Registry using AWS Resource Access Manager (AWS RAM) , making it easier to securely share and discover machine learning (ML) models across your AWS accounts.

AWS 95

AWS ML ML Machine Learning 95

AWS Machine Learning Blog

DECEMBER 7, 2023

In this post, we describe the end-to-end workforce management system that begins with location-specific demand forecast, followed by courier workforce planning and shift assignment using Amazon Forecast and AWS Step Functions. AWS Step Functions automatically initiate and monitor these workflows by simplifying error handling.

AWS 125

AWS Algorithm Data Science Machine Learning 125

AWS Machine Learning Blog

APRIL 4, 2025

When we launched LLM-as-a-judge (LLMaJ) and Retrieval Augmented Generation (RAG) evaluation capabilities in public preview at AWS re:Invent 2024 , customers used them to assess their foundation models (FMs) and generative AI applications, but asked for more flexibility beyond Amazon Bedrock models and knowledge bases.

AWS 111

AWS AI AI ML 111