AWS Machine Learning Blog

DECEMBER 18, 2024

Training an LLM is a compute-intensive and complex process, which is why Fastweb, as a first step in their AI journey, used AWS generative AI and machine learning (ML) services such as Amazon SageMaker HyperPod. The team opted for fine-tuning on AWS.

Clustering 102

Clustering AWS AI AI 102

AWS Machine Learning Blog

SEPTEMBER 18, 2024

The ZMP analyzes billions of structured and unstructured data points to predict consumer intent by using sophisticated artificial intelligence (AI) to personalize experiences at scale. Additionally, Feast promotes feature reuse, so the time spent on data preparation is reduced greatly.

AWS 126

AWS Machine Learning Machine Learning ML 126

IBM Journey to AI blog

MAY 15, 2024

Data engineers build data pipelines, which are called data integration tasks or jobs, as incremental steps to perform data operations and orchestrate these data pipelines in an overall workflow. Organizations can harness the full potential of their data while reducing risk and lowering costs.

Data Pipeline 85

Data Pipeline ETL SQL Database 85

Data Science Dojo

FEBRUARY 20, 2023

It is used by businesses across industries for a wide range of applications, including fraud prevention, marketing automation, customer service, artificial intelligence (AI), chatbots, virtual assistants, and recommendations. AWS SageMaker also has a CLI for model creation and management.

Machine Learning 195

Machine Learning Machine Learning AWS Azure 195

AWS Machine Learning Blog

FEBRUARY 23, 2023

For more information about distributed training with SageMaker, refer to the AWS re:Invent 2020 video Fast training and near-linear scaling with DataParallel in Amazon SageMaker and The science behind Amazon SageMaker’s distributed-training engines. In a later post, we will do a deep dive into the DNNs used by ADAS systems.

AWS 129

AWS ML ML Machine Learning 129

AWS Machine Learning Blog

OCTOBER 23, 2024

SnapLogic uses Amazon Bedrock to build its platform, capitalizing on the proximity to data already stored in Amazon Web Services (AWS). Control plane and data plane implementation SnapLogic’s Agent Creator platform follows a decoupled architecture, separating the control plane and data plane for enhanced security and scalability.

AI 94

AI AI AWS Database 94

Flipboard

MAY 21, 2025

This post highlights how the UBC CIC uses Amazon Web Services (AWS) to accelerate generative AI development, sharing lessons learned, tools used, and actionable insights you can apply to your projects. Security in generative AI prototyping UBC CIC observes the shared responsibility model through the Amazon Bedrock Data protection features.

AWS 81

AWS AI AI Database 81

Pickl AI

DECEMBER 26, 2024

Each platform offers unique capabilities tailored to varying needs, making the platform a critical decision for any Data Science project. Major Cloud Platforms for Data Science Amazon Web Services ( AWS ), Microsoft Azure, and Google Cloud Platform (GCP) dominate the cloud market with their comprehensive offerings.

Data Science 52

Data Science Cloud Computing Machine Learning Machine Learning 52

Precisely

APRIL 11, 2024

In an era where cloud technology is not just an option but a necessity for competitive business operations, the collaboration between Precisely and Amazon Web Services (AWS) has set a new benchmark for mainframe and IBM i modernization. Solution page Precisely on Amazon Web Services (AWS) Precisely brings data integrity to the AWS cloud.

AWS 72

AWS Cloud Computing Database Data Pipeline 72

AWS Machine Learning Blog

FEBRUARY 1, 2024

Consider the following picture, which is an AWS view of the a16z emerging application stack for large language models (LLMs). This pipeline could be a batch pipeline if you prepare contextual data in advance, or a low-latency pipeline if you’re incorporating new contextual data on the fly.

AWS 139

AWS AI AI Database 139

AWS Machine Learning Blog

JUNE 18, 2024

On December 6 th -8 th 2023, the non-profit organization, Tech to the Rescue , in collaboration with AWS, organized the world’s largest Air Quality Hackathon – aimed at tackling one of the world’s most pressing health and environmental challenges, air pollution. As always, AWS welcomes your feedback.

AWS 135

AWS Python AI AI 135

AWS Machine Learning Blog

FEBRUARY 13, 2024

SageMaker Feature Store now makes it effortless to share, discover, and access feature groups across AWS accounts. With this launch, account owners can grant access to select feature groups by other accounts using AWS Resource Access Manager (AWS RAM). Their task is to construct and oversee efficient data pipelines.

AWS 132

AWS ML ML Machine Learning 132

Flipboard

NOVEMBER 24, 2023

In this post, we will talk about how BMW Group, in collaboration with AWS Professional Services, built its Jupyter Managed (JuMa) service to address these challenges. For example, teams using these platforms missed an easy migration of their AI/ML prototypes to the industrialization of the solution running on AWS.

ML 153

ML ML AWS AI 153

AWS Machine Learning Blog

MARCH 14, 2024

Generative artificial intelligence (generative AI) has enabled new possibilities for building intelligent systems. Given the data sources, LLMs provided tools that would allow us to build a Q&A chatbot in weeks, rather than what may have taken years previously, and likely with worse performance.

SQL 135

SQL AWS AI AI 135

AWS Machine Learning Blog

AUGUST 12, 2024

Instead, organizations are increasingly looking to take advantage of transformative technologies like machine learning (ML) and artificial intelligence (AI) to deliver innovative products, improve outcomes, and gain operational efficiencies at scale.

ML 127

ML ML AWS AI 127

AWS Machine Learning Blog

MARCH 8, 2023

In order to train a model using data stored outside of the three supported storage services, the data first needs to be ingested into one of these services (typically Amazon S3). This requires building a data pipeline (using tools such as Amazon SageMaker Data Wrangler ) to move data into Amazon S3.

ML 135

ML ML AWS Python 135

Flipboard

NOVEMBER 24, 2023

In this post, we show you how SnapLogic , an AWS customer, used Amazon Bedrock to power their SnapGPT product through automated creation of these complex DSL artifacts from human language. SnapLogic background SnapLogic is an AWS customer on a mission to bring enterprise automation to the world.

Database 158

Database AWS ETL SQL 158

AWS Machine Learning Blog

FEBRUARY 24, 2023

AWS recently released Amazon SageMaker geospatial capabilities to provide you with satellite imagery and geospatial state-of-the-art machine learning (ML) models, reducing barriers for these types of use cases. In the following sections, we dive into each pipeline in more detail.

ML 102

ML ML AWS Data Pipeline 102

AWS Machine Learning Blog

AUGUST 8, 2024

As one of the largest AWS customers, Twilio engages with data, artificial intelligence (AI), and machine learning (ML) services to run their daily workloads. Data is the foundational layer for all generative AI and ML applications. Access to Amazon Bedrock FMs isn’t granted by default.

SQL 132

SQL Data Lakes Data Analyst AWS 132

AWS Machine Learning Blog

DECEMBER 20, 2023

Whether logs are coming from Amazon Web Services (AWS), other cloud providers, on-premises, or edge devices, customers need to centralize and standardize security data. After the security log data is stored in Amazon Security Lake, the question becomes how to analyze it. Subscribe an AWS Lambda function to the SQS queue.

AWS 136

AWS ML ML Algorithm 136

ODSC - Open Data Science

APRIL 23, 2025

Confluent Confluent provides a robust data streaming platform built around Apache Kafka. AI credits from Confluent can be used to implement real-time data pipelines, monitor data flows, and run stream-based ML applications.

Data Scientist 52

Data Scientist Azure Apache Kafka ML 52

AWS Machine Learning Blog

SEPTEMBER 24, 2024

Working with the AWS Generative AI Innovation Center , DoorDash built a solution to provide Dashers with a low-latency self-service voice experience to answer frequently asked questions, reducing the need for live agent assistance, in just 2 months. “We You can deploy the solution in your own AWS account and try the example solution.

AWS 104

AWS AI AI Analytics 104

AWS Machine Learning Blog

DECEMBER 15, 2023

In this post, we discuss how to bring data stored in Amazon DocumentDB into SageMaker Canvas and use that data to build ML models for predictive analytics. Without creating and maintaining data pipelines, you will be able to power ML models with your unstructured data stored in Amazon DocumentDB.

Machine Learning 125

Machine Learning Machine Learning AWS ML 125

AWS Machine Learning Blog

AUGUST 22, 2024

Building a deployment pipeline for generative artificial intelligence (AI) applications at scale is a formidable challenge because of the complexities and unique requirements of these systems. Generative AI applications require continuous ingestion, preprocessing, and formatting of vast amounts of data from various sources.

ML 133

ML ML Python AWS 133

AWS Machine Learning Blog

DECEMBER 5, 2023

AWS is especially well suited to provide enterprises the tools necessary for deploying LLMs at scale to enable critical decision-making. In their implementation of generative AI technology, enterprises have real concerns about data exposure and ownership of confidential information that may be sent to LLMs.

AI 132

AI AI AWS ML 132

AWS Machine Learning Blog

SEPTEMBER 11, 2024

These activities cover disparate fields such as basic data processing, analytics, and machine learning (ML). And finally, some activities, such as those involved with the latest advances in artificial intelligence (AI), are simply not practically possible, without hardware acceleration.

AWS 118

AWS ML ML Clustering 118

AWS Machine Learning Blog

SEPTEMBER 28, 2023

This process significantly benefits from the MLOps features of SageMaker, which streamline the data science workflow by harnessing the powerful cloud infrastructure of AWS. The following diagram illustrates the inference pipeline. Click here to open the AWS console and follow along.

AWS 124

AWS Machine Learning Machine Learning ML 124

Data Science Dojo

JULY 3, 2024

Big Data Technologies : Handling and processing large datasets using tools like Hadoop, Spark, and cloud platforms such as AWS and Google Cloud. Data Processing and Analysis : Techniques for data cleaning, manipulation, and analysis using libraries such as Pandas and Numpy in Python.

Data Science 150

Data Science Machine Learning Machine Learning Data Visualization 150

ODSC - Open Data Science

FEBRUARY 17, 2023

Cloud Computing, APIs, and Data Engineering NLP experts don’t go straight into conducting sentiment analysis on their personal laptops. Data Engineering Platforms Spark is still the leader for data pipelines but other platforms are gaining ground. Google Cloud is starting to make a name for itself as well.

Deep Learning 111

Deep Learning Deep Learning Data Science Natural Language Processing 111

AWS Machine Learning Blog

NOVEMBER 1, 2023

Give the features a try and send us feedback either through the AWS forum for Amazon Comprehend or through your usual AWS support contacts. About the Authors Aman Tiwari is a General Solutions Architect working with Worldwide Commercial Sales at AWS.

AWS 125

AWS Machine Learning Machine Learning ML 125

IBM Journey to AI blog

AUGUST 12, 2024

Instead, businesses tend to rely on advanced tools and strategies—namely artificial intelligence for IT operations (AIOps) and machine learning operations (MLOps)—to turn vast quantities of data into actionable insights that can improve IT decision-making and ultimately, the bottom line.

Big Data 106

Big Data Big Data ML ML 106

AWS Machine Learning Blog

APRIL 5, 2024

Solution workflow In this section, we discuss how the different components work together, from data acquisition to spatial modeling and forecasting, serving as the core of the UHI solution. Janosch Woschitz is a Senior Solutions Architect at AWS, specializing in AI/ML. Outside work, he is a travel enthusiast.

Clustering 136

Clustering ML ML AWS 136

Precisely

JANUARY 18, 2024

With the emergence of cloud hyperscalers like AWS, Google, and Microsoft, the shift to the cloud has accelerated significantly. Instead of performing major surgery on their critical business systems, enterprises are opting for real-time data integration built around inherently reliable and scalable change data capture (CDC) technology.

AWS 52

AWS Artificial Intelligence Artificial Intelligence Cloud Computing 52

Precisely

JUNE 10, 2025

Here’s what that means, at a glance: Align AI initiatives with your existing investments Uphold internal security and compliance standards Easily adapt to changing business needs And, critically, this approach fosters cross-functional collaboration, accountability, and scalability of AI initiatives across your data pipelines.

AI 52

AI AI Data Pipeline Azure 52

Pickl AI

DECEMBER 25, 2024

Introduction In the rapidly evolving field of Artificial Intelligence , datasets like the Pile play a pivotal role in training models to understand and generate human-like text. The dataset is openly accessible, making it a go-to resource for researchers and developers in Artificial Intelligence.

Natural Language Processing 52

Natural Language Processing Machine Learning Machine Learning AI 52

AWS Machine Learning Blog

JANUARY 25, 2023

This field is often referred to as explainable artificial intelligence (XAI). Amazon SageMaker Clarify is a feature of Amazon SageMaker that enables data scientists and ML engineers to explain the predictions of their ML models. Solution overview SageMaker algorithms have fixed input and output data formats.

Algorithm 98

Algorithm Natural Language Processing Machine Learning Machine Learning 98

Towards AI

MAY 30, 2024

Build and Run Data Pipelines with Sagemaker Pipelines by Jake Teo This article shows how to run long-running, repetitive, centrally managed, and traceable data pipelines leveraging AWS’s MLOps platform, Sagemaker, and its underlying services, Sagemaker pipelines, and Studio.

AI 80

AI AI Data Pipeline Deep Learning 80