AWS Machine Learning Blog

OCTOBER 29, 2024

This engine uses artificial intelligence (AI) and machine learning (ML) services and generative AI on AWS to extract transcripts, produce a summary, and provide a sentiment for the call. Organizations typically can’t predict their call patterns, so the solution relies on AWS serverless services to scale during busy times.

AWS 114

AWS AI AI ML 114

AWS Machine Learning Blog

JANUARY 29, 2025

In this post, we explore how to deploy distilled versions of DeepSeek-R1 with Amazon Bedrock Custom Model Import, making them accessible to organizations looking to use state-of-the-art AI capabilities within the secure and scalable AWS infrastructure at an effective cost. You can monitor costs with AWS Cost Explorer.

AWS 134

AWS ML ML AI 134

Data Science Dojo

JULY 6, 2023

Essential data engineering tools for 2023 Top 10 data engineering tools to watch out for in 2023 1. Amazon Redshift: Amazon Redshift is a cloud-based data warehousing service provided by Amazon Web Services (AWS). It allows data engineers to store, manage, and analyze large datasets efficiently.

Data Engineering 195

Data Engineering Data Engineering Data Engineering Data Engineer 195

AWS Machine Learning Blog

SEPTEMBER 27, 2024

We can also gain an understanding of data presented in charts and graphs by asking questions related to business intelligence (BI) tasks, such as “What is the sales trend for 2023 for company A in the enterprise market?” AWS Fargate is the compute engine for web application. This allows you to experiment quickly with new designs.

AWS 126

AWS AI AI Computer Science 126

AWS Machine Learning Blog

APRIL 7, 2025

Virginia) AWS Region. Prerequisites To try the Llama 4 models in SageMaker JumpStart, you need the following prerequisites: An AWS account that will contain all your AWS resources. An AWS Identity and Access Management (IAM) role to access SageMaker AI. Access to accelerated instances (GPUs) for hosting the LLMs.

AWS 118

AWS Machine Learning Machine Learning ML 118

AWS Machine Learning Blog

MAY 23, 2023

You can also access JumpStart models using the SageMaker Python SDK. In April 2023, AWS unveiled Amazon Bedrock , which provides a way to build generative AI-powered apps via pre-trained models from startups including AI21 Labs , Anthropic , and Stability AI. Clone and set up the AWS CDK application.

AWS 111

AWS AI AI ML 111

AWS Machine Learning Blog

AUGUST 28, 2023

As part of the 2023 Data Science Conference (DSCO 23), AWS partnered with the Data Institute at the University of San Francisco (USF) to conduct a datathon. I learned some Python coding in class but this helped make it real. Response from the event “This was a fun event, and a great way to work with others.

Data Science 95

Data Science AWS Machine Learning Machine Learning 95

AWS Machine Learning Blog

APRIL 10, 2023

In this post, we take the same approach but host the model on AWS Inferentia2. We use the AWS Neuron software development kit (SDK) to access the Inferentia device and benefit from its high performance. AWS Neuron and tranformer-neuronx are the SDKs used to run deep learning workloads on AWS Inferentia.

AWS 100

AWS Deep Learning Deep Learning ML 100

AWS Machine Learning Blog

SEPTEMBER 18, 2024

In addition to its groundbreaking AI innovations, Zeta Global has harnessed Amazon Elastic Container Service (Amazon ECS) with AWS Fargate to deploy a multitude of smaller models efficiently. Airflow for workflow orchestration Airflow schedules and manages complex workflows, defining tasks and dependencies in Python code.

AWS 124

AWS Machine Learning Machine Learning ML 124

AWS Machine Learning Blog

APRIL 7, 2025

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies and AWS. Solution overview The following diagram provides a high-level overview of AWS services and features through a sample use case. The response only cites sources that are relevant to the query.

Database 124

Database AWS Natural Language Processing AI 124

Flipboard

MAY 2, 2025

The initial step involves creating an AWS Lambda function that will integrate with the Amazon Bedrock agents CreatePortfolio action group. To configure the Lambda function, on the AWS Lambda console , establish a new function with the following specifications: Configure Python 3.12 Srinivasan is a Cloud Support Engineer at AWS.

AI 143

AI AI AWS Machine Learning 143

AWS Machine Learning Blog

MAY 10, 2023

Given the importance of Jupyter to data scientists and ML developers, AWS is an active sponsor and contributor to Project Jupyter. In parallel to these open-source contributions, we have AWS product teams who are working to integrate Jupyter with products such as Amazon SageMaker.

ML 105

ML ML AWS AI 105

AWS Machine Learning Blog

JUNE 18, 2024

On December 6 th -8 th 2023, the non-profit organization, Tech to the Rescue , in collaboration with AWS, organized the world’s largest Air Quality Hackathon – aimed at tackling one of the world’s most pressing health and environmental challenges, air pollution. This is done to optimize performance and minimize cost of LLM invocation.

AWS 133

AWS Python AI AI 133

Flipboard

NOVEMBER 20, 2023

We use two AWS Media & Entertainment Blog posts as the sample external data, which we convert into embeddings with the BAAI/bge-small-en-v1.5 Prerequisites To follow the steps in this post, you need to have an AWS account and an AWS Identity and Access Management (IAM) role with permissions to create and access the solution resources.

AWS 166

AWS Database Machine Learning Machine Learning 166

AWS Machine Learning Blog

JULY 26, 2023

Generative AI Foundations on AWS is a new technical deep dive course that gives you the conceptual fundamentals, practical advice, and hands-on guidance to pre-train, fine-tune, and deploy state-of-the-art foundation models on AWS and beyond. Feel free to reach out to me on Medium, LinkedIn , GitHub , or through your AWS teams.

AWS 98

AWS AI AI Machine Learning 98

AWS Machine Learning Blog

NOVEMBER 15, 2024

For a qualitative question like “What caused inflation in 2023?”, However, for a quantitative question such as “What was the average inflation in 2023?”, For instance, analyzing large tables might require prompting the LLM to generate Python or SQL and running it, rather than passing the tabular data to the LLM.

Database 121

Database SQL Data Analysis Data Analysis 121

The MLOps Blog

JUNE 27, 2023

As you delve into the landscape of MLOps in 2023, you will find a plethora of tools and platforms that have gained traction and are shaping the way models are developed, deployed, and monitored. For example, if you use AWS, you may prefer Amazon SageMaker as an MLOps platform that integrates with other AWS services.

Machine Learning 134

Machine Learning Machine Learning ML ML 134

AWS Machine Learning Blog

JULY 24, 2023

In this post we walk you through the process of deploying FastAPI model servers on AWS Inferentia devices (found on Amazon EC2 Inf1 and Amazon EC Inf2 instances). Solution overview FastAPI is an open-source web framework for serving Python applications that is much faster than traditional frameworks like Flask and Django.

AWS 97

AWS Deep Learning Deep Learning Python 97

ODSC - Open Data Science

FEBRUARY 2, 2023

The role of a data scientist is in demand and 2023 will be no exception. To get a better grip on those changes we reviewed over 25,000 data scientist job descriptions from that past year to find out what employers are looking for in 2023. While knowing Python, R, and SQL are expected, you’ll need to go beyond that.

Data Science 98

Data Science Data Scientist Computer Science Computer Science 98

ODSC - Open Data Science

FEBRUARY 17, 2023

NLP Skills for 2023 These skills are platform agnostic, meaning that employers are looking for specific skillsets, expertise, and workflows. NLP Programming Languages It shouldn’t be a surprise that Python has a strong lead as a programming language of choice for NLP. Knowing some SQL is also essential.

Data Science 111

Data Science Deep Learning Deep Learning Natural Language Processing 111

DrivenData Labs

MAY 12, 2025

The challenge and results were also published in the AGU Space Weather journal and was among their top 10% of viewed articles published in 2023. This led to increased investment by companies in this space along with our partner at The Nature Conservancy, such as through work with AWS among others.

Algorithm 130

Algorithm Machine Learning Machine Learning Deep Learning 130

AWS Machine Learning Blog

MAY 6, 2025

Overview Custom metrics in Amazon Bedrock Evaluations offer the following features: Simplified getting started experience Pre-built starter templates are available on the AWS Management Console based on our industry-tested built-in metrics, with options to create from scratch for specific evaluation criteria. bedrock_client = boto3.client('bedrock',

AI 76

AI AI AWS Python 76

AWS Machine Learning Blog

AUGUST 7, 2023

In an effort to create and maintain a socially responsible gaming environment, AWS Professional Services was asked to build a mechanism that detects inappropriate language (toxic speech) within online gaming player interactions. Unfortunately, as in the real world, not all players communicate appropriately and respectfully.

AWS 98

AWS ML ML Data Science 98

AWS Machine Learning Blog

MAY 7, 2024

Based on a survey conducted by American Express in 2023, 41% of business meetings are expected to take place in hybrid or virtual format by 2024. Every time a new recording is uploaded to this folder, an AWS Lambda Transcribe function is invoked and initiates an Amazon Transcribe job that converts the meeting recording into text.

AWS 134

AWS ML ML Machine Learning 134

AWS Machine Learning Blog

OCTOBER 21, 2024

However, customers who want to deploy LLMs in their own self-managed workflows for greater control and flexibility of underlying resources can use these LLMs optimized on top of AWS Inferentia2-powered Amazon Elastic Compute Cloud (Amazon EC2) Inf2 instances. Mistral AI 7.3 See the reference link for how to apply for a quota.

AWS 87

AWS AI AI Machine Learning 87

AWS Machine Learning Blog

APRIL 2, 2024

In December 2023, the Solar 10.7B This model requires an AWS Marketplace subscription. If you have not subscribed to this model, choose Subscribe , go to AWS Marketplace, review the pricing terms and End User License Agreement (EULA), and choose Accept offer. You can test single-turn or multi-turn chat examples with Python. #

AWS 128

AWS ML ML Python 128

AWS Machine Learning Blog

JUNE 6, 2023

Feature Store recently extended the SageMaker Python SDK to make it easier to create datasets from the offline store. In this post, we demonstrate how to use the SageMaker Python SDK to build ML-ready datasets without writing any SQL statements. Prerequisites You need the following prerequisites: An AWS account.

Machine Learning 98

Machine Learning Machine Learning Python SQL 98

AWS Machine Learning Blog

SEPTEMBER 19, 2023

Engineers must manually write custom data preprocessing and aggregation logic in Python or Spark for each use case. Prerequisites To follow this tutorial, you need the following: An AWS account. AWS Identity and Access Management (IAM) permissions. 50195| 1686627154| | 6| Acura TLX A-Spec| 2023| New| NA|50195.00|50195|

ML 127

ML ML AWS SQL 127

AWS Machine Learning Blog

SEPTEMBER 12, 2024

LangChain is a Python library designed to build applications with LLMs. Prerequisites To implement this solution, you need the following: An AWS account with privileges to create AWS Identity and Access Management (IAM) roles and policies. Basic familiarity with SageMaker and AWS services that support LLMs. Python 3.10

AWS 136

AWS ML ML AI 136

ODSC - Open Data Science

AUGUST 3, 2023

ML for Big Data with PySpark on AWS, Asynchronous Programming in Python, and the Top Industries for AI Harnessing Machine Learning on Big Data with PySpark on AWS In this brief tutorial, you’ll learn some basics on how to use Spark on AWS for machine learning, MLlib, and more. Here’s how. Check them out here.

Big Data 52

Big Data Big Data AWS ML 52

AWS Machine Learning Blog

JUNE 26, 2024

This post is a follow-up to Generative AI and multi-modal agents in AWS: The key to unlocking new value in financial markets. For unstructured data, the agent uses AWS Lambda functions with AI services such as Amazon Comprehend for natural language processing (NLP). The following diagram illustrates the technical architecture.

AWS 136

AWS AI AI Database 136

Flipboard

FEBRUARY 16, 2023

In October 2022, we launched Amazon EC2 Trn1 Instances , powered by AWS Trainium , which is the second generation machine learning accelerator designed by AWS. Our solution uses the AWS ParallelCluster management tool to create the necessary infrastructure and environment to spin up a Trn1 UltraCluster. Create the cluster.

Clustering 131

Clustering AWS Deep Learning Deep Learning 131

DrivenData Labs

NOVEMBER 14, 2023

Where to access the data Access programmatically through Microsoft’s Planetary Computer Access programmatically through Google Earth Engine Getting started Example notebook from the Planetary Computer showing how to access Landsat data and perform some basic analysis (Python) Google Earth Engine starter code for downloading Landsat surface reflectance (..)

Python 162

Python AWS Azure Data Analysis 162

AssemblyAI

DECEMBER 20, 2023

Join Us On Discord 2023 at AssemblyAI - A Year in Review Here are some of the new products and features we've launched for customers in 2023: Conformer-1 and Conformer-2 AI Models Released : The year saw the launch of  Conformer-2 , our enhanced AI model for automatic speech recognition. million hours of English audio.

Python 59

Python AWS Database AI 59

AWS Machine Learning Blog

NOVEMBER 24, 2023

It does so by covering the ML workflow end-to-end: whether you’re looking for powerful data preparation and AutoML, managed endpoint deployment, simplified MLOps capabilities, and ready-to-use models powered by AWS AI services and Generative AI, SageMaker Canvas can help you to achieve your goals.

AWS 125

AWS ML ML Machine Learning 125

AWS Machine Learning Blog

MAY 22, 2024

The inference workflow is then invoked through an AWS Lambda request, which first makes an HTTP request to the Sagemaker endpoint, and then uses that to make another request to Amazon Bedrock. For details, see Creating an AWS account. Note: Be sure to set up your AWS Command Line Interface (AWS CLI) credentials correctly.

AWS 138

AWS Machine Learning Machine Learning Natural Language Processing 138

AWS Machine Learning Blog

AUGUST 4, 2023

In our example, the URI is s3://sagemaker-us-east-1-43257985977/data_wrangler_flows/example-2023-05-30T12-20-18.tar.gz. We can programmatically determine this S3 location and use this artifact to create a SageMaker model using the SageMaker Python SDK , which is demonstrated in the SageMaker Inference Pipeline notebook.

Data Preparation 97

Data Preparation AWS ML ML 97