AWS Machine Learning Blog

SEPTEMBER 4, 2024

A challenge for DevOps engineers is the additional complexity that comes from using Kubernetes to manage the deployment stage while resorting to other tools (such as the AWS SDK or AWS CloudFormation ) to manage the model building pipeline. kubectl for working with Kubernetes clusters. eksctl for working with EKS clusters.

AWS 104

AWS Clustering ML ML 104

AWS Machine Learning Blog

APRIL 22, 2024

Amazon SageMaker HyperPod is purpose-built to accelerate foundation model (FM) training, removing the undifferentiated heavy lifting involved in managing and optimizing a large training compute cluster. In this solution, HyperPod cluster instances use the LDAPS protocol to connect to the AWS Managed Microsoft AD via an NLB.

Clustering 114

Clustering AWS Machine Learning Machine Learning 114

AWS Machine Learning Blog

JUNE 25, 2024

Amazon Web Services is excited to announce the launch of the AWS Neuron Monitor container , an innovative tool designed to enhance the monitoring capabilities of AWS Inferentia and AWS Trainium chips on Amazon Elastic Kubernetes Service (Amazon EKS). The Container Insights dashboard also shows cluster status and alarms.

AWS 92

AWS ML ML Clustering 92

AWS Machine Learning Blog

JANUARY 24, 2024

Generative AI solutions have the potential to transform businesses by boosting productivity and improving customer experiences, and using large language models (LLMs) with these solutions has become increasingly popular. Despite their wealth of general knowledge, state-of-the-art LLMs only have access to the information they were trained on.

AWS 140

AWS Database AI AI 140

AWS Machine Learning Blog

MAY 30, 2024

Generative artificial intelligence (AI) has unlocked fresh opportunities for these use cases. In this post, we introduce the Media Analysis and Policy Evaluation solution, which uses AWS AI and generative AI services to provide a framework to streamline video extraction and evaluation processes.

AWS 135

AWS AI AI ML 135

AWS Machine Learning Blog

MAY 1, 2024

Large language models (LLMs) are making a significant impact in the realm of artificial intelligence (AI). Llama2 by Meta is an example of an LLM offered by AWS. To learn more about Llama 2 on AWS, refer to Llama 2 foundation models from Meta are now available in Amazon SageMaker JumpStart.

AWS 116

AWS ML ML Clustering 116

AWS Machine Learning Blog

MAY 23, 2023

Just recently, generative AI applications have captured everyone’s attention and imagination. We are truly at an exciting inflection point in the widespread adoption of ML, and we believe every customer experience and application will be reinvented with generative AI.

AWS 113

AWS AI AI ML 113

AWS Machine Learning Blog

APRIL 4, 2023

AWS provides various services catered to time series data that are low code/no code, which both machine learning (ML) and non-ML practitioners can use for building ML solutions. In this post, we seek to separate a time series dataset into individual clusters that exhibit a higher degree of similarity between its data points and reduce noise.

Clustering 98

Clustering ML ML AWS 98

AWS Machine Learning Blog

MAY 30, 2024

CBRE is unlocking the potential of artificial intelligence (AI) to realize value across the entire commercial real estate lifecycle—from guiding investment decisions to managing buildings. The opportunities to unlock value using AI in the commercial real estate lifecycle starts with data at scale.

AWS 130

AWS SQL Database AI 130

AWS Machine Learning Blog

APRIL 29, 2024

Close collaboration with AWS Trainium has also played a major role in making the Arcee platform extremely performant, not only accelerating model training but also reducing overall costs and enforcing compliance and data integrity in the secure AWS environment. Our cluster consisted of 16 nodes, each equipped with a trn1n.32xlarge

AWS 127

AWS Clustering ML ML 127

AWS Machine Learning Blog

JUNE 11, 2024

Each of these products are infused with artificial intelligence (AI) capabilities to deliver exceptional customer experience. Sprinklr’s specialized AI models streamline data processing, gather valuable insights, and enable workflows and analytics at scale to drive better decision-making and productivity.

Machine Learning 106

Machine Learning Machine Learning AWS Natural Language Processing 106

AWS Machine Learning Blog

OCTOBER 5, 2023

In this post, we walk through how to fine-tune Llama 2 on AWS Trainium , a purpose-built accelerator for LLM training, to reduce training times and costs. We review the fine-tuning scripts provided by the AWS Neuron SDK (using NeMo Megatron-LM), the various configurations we used, and the throughput results we saw.

AWS 125

AWS Machine Learning Machine Learning Deep Learning 125

Flipboard

JUNE 20, 2023

For reference, GPT-3, an earlier generation LLM has 175 billion parameters and requires months of non-stop training on a cluster of thousands of accelerated processors. The Carbontracker study estimates that training GPT-3 from scratch may emit up to 85 metric tons of CO2 equivalent, using clusters of specialized hardware accelerators.

AWS 123

AWS Machine Learning Machine Learning Deep Learning 123

IBM Journey to AI blog

OCTOBER 26, 2023

Maximo maintains high-value assets with AI and analytics to optimize performance, extend asset lifecycles and reduce downtime and costs. In this journey, we are seeing an increased interest in migrating and deploying MAS on AWS Cloud. Therefore, Maximo migration and modernization has become even more important for clients.

AWS 122

AWS Clustering Database Analytics 122

AWS Machine Learning Blog

DECEMBER 12, 2023

In this post, we’ll summarize training procedure of GPT NeoX on AWS Trainium , a purpose-built machine learning (ML) accelerator optimized for deep learning training. M tokens/$) trained such models with AWS Trainium without losing any model quality. We’ll outline how we cost-effectively (3.2 billion in Pythia. billion in Pythia.

AWS 124

AWS Deep Learning Deep Learning Machine Learning 124

AWS Machine Learning Blog

MAY 31, 2023

With containers, scaling on a cluster becomes much easier. In late 2022, AWS announced the general availability of Amazon EC2 Trn1 instances powered by AWS Trainium accelerators, which are purpose built for high-performance deep learning training. What you get is an ML development environment that is consistent and portable.

AWS 100

AWS Machine Learning Machine Learning Clustering 100

AWS Machine Learning Blog

OCTOBER 2, 2024

Large enterprises are building strategies to harness the power of generative AI across their organizations. Managing bias, intellectual property, prompt safety, and data integrity are critical considerations when deploying generative AI solutions at scale. We focus on the operational excellence pillar in this post.

AWS 121

AWS AI AI ML 121

AWS Machine Learning Blog

NOVEMBER 19, 2024

In the rapidly evolving world of AI, the ability to customize language models for specific industries has become more important. Moreover, generative AI applications for consumers can offer valuable insights into the types of interactions from end-users. AWS offers a wide range of solutions for interacting with language models.

AWS 97

AWS ML ML Machine Learning 97

AWS Machine Learning Blog

NOVEMBER 13, 2024

In the context of generative AI , significant progress has been made in developing multimodal embedding models that can embed various data modalities—such as text, image, video, and audio data—into a shared vector space. The AWS Command Line Interface (AWS CLI) installed on your machine to upload the dataset to Amazon S3.

AWS 106

AWS Database K-nearest Neighbors AI 106

IBM Journey to AI blog

AUGUST 30, 2023

IBM Maximo Application Suite (MAS), the next generation of IBM Maximo, delivers a better user experience, faster integration, robust AI analytics and a broad range of cloud deployment options. Why ROSA for Maximo in AWS? Red Hat OpenShift Service on AWS is jointly developed and jointly supported by AWS and Red Hat.

AWS 89

AWS Clustering Internet of Things Artificial Intelligence 89

AWS Machine Learning Blog

NOVEMBER 30, 2023

Building foundation models (FMs) requires building, maintaining, and optimizing large clusters to train models with tens to hundreds of billions of parameters on vast amounts of data. Customers such as Stability AI use SageMaker HyperPod to train their foundation models, including Stable Diffusion. “As

Clustering 129

Clustering AWS Machine Learning Machine Learning 129

AWS Machine Learning Blog

APRIL 19, 2024

Iambic Therapeutics is a drug discovery startup with a mission to create innovative AI-driven technologies to bring better medicines to cancer patients, faster. Our advanced generative and predictive artificial intelligence (AI) tools enable us to search the vast space of possible drug molecules faster and more effectively.

Clustering 126

Clustering AI AI AWS 126

IBM Journey to AI blog

JANUARY 16, 2024

Businesses are increasingly embracing data-intensive workloads, including high-performance computing, artificial intelligence (AI) and machine learning (ML). To aid in building more sustainable IT estates, IBM has partnered up with Amazon Web Services (AWS) to facilitate sustainable cloud modernization journeys.

AWS 118

AWS Clustering Database Artificial Intelligence 118

AWS Machine Learning Blog

SEPTEMBER 3, 2024

From deriving insights to powering generative artificial intelligence (AI) -driven applications, the ability to efficiently process and analyze large datasets is a vital capability. SageMaker Studio runs inside an AWS managed virtual private cloud ( VPC ), with network access for SageMaker Studio domains, in this setup configured as VPC-only.

AWS 116

AWS Clustering Big Data Big Data 116

AWS Machine Learning Blog

MARCH 15, 2024

Therefore, ML creates challenges for AWS customers who need to ensure privacy and security across distributed entities without compromising patient outcomes. Solution overview We deploy FedML into multiple EKS clusters integrated with SageMaker for experiment tracking. As always, AWS welcomes your feedback.

AWS 121

AWS ML ML Machine Learning 121

AWS Machine Learning Blog

AUGUST 21, 2023

Data is frequently kept in data lakes that can be managed by AWS Lake Formation , giving you the ability to implement fine-grained access control using a straightforward grant or revoke procedure. You can use the provided AWS CloudFormation stack to set up the architectural components for this solution.

AWS 94

AWS Data Lakes Clustering Data Preparation 94

AWS Machine Learning Blog

OCTOBER 24, 2024

Prerequisites Before you begin, make sure you have the following prerequisites in place: An AWS account and role with the AWS Identity and Access Management (IAM) privileges to deploy the following resources: IAM roles. For this post we’ll use a provisioned Amazon Redshift cluster. A SageMaker domain. Database name : Enter dev.

Data Warehouse 113

Data Warehouse Machine Learning Machine Learning Cloud Data 113

IBM Journey to AI blog

MARCH 20, 2024

In the rest of this paper, we will explore how Cloud Pak for Integration, deployed on Red Hat OpenShift is the best way to provide integrations deploying in AWS. ROSA is jointly engineered and supported by AWS and Red Hat.  Why ROSA for Cloud Pak for Integration in AWS? What is ROSA? Interested to hear more?

AWS 88

AWS Clustering AI AI 88

AWS Machine Learning Blog

MAY 31, 2024

In this blog post and open source project , we show you how you can pre-train a genomics language model, HyenaDNA , using your genomic data in the AWS Cloud. Amazon SageMaker Amazon SageMaker is a fully managed ML service offered by AWS, designed to reduce the time and cost associated with training and tuning ML models at scale.

AWS 109

AWS ML ML Machine Learning 109

AWS Machine Learning Blog

OCTOBER 18, 2024

In this post, we introduce an innovative solution for end-to-end model customization and deployment at the edge using Amazon SageMaker and Qualcomm AI Hub. After fine-tuning, we show you how to optimize the model with Qualcomm AI Hub so that it’s ready for deployment across edge devices powered by Snapdragon and Qualcomm platforms.

AWS 100

AWS AI AI Machine Learning 100

AWS Machine Learning Blog

APRIL 1, 2024

Distributed model training requires a cluster of worker nodes that can scale. Amazon Elastic Kubernetes Service (Amazon EKS) is a popular Kubernetes-conformant service that greatly simplifies the process of running AI/ML workloads, making it more manageable and less time-consuming.

Clustering 129

Clustering AWS ML ML 129

Smart Data Collective

FEBRUARY 20, 2022

AWS (Amazon Web Services), the comprehensive and evolving cloud computing platform provided by Amazon, is comprised of infrastructure as a service (IaaS), platform as a service (PaaS) and packaged software as a service (SaaS). With its wide array of tools and convenience, AWS has already become a popular choice for many SaaS companies.

AWS 116

AWS Cloud Computing Data Lakes Database 116

IBM Journey to AI blog

APRIL 3, 2024

Data and AI are increasingly critical tools in how organizations are evolving their facilities management. Real-time insights infused with AI support dynamic space planning. In this blog post, we walk through the recommended options for running IBM TAS on Amazon Web Services (AWS).

AWS 88

AWS Clustering AI AI 88

AWS Machine Learning Blog

JULY 17, 2023

As described in the AWS Well-Architected Framework , separating workloads across accounts enables your organization to set common guardrails while isolating environments. Organizations with a multi-account architecture typically have Amazon Redshift and SageMaker Studio in two separate AWS accounts. Select VPC Only , then choose Next.

Clustering 78

Clustering AWS ML ML 78

AWS Machine Learning Blog

MARCH 15, 2023

Tens of thousands of AWS customers use AWS machine learning (ML) services to accelerate their ML development with fully managed infrastructure and tools. The data scientist is responsible for moving the code into SageMaker, either manually or by cloning it from a code repository such as AWS CodeCommit.

AWS 137

AWS Machine Learning Machine Learning Data Scientist 137

AWS Machine Learning Blog

AUGUST 15, 2024

QnABot on AWS (an AWS Solution) now provides access to Amazon Bedrock foundational models (FMs) and Knowledge Bases for Amazon Bedrock , a fully managed end-to-end Retrieval Augmented Generation (RAG) workflow. In turn, customers can ask a variety of questions and receive accurate answers powered by generative AI.

AWS 128

AWS AI AI Machine Learning 128

AWS Machine Learning Blog

JUNE 21, 2024

To accomplish this, eSentire built AI Investigator, a natural language query tool for their customers to access security platform data by using AWS generative artificial intelligence (AI) capabilities. Over 100 SOC analysts are now using AI Investigator models to analyze security data and provide rapid investigation conclusions.

AWS 124

AWS AI AI Natural Language Processing 124