AWS Machine Learning Blog

NOVEMBER 19, 2024

In 2018, I sat in the audience at AWS re:Invent as Andy Jassy announced AWS DeepRacer —a fully autonomous 1/18th scale race car driven by reinforcement learning. But AWS DeepRacer instantly captured my interest with its promise that even inexperienced developers could get involved in AI and ML.

AWS 102

AWS ML ML AI 102

AWS Machine Learning Blog

OCTOBER 5, 2023

In this post, we walk through how to fine-tune Llama 2 on AWS Trainium , a purpose-built accelerator for LLM training, to reduce training times and costs. We review the fine-tuning scripts provided by the AWS Neuron SDK (using NeMo Megatron-LM), the various configurations we used, and the throughput results we saw.

AWS 116

AWS Machine Learning Machine Learning Deep Learning 116

AWS Machine Learning Blog

JANUARY 13, 2023

To mitigate these challenges, we propose a federated learning (FL) framework, based on open-source FedML on AWS, which enables analyzing sensitive HCLS data. In this two-part series, we demonstrate how you can deploy a cloud-based FL framework on AWS. For Account ID , enter the AWS account ID of the owner of the accepter VPC.

AWS 81

AWS Analytics Analytics Machine Learning 81

IBM Journey to AI blog

NOVEMBER 2, 2023

These tech pioneers were looking for ways to bring Google’s internal infrastructure expertise into the realm of large-scale cloud computing and also enable Google to compete with Amazon Web Services (AWS)—the unrivaled leader among cloud providers at the time. Control plane nodes , which control the cluster.

Clustering 123

Clustering Cloud Computing AWS 123

Dataconomy

APRIL 26, 2023

The strategic value of IoT development and data analytics Sierra Wireless Sierra Wireless , a wireless communications equipment designer and service provider, has been honing its focus on IoT software and managed services following its acquisition of M2M Group, a cluster of companies dedicated to IoT connectivity, in 2020.

Internet of Things 156

Internet of Things Azure AWS Cloud Computing 156

AWS Machine Learning Blog

SEPTEMBER 11, 2024

The following figure illustrates the idea of a large cluster of GPUs being used for learning, followed by a smaller number for inference. In 2018, other forms of PBAs became available, and by 2020, PBAs were being widely used for parallel problems, such as training of NN.

AWS 91

AWS ML ML Clustering 91

AWS Machine Learning Blog

JULY 13, 2023

Amazon SageMaker distributed training jobs enable you with one click (or one API call) to set up a distributed compute cluster, train a model, save the result to Amazon Simple Storage Service (Amazon S3), and shut down the cluster when complete. Finally, launching clusters can introduce operational overhead due to longer starting time.

Clustering 76

Clustering Algorithm Deep Learning Deep Learning 76