article thumbnail

Your guide to generative AI and ML at AWS re:Invent 2024

AWS Machine Learning Blog

The excitement is building for the fourteenth edition of AWS re:Invent, and as always, Las Vegas is set to host this spectacular event. Third, we’ll explore the robust infrastructure services from AWS powering AI innovation, featuring Amazon SageMaker , AWS Trainium , and AWS Inferentia under AI/ML, as well as Compute topics.

AWS 108
article thumbnail

Fast and cost-effective LLaMA 2 fine-tuning with AWS Trainium

AWS Machine Learning Blog

In this post, we walk through how to fine-tune Llama 2 on AWS Trainium , a purpose-built accelerator for LLM training, to reduce training times and costs. We review the fine-tuning scripts provided by the AWS Neuron SDK (using NeMo Megatron-LM), the various configurations we used, and the throughput results we saw.

AWS 132
professionals

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Getir end-to-end workforce management: Amazon Forecast and AWS Step Functions

AWS Machine Learning Blog

Getir was founded in 2015 and operates in Turkey, the UK, the Netherlands, Germany, and the United States. In this post, we describe the end-to-end workforce management system that begins with location-specific demand forecast, followed by courier workforce planning and shift assignment using Amazon Forecast and AWS Step Functions.

AWS 133
article thumbnail

How Getir reduced model training durations by 90% with Amazon SageMaker and AWS Batch

AWS Machine Learning Blog

Established in 2015, Getir has positioned itself as the trailblazer in the sphere of ultrafast grocery delivery. In this post, we explain how we built an end-to-end product category prediction pipeline to help commercial teams by using Amazon SageMaker and AWS Batch , reducing model training duration by 90%.

AWS 129
article thumbnail

Amazon vets raise cash for Griptape, a Seattle startup that helps companies build AI apps

Flipboard

Kyle Roche , the startup’s co-founder and CEO, spent more than eight years at Amazon Web Services (AWS) in various roles. In his position as head of immersive technology, Roche led teams that built and ran AWS services including Amazon Location Service, Amazon Nimble Studio, Thinkbox, and others.

AWS 165
article thumbnail

Evaluate the text summarization capabilities of LLMs for enhanced decision-making on AWS

AWS Machine Learning Blog

In AWS, the FMEval library within Amazon SageMaker Clarify streamlines the evaluation and selection of foundation models (FMs) for tasks like text summarization, question answering, and classification. Hurricane Patricia has been rated as a categor… Human: 23 October 2015 Last updated at 17:44 B… [{‘name’: meteor’, “value’: 0.102339181286549.

AWS 137
article thumbnail

Federated Learning on AWS with FedML: Health analytics without sharing sensitive data – Part 2

AWS Machine Learning Blog

To mitigate these challenges, we propose a federated learning (FL) framework, based on open-source FedML on AWS, which enables analyzing sensitive HCLS data. In this two-part series, we demonstrate how you can deploy a cloud-based FL framework on AWS. In the first post , we described FL concepts and the FedML framework.

AWS 97