Deploying a pretrained GPT-2 model on AWS
KDnuggets
DECEMBER 12, 2019
This post attempts to summarize my recent detour into NLP, describing how I exposed a Huggingface pre-trained Language Model (LM) on an AWS-based web application.
Racing into the future: How AWS DeepRacer fueled my AI and ML journey
AWS Machine Learning Blog
NOVEMBER 19, 2024
In 2018, I sat in the audience at AWS re:Invent as Andy Jassy announced AWS DeepRacer —a fully autonomous 1/18th scale race car driven by reinforcement learning. But AWS DeepRacer instantly captured my interest with its promise that even inexperienced developers could get involved in AI and ML.
AWS 
114
114 Join 17,000+
professionals
Sign Up for our Newsletter
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
AWS at NVIDIA GTC 2024: Accelerate innovation with generative AI on AWS
AWS Machine Learning Blog
APRIL 11, 2024
AWS was delighted to present to and connect with over 18,000 in-person and 267,000 virtual attendees at NVIDIA GTC, a global artificial intelligence (AI) conference that took place March 2024 in San Jose, California, returning to a hybrid, in-person experience for the first time since 2019.
AWS 131
131 
Advance environmental sustainability in clinical trials using AWS
AWS Machine Learning Blog
NOVEMBER 1, 2024
AWS can play a key role in enabling fast implementation of these decentralized clinical trials. By exploring these AWS powered alternatives, we aim to demonstrate how organizations can drive progress towards more environmentally friendly clinical research practices.
AWS 121
121 
Support for AWS DeepComposer ending soon
AWS Machine Learning Blog
SEPTEMBER 17, 2024
AWS DeepComposer was first introduced during AWS re:Invent 2019 as a fun way for developers to compose music by using generative AI. After careful consideration, we have made the decision to end support for AWS DeepComposer, effective September 17, 2025. About the author Kanchan Jagannathan is a Sr.
AWS 97
97 
Data Science News for May 2019
Data Science 101
MAY 23, 2019
Here is the latest data science news for May 2019. Microsoft Build 2019 – This is a huge conference hosted by Microsoft for the developer community. Google I/O 2019 Videos – Google’s big annual conference. From Data Science 101. General Data Science. Many of the presentation are available to watch online.
Data Science 97
97 
AWS re:Invent 2019 Livestream
Data Science 101
DECEMBER 2, 2019
AWS re:Invent 2019 starts today. It is a large learning conference dedicated to Amazon Web Services and Cloud Computing. Parts of the event will be livestreamed , so you can watch from anywhere. Based upon the announcements last week , there will probably be a lot of focus around machine learning and deep learning.
AWS 64
64 
Getir end-to-end workforce management: Amazon Forecast and AWS Step Functions
AWS Machine Learning Blog
DECEMBER 7, 2023
In this post, we describe the end-to-end workforce management system that begins with location-specific demand forecast, followed by courier workforce planning and shift assignment using Amazon Forecast and AWS Step Functions. AWS Step Functions automatically initiate and monitor these workflows by simplifying error handling.
AWS 133
133 
Fast and cost-effective LLaMA 2 fine-tuning with AWS Trainium
AWS Machine Learning Blog
OCTOBER 5, 2023
In this post, we walk through how to fine-tune Llama 2 on AWS Trainium , a purpose-built accelerator for LLM training, to reduce training times and costs. We review the fine-tuning scripts provided by the AWS Neuron SDK (using NeMo Megatron-LM), the various configurations we used, and the throughput results we saw.
AWS 132
132 
How Getir reduced model training durations by 90% with Amazon SageMaker and AWS Batch
AWS Machine Learning Blog
DECEMBER 4, 2023
In this post, we explain how we built an end-to-end product category prediction pipeline to help commercial teams by using Amazon SageMaker and AWS Batch , reducing model training duration by 90%. An important aspect of our strategy has been the use of SageMaker and AWS Batch to refine pre-trained BERT models for seven different languages.
AWS 129
129 
Frugality meets Accuracy: Cost-efficient training of GPT NeoX and Pythia models with AWS Trainium
AWS Machine Learning Blog
DECEMBER 12, 2023
In this post, we’ll summarize training procedure of GPT NeoX on AWS Trainium , a purpose-built machine learning (ML) accelerator optimized for deep learning training. M tokens/$) trained such models with AWS Trainium without losing any model quality. We’ll outline how we cost-effectively (3.2 billion in Pythia. 2048 256 10.4
AWS 131
131 
AWS DeepRacer: How to master physical racing?
AWS Machine Learning Blog
DECEMBER 1, 2024
In this blog post, I will look at what makes physical AWS DeepRacer racing—a real car on a real track—different to racing in the virtual world—a model in a simulated 3D environment. The AWS DeepRacer League is wrapping up. The original AWS DeepRacer, without modifications, has a smaller speed range of about 2 meters per second.
AWS 99
99 
AWS Inferentia2 builds on AWS Inferentia1 by delivering 4x higher throughput and 10x lower latency
AWS Machine Learning Blog
JUNE 13, 2023
AWS Inferentia2 was designed from the ground up to deliver higher performance while lowering the cost of LLMs and generative AI inference. In this post, we show how the second generation of AWS Inferentia builds on the capabilities introduced with AWS Inferentia1 and meets the unique demands of deploying and running LLMs and FMs.
AWS 93
93 
The thin line between data science and data engineering
KDnuggets
SEPTEMBER 25, 2019
And as these implementations have required models that can perform on larger and larger datasets in real-time, an awful lot of data science problems have become engineering problems.
Data Science 247
247 
The LLM Land Grab: How AWS, Azure, and GCP Are Sparring Over AI
Towards AI
AUGUST 10, 2023
PC Magazine: # 4 Companies Control 67% of the World’s Cloud Infrastructure Amazon Web Services: The Swiss Army Knife Approach With its vast array of cloud infrastructure offerings and unrivaled scale, Amazon Web Services (AWS) has firmly established itself as the dominant player in the space. Enter Amazon Bedrock, launched in April 2023.
Azure 98
98 
AWS ReInvent 2019 Wrap-Up
DataCentric podcast
DECEMBER 9, 2019
Amazon's massive AWS ReInvent Conference is nearly overwhelming in its breadth and scope, with dozens of announcements spanning numerous areas, from ARM to AI to on-premises Outpost.
AWS 52
52 
Build a contextual chatbot application using Knowledge Bases for Amazon Bedrock
AWS Machine Learning Blog
FEBRUARY 19, 2024
Note that you can also use Knowledge Bases for Amazon Bedrock service APIs and the AWS Command Line Interface (AWS CLI) to programmatically create a knowledge base. Create a Lambda function This Lambda function is deployed using an AWS CloudFormation template available in the GitHub repo under the /cfn folder.
AWS 127
127 
Data Science News from Microsoft Ignite 2019
Data Science 101
NOVEMBER 7, 2019
It is now possible to deploy an Azure SQL Database to a virtual machine running on Amazon Web Services (AWS) and manage it from Azure. This allows Azure to manage a completely hybrid infrastructure of: Azure, on-premise, IoT, and other cloud environments. It’s true, I saw it happen this week. R Support for Azure Machine Learning.
Data Science 106
106 
Cloud Data Science News Beta #1
Data Science 101
NOVEMBER 11, 2019
SQL Server 2019 SQL Server 2019 went Generally Available. If you are at a University or non-profit, you can ask for cash and/or AWS credits. AWS Parallel Cluster for Machine Learning AWS Parallel Cluster is an open-source cluster management tool. It can be used to do distributed Machine Learning on AWS.
Cloud Data 95
95 
Knowledge Bases for Amazon Bedrock now supports custom prompts for the RetrieveAndGenerate API and configuration of the maximum number of retrieved results
AWS Machine Learning Blog
APRIL 9, 2024
In the following sections, we explain how you can use these features with either the AWS Management Console or SDK. The correct response for this query is “Amazon’s annual revenue increased from $245B in 2019 to $434B in 2022,” based on the documents in the knowledge base. We ask “What was the Amazon’s revenue in 2019 and 2021?”
Machine Learning 139
139 
Cloud Data Science News – Beta #3
Data Science 101
NOVEMBER 22, 2019
AWS Storage Day On November 20, 2019, Amazon held AWS Storage Day. Many announcements came out regarding storage of all types at AWS. Much of this is in anticipation of AWS re:Invent, coming in early December 2019. Much of this is in anticipation of AWS re:Invent, coming in early December 2019.
Cloud Data 99
99 
Advanced RAG patterns on Amazon SageMaker
AWS Machine Learning Blog
MARCH 28, 2024
For more information on Mixtral-8x7B Instruct on AWS, refer to Mixtral-8x7B is now available in Amazon SageMaker JumpStart. Before you get started with the solution, create an AWS account. This identity is called the AWS account root user. The Mixtral-8x7B model is made available under the permissive Apache 2.0
AWS 138
138 
Leveraging generative AI on AWS to transform life sciences
IBM Journey to AI blog
JULY 19, 2023
In this blog post, we will showcase how IBM Consulting is partnering with AWS and leveraging Large Language Models (LLMs), on IBM Consulting’s generative AI-Automation platform (ATOM), to create industry-aware, life sciences domain-trained foundation models to generate first drafts of the narrative documents, with an aim to assist human teams.
AWS 73
73 
Amazon's Secret Weapon in Chip Design is Amazon
Hacker News
SEPTEMBER 15, 2024
Amazon Web Services (AWS) got there ahead of most of the competition, when they purchased chip designer Annapurna Labs in 2015 and proceeded to design CPUs, AI accelerators, servers, and data centers as a vertically-integrated operation. Rami Sinno AWS Rami Sinno : Amazon is my first vertically integrated company. Tell no one.”
AWS 181
181 
Build an end-to-end MLOps pipeline for visual quality inspection at the edge – Part 2
AWS Machine Learning Blog
OCTOBER 2, 2023
On top of that, the whole process can be configured and managed via the AWS SDK, which is what we use to orchestrate our labeling workflow as part of our CI/CD pipeline. For more information about best practices, refer to the AWS re:Invent 2019 talk, Build accurate training datasets with Amazon SageMaker Ground Truth.
AWS 129
129 
Cloud Data Science News – Beta 9
Data Science 101
JANUARY 3, 2020
Machine Learning with Kubernetes on AWS A talk from Container Day 2019 in San Diego. A First Look at AWS Data Exchange (Webinar) AWS Data Exchange is a product for finding and using third party data. No significant news to report. Hopefully some releases and announcements will be coming next week. Courses/Education.
Data Science 78
78 
Talk to your slide deck using multimodal foundation models hosted on Amazon Bedrock and Amazon SageMaker – Part 2
AWS Machine Learning Blog
APRIL 19, 2024
We used AWS services including Amazon Bedrock , Amazon SageMaker , and Amazon OpenSearch Serverless in this solution. In this series, we use the slide deck Train and deploy Stable Diffusion using AWS Trainium & AWS Inferentia from the AWS Summit in Toronto, June 2023 to demonstrate the solution. I need numbers."
AWS 132
132 
Amazon SageMaker unveils the Cohere Command R fine-tuning model
AWS Machine Learning Blog
JULY 17, 2024
AWS announced the availability of the Cohere Command R fine-tuning model on Amazon SageMaker. About the Authors Shashi Raina is a Senior Partner Solutions Architect at Amazon Web Services (AWS), where he specializes in supporting generative AI (GenAI) startups. Start building with Cohere’s fine-tuning model in SageMaker today.
AWS 132
132 
Build a classification pipeline with Amazon Comprehend custom classification (Part I)
AWS Machine Learning Blog
SEPTEMBER 14, 2023
“Data locked away in text, audio, social media, and other unstructured sources can be a competitive advantage for firms that figure out how to use it“ Only 18% of organizations in a 2019 survey by Deloitte reported being able to take advantage of unstructured data. The majority of data, between 80% and 90%, is unstructured data.
AWS 129
129 
Tableau + AWS: Accelerating your digital transformation with Modern Cloud Analytics
Tableau
NOVEMBER 24, 2019
November 25, 2019 - 4:39am. To help customers unlock the power and flexibility of self-service analytics in the cloud, we’re continuously investing in our Modern Cloud Analytics initiative, which we announced at Tableau Conference in 2019. Core product integration and connectivity between Tableau and AWS. Jason Dudek.
Tableau 52
52 
Tableau + AWS: Accelerating your digital transformation with Modern Cloud Analytics
Tableau
NOVEMBER 24, 2019
November 25, 2019 - 4:39am. To help customers unlock the power and flexibility of self-service analytics in the cloud, we’re continuously investing in our Modern Cloud Analytics initiative, which we announced at Tableau Conference in 2019. Core product integration and connectivity between Tableau and AWS. Jason Dudek.
Tableau 52
52 
The journey of PGA TOUR’s generative AI virtual assistant, from concept to development to prototype
AWS Machine Learning Blog
MARCH 14, 2024
In this post we highlight how the AWS Generative AI Innovation Center collaborated with the AWS Professional Services and PGA TOUR to develop a prototype virtual assistant using Amazon Bedrock that could enable fans to extract information about any event, player, hole or shot level details in a seamless interactive manner.
SQL 134
134 
2022H2 Amazon Textract launch summary
AWS Machine Learning Blog
DECEMBER 29, 2022
This is why we launched Amazon Textract in 2019 to help you automate your tedious document processing workflows powered by AI. Integration with AWS Service Quotas. You can now proactively manage all your Amazon Textract service quotas via the AWS Service Quotas console. Increased default service quotas for Amazon Textract.
AWS 125
125 
How healthcare payers and plans can empower members with generative AI
AWS Machine Learning Blog
SEPTEMBER 12, 2024
Architecture The solution uses Amazon API Gateway , AWS Lambda , Amazon RDS, Amazon Bedrock, and Anthropic Claude 3 Sonnet on Amazon Bedrock to implement the backend of the application. Model deployment accounts – The LLMs offered by various vendors are hosted and operated by AWS in separate accounts dedicated for model deployment.
SQL 134
134 
Tableau + AWS: Accelerating your digital transformation with Modern Cloud Analytics
Tableau
NOVEMBER 24, 2019
November 25, 2019 - 4:39am. To help customers unlock the power and flexibility of self-service analytics in the cloud, we’re continuously investing in our Modern Cloud Analytics initiative, which we announced at Tableau Conference in 2019. Core product integration and connectivity between Tableau and AWS. Jason Dudek.
Tableau 52
52 
Rad AI reduces real-time inference latency by 50% using Amazon SageMaker
AWS Machine Learning Blog
NOVEMBER 26, 2024
We use AWS Fargate to run CPU inferences and other supporting components, usually alongside a comprehensive frontend API. Since joining as an early engineer hire in 2019, he has steadily worked on the design and architecture of Rad AI’s online inference systems.
AI 119
119 
Medical content creation in the age of generative AI
AWS Machine Learning Blog
JULY 3, 2024
To answer this question, the AWS Generative AI Innovation Center recently developed an AI assistant for medical content generation. 2019 Apr;179(4):561-569. Epub 2019 Jan 31. Liza (Elizaveta) Zinovyeva is an Applied Scientist at AWS Generative AI Innovation Center and is based in Berlin. Am J Med Genet A. Int J Nurs Stud.
AI 135
135 
Build a serverless meeting summarization backend with large language models on Amazon SageMaker JumpStart
AWS Machine Learning Blog
MAY 17, 2023
AWS delivers services that meet customers’ artificial intelligence (AI) and machine learning (ML) needs with services ranging from custom hardware like AWS Trainium and AWS Inferentia to generative AI foundation models (FMs) on Amazon Bedrock. SageMaker Model SageMakerModel: Type: AWS::SageMaker::Model Properties: ModelName: !Sub
AWS 97
97 
Reduce call hold time and improve customer experience with self-service virtual agents using Amazon Connect and Amazon Lex
AWS Machine Learning Blog
MARCH 31, 2023
Also, the introduction of federal REAL ID requirements in 2019 resulted in increased call volumes from drivers with questions. The contact center is powered by Amazon Connect, and Max, the virtual agent, is powered by Amazon Lex and the AWS QnABot solution. We’d love to hear from you. Let us know what you think in the comments section.
AWS 102
102 
Generate synthetic data for evaluating RAG systems using Amazon Bedrock
AWS Machine Learning Blog
SEPTEMBER 23, 2024
Amazon Bedrock Knowledge Bases offers a streamlined approach to implement RAG on AWS, providing a fully managed solution for connecting FMs to custom data sources. This shift by so many companies (along with the economy recovering) helped re-accelerate AWS’s revenue growth to 37% Y oY in 2021.nConversely, These areastounding numbers.
AWS 97
97 
Beyond forecasting: The delicate balance of serving customers and growing your business
AWS Machine Learning Blog
SEPTEMBER 28, 2023
Modern, state-of-the-art time series forecasting enables choice To meet real-world forecasting needs, AWS provides a broad and deep set of capabilities that deliver a modern approach to time series forecasting. AWS services address this need by the use of ML models coupled with quantile regression. References DeYong, G.
AWS 129
129 
Emily Webber of AWS on Pretraining Large Language Models
ODSC - Open Data Science
AUGUST 4, 2023
Recently, we spoke with Emily Webber, Principal Machine Learning Specialist Solutions Architect at AWS. She’s the author of “Pretrain Vision and Large Language Models in Python: End-to-end techniques for building and deploying foundation models on AWS.” And then I spent many years working with customers.
AWS 52
52 
Say Goodbye to Costly BERT Inference: Turbocharge with AWS Inferentia2 and Hugging Face…
Mlearning.ai
JUNE 7, 2023
AWS Inferentia accelerators are custom-built machine learning inference chips designed by Amazon Web Services (AWS) to optimize inference workloads on the AWS platform. The AWS Inferentia chips are designed with a focus on delivering high performance, low latency, and cost efficiency for inference workloads.
AWS 52
52 
A review of purpose-built accelerators for financial services
AWS Machine Learning Blog
SEPTEMBER 11, 2024
Examples of other PBAs now available include AWS Inferentia and AWS Trainium , Google TPU, and Graphcore IPU. The AWS P5 EC2 instance type range is based on the NVIDIA H100 chip, which uses the Hopper architecture. In November 2023, AWS announced the next generation Trainium2 chip.
AWS 113
113 
Let's personalize your content