AWS Machine Learning Blog

NOVEMBER 21, 2024

Today, we’re excited to share the journey of the VW —an innovator in the automotive industry and Europe’s largest car maker—to enhance knowledge management by using generative AI , Amazon Bedrock , and Amazon Kendra to devise a solution based on Retrieval Augmented Generation (RAG) that makes internal information more easily accessible by its users.

AWS 68

AWS AI AI Machine Learning 68

AWS Machine Learning Blog

JULY 2, 2024

AWS optimized the PyTorch torch.compile feature for AWS Graviton3 processors. the optimizations are available in torch Python wheels and AWS Graviton PyTorch deep learning container (DLC). The goal for the AWS Graviton team was to optimize torch.compile backend for Graviton3 processors. Starting with PyTorch 2.3.1,

AWS 119

AWS Natural Language Processing Python ML 119

Towards AI

AUGUST 6, 2024

Author(s): Youssef Hosni Originally published on Towards AI. Master LLMs & Generative AI Through These Five Books This article reviews five key books that explore the rapidly evolving fields of large language models (LLMs) and generative AI, providing essential insights into these transformative technologies.

Natural Language Processing 106

Natural Language Processing AI AI AWS 106

AWS Machine Learning Blog

NOVEMBER 22, 2023

Yes, the AWS re:Invent season is upon us and as always, the place to be is Las Vegas! Now all you need is some guidance on generative AI and machine learning (ML) sessions to attend at this twelfth edition of re:Invent. And although generative AI has appeared in previous events, this year we’re taking it to the next level.

AWS 132

AWS ML ML AI 132

AWS Machine Learning Blog

OCTOBER 21, 2024

Many organizations are building generative AI applications powered by large language models (LLMs) to boost productivity and build differentiated experiences. Most generative AI use cases involve human interaction, which requires AI accelerators that can deliver real time response rates with low latency. Mistral AI 7.3

AWS 86

AWS AI AI Machine Learning 86

AWS Machine Learning Blog

AUGUST 28, 2024

This post demonstrates how to seamlessly automate the deployment of an end-to-end RAG solution using Knowledge Bases for Amazon Bedrock and the AWS Cloud Development Kit (AWS CDK), enabling organizations to quickly set up a powerful question answering system. The AWS CDK already set up. txt,md,html,doc/docx,csv,xls/.xlsx,pdf).

AWS 94

AWS Natural Language Processing Machine Learning Machine Learning 94

Analytics Vidhya

FEBRUARY 3, 2022

Deep learning, natural language processing, and computer vision are examples […]. The post Top 10 AI and Data Science Trends in 2022 appeared first on Analytics Vidhya. Times change, technology improves and our lives get better.

Data Science 317

Data Science Natural Language Processing Deep Learning Deep Learning 317

AWS Machine Learning Blog

JUNE 26, 2024

Artificial intelligence and machine learning (AI/ML) technologies can assist capital market organizations overcome these challenges. Intelligent document processing (IDP) applies AI/ML techniques to automate data extraction from documents. These applications come with the drawback of being inflexible and high-maintenance.

AWS 114

AWS ML ML AI 114

AWS Machine Learning Blog

JUNE 11, 2024

Each of these products are infused with artificial intelligence (AI) capabilities to deliver exceptional customer experience. Sprinklr’s specialized AI models streamline data processing, gather valuable insights, and enable workflows and analytics at scale to drive better decision-making and productivity.

Machine Learning 106

Machine Learning Machine Learning AWS Natural Language Processing 106

AWS Machine Learning Blog

NOVEMBER 13, 2024

The financial and banking industry can significantly enhance investment research by integrating generative AI into daily tasks like financial statement analysis. Generative AI models can automate finding and extracting financial data from documents like 10-Ks, balance sheets, and income statements.

AWS 100

AWS AI AI Natural Language Processing 100

AWS Machine Learning Blog

MARCH 13, 2024

In this post, we introduce solutions that enable audio and text chat moderation using various AWS services, including Amazon Transcribe , Amazon Comprehend , Amazon Bedrock , and Amazon OpenSearch Service. Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies.

AWS 131

AWS AI AI Natural Language Processing 131

AWS Machine Learning Blog

OCTOBER 31, 2024

Amazon SageMaker Ground Truth enables the creation of high-quality, large-scale training datasets, essential for fine-tuning across a wide range of applications, including large language models (LLMs) and generative AI. This feature is currently available in all AWS Regions that support SageMaker Ground Truth.

AWS 116

AWS Natural Language Processing ML ML 116

AWS Machine Learning Blog

JANUARY 24, 2024

Generative AI solutions have the potential to transform businesses by boosting productivity and improving customer experiences, and using large language models (LLMs) with these solutions has become increasingly popular. Where is the data processed? Who has access to the data?

AWS 140

AWS Database AI AI 140

Data Science Dojo

SEPTEMBER 30, 2024

AI code generator tools are stepping in, offering a new way to approach software development. Whether you’re new to coding or a seasoned pro, AI is changing the game, making development faster, smarter, and more accessible. What is AI Code Generation? How Do AI Code Generator Tools Work?

AI 244

AI AI AWS Python 244

AWS Machine Learning Blog

SEPTEMBER 28, 2023

In either case, as knowledge management becomes more complex, generative AI presents a game-changing opportunity for enterprises to connect people to the information they need to perform and innovate. To help tackle this challenge, Accenture collaborated with AWS to build an innovative generative AI solution called Knowledge Assist.

AWS 123

AWS AI AI Artificial Intelligence 123

AWS Machine Learning Blog

AUGUST 5, 2024

In recent years, we have seen a big increase in the size of large language models (LLMs) used to solve natural language processing (NLP) tasks such as question answering and text summarization. For example, on AWS Trainium , Llama-3-70B has a median per-token latency of 21.4 compared to 76.4).

AWS 112

AWS ML ML Natural Language Processing 112

AWS Machine Learning Blog

FEBRUARY 26, 2024

Large Language Models (LLMs) have revolutionized the field of natural language processing (NLP), improving tasks such as language translation, text summarization, and sentiment analysis. Through AWS Step Functions orchestration, the function calls Amazon Comprehend to detect the sentiment and toxicity.

AWS 132

AWS Machine Learning Machine Learning Big Data 132

AWS Machine Learning Blog

OCTOBER 15, 2024

Now, with the advent of large language models (LLMs), you can use generative AI -powered virtual assistants to provide real-time analysis of speech, identification of areas for improvement, and suggestions for enhancing speech delivery. The generative AI capabilities of Amazon Bedrock efficiently process user speech inputs.

AWS 127

AWS AI AI Python 127

AWS Machine Learning Blog

OCTOBER 5, 2023

In this post, we walk through how to fine-tune Llama 2 on AWS Trainium , a purpose-built accelerator for LLM training, to reduce training times and costs. We review the fine-tuning scripts provided by the AWS Neuron SDK (using NeMo Megatron-LM), the various configurations we used, and the throughput results we saw.

AWS 125

AWS Machine Learning Machine Learning Deep Learning 125

AWS Machine Learning Blog

OCTOBER 29, 2024

Recently, we’ve been witnessing the rapid development and evolution of generative AI applications, with observability and evaluation emerging as critical aspects for developers, data scientists, and stakeholders. In the context of Amazon Bedrock , observability and evaluation become even more crucial.

AWS 112

AWS AI AI Data Scientist 112

AWS Machine Learning Blog

MARCH 12, 2024

In this post, we discuss how Leidos worked with AWS to develop an approach to privacy-preserving large language model (LLM) inference using AWS Nitro Enclaves. LLMs are designed to understand and generate human-like language, and are used in many industries, including government, healthcare, financial, and intellectual property.

AWS 116

AWS Natural Language Processing Machine Learning Machine Learning 116

AWS Machine Learning Blog

MAY 1, 2024

Large language models (LLMs) are making a significant impact in the realm of artificial intelligence (AI). Llama2 by Meta is an example of an LLM offered by AWS. Llama 2 is an auto-regressive language model that uses an optimized transformer architecture and is intended for commercial and research use in English.

AWS 116

AWS ML ML Clustering 116

AWS Machine Learning Blog

OCTOBER 24, 2024

These agentic workflows decompose the natural language query-based tasks into multiple actionable steps with iterative feedback loops and self-reflection to produce the final result using tools and APIs. Amazon Bedrock Agents helps you accelerate generative AI application development by orchestrating multistep tasks.

AWS 96

AWS SQL Database AI 96

AWS Machine Learning Blog

JUNE 23, 2023

Additionally, you can use AWS Lambda directly to expose your models and deploy your ML applications using your preferred open-source framework, which can prove to be more flexible and cost-effective. We also show you how to automate the deployment using the AWS Cloud Development Kit (AWS CDK). The artifacts are all in place.

AWS 101

AWS ML ML Python 101

AWS Machine Learning Blog

MAY 4, 2023

The world of artificial intelligence (AI) and machine learning (ML) has been witnessing a paradigm shift with the rise of generative AI models that can create human-like text, images, code, and audio. Compared to classical ML models, generative AI models are significantly bigger and more complex.

AWS 93

AWS Deep Learning Deep Learning ML 93

AWS Machine Learning Blog

NOVEMBER 15, 2023

They are processing data across channels, including recorded contact center interactions, emails, chat and other digital channels. Solution requirements Principal provides investment services through Genesys Cloud CX, a cloud-based contact center that provides powerful, native integrations with AWS.

AWS 126

AWS Analytics Analytics ML 126

Flipboard

JUNE 20, 2023

There are several ways AWS is enabling ML practitioners to lower the environmental impact of their workloads. One way is through providing prescriptive guidance around architecting your AI/ML workloads for sustainability. Performance, Cost and Energy Efficiency Results of Inference Benchmarks AWS Inferentia delivers 6.3

AWS 123

AWS Machine Learning Machine Learning Deep Learning 123

AWS Machine Learning Blog

JUNE 13, 2023

The size of the machine learning (ML) models––large language models ( LLMs ) and foundation models ( FMs )–– is growing fast year-over-year , and these models need faster and more powerful accelerators, especially for generative AI. With AWS Inferentia1, customers saw up to 2.3x With AWS Inferentia1, customers saw up to 2.3x

AWS 84

AWS ML ML Deep Learning 84

AWS Machine Learning Blog

SEPTEMBER 19, 2023

Multi-modal agents are AI systems that can understand and analyze data in multiple modalities using the right tools in their toolkit. Multi-modal agents, in conjunction with generative AI, are finding a wide spread application in financial markets. Detecting fraudulent collusion across data types requires multi-modal analysis.

AWS 126

AWS AI AI ML 126

AWS Machine Learning Blog

MAY 10, 2023

In this post, we focus on how you can take advantage of the AWS Graviton3 -based Amazon Elastic Compute Cloud (EC2) C7g instances to help reduce inference costs by up to 50% relative to comparable EC2 instances for real-time inference on Amazon SageMaker. 4xlarge (AWS Graviton3) is about 50% of the c5.4xlarge and 40% of c6i.4xlarge;

AWS 94

AWS ML ML Machine Learning 94

AWS Machine Learning Blog

MAY 31, 2024

Genomic language models are a new and exciting field in the application of large language models to challenges in genomics. In this blog post and open source project , we show you how you can pre-train a genomics language model, HyenaDNA , using your genomic data in the AWS Cloud.

AWS 109

AWS ML ML Machine Learning 109

AWS Machine Learning Blog

OCTOBER 23, 2024

Generative AI is set to revolutionize user experiences over the next few years. A crucial step in that journey involves bringing in AI assistants that intelligently use tools to help customers navigate the digital landscape. In this post, we demonstrate how to deploy a contextual AI assistant.

AWS 96

AWS Natural Language Processing AI AI 96

AWS Machine Learning Blog

AUGUST 30, 2023

It enables translation of reports into human readable language, thereby alleviating the patients’ burden of reading through lengthy and obscure reports. To solve this problem, we propose the use of generative AI, a type of AI that can create new content and ideas, including conversations, stories, images, videos, and music.

AWS 134

AWS AI AI ML 134

AWS Machine Learning Blog

JUNE 21, 2024

To accomplish this, eSentire built AI Investigator, a natural language query tool for their customers to access security platform data by using AWS generative artificial intelligence (AI) capabilities. This helps customers quickly and seamlessly explore their security data and accelerate internal investigations.

AWS 124

AWS AI AI Natural Language Processing 124

AWS Machine Learning Blog

OCTOBER 30, 2024

Global Resiliency is a new Amazon Lex capability that enables near real-time replication of your Amazon Lex V2 bots in a second AWS Region. We showcase the replication process of bot versions and aliases across multiple Regions. Solution overview For this exercise, we create a BookHotel bot as our sample bot.

AWS 106

AWS AI AI Natural Language Processing 106

AWS Machine Learning Blog

OCTOBER 21, 2024

Amazon Bedrock Agents help you accelerate generative AI application development by orchestrating multistep tasks. Amazon Bedrock Agents allows you to write IaC code with AWS CloudFormation , the AWS Cloud Development Kit (AWS CDK), or Terraform. We also recommend that you get started using our Agent Blueprints construct.

AWS 91

AWS AI AI ML 91

AWS Machine Learning Blog

OCTOBER 18, 2024

In this post, we introduce an innovative solution for end-to-end model customization and deployment at the edge using Amazon SageMaker and Qualcomm AI Hub. The process uses a single ml.g5.2xlarge instance (providing one NVIDIA A10G Tensor Core GPU) with SageMaker for fine-tuning. How can Amazon SageMaker and Qualcomm AI Hub help?

AWS 100

AWS AI AI Machine Learning 100