AWS and Blog - Data Science Current

Using AWS Athena and QuickSight for Data Analysis

Analytics Vidhya

AUGUST 25, 2022

This blog post will walk you through the necessary steps to achieve this using Amazon services and tools. The post Using AWS Athena and QuickSight for Data Analysis appeared first on Analytics Vidhya. Introduction Ever wondered how to query and analyze raw data? Also, have you ever tried doing this with Athena and QuickSight?

Data Analysis

Data Analysis Data Analysis AWS Data Science

Enhanced observability for AWS Trainium and AWS Inferentia with Datadog

AWS Machine Learning Blog

NOVEMBER 26, 2024

AWS AI chips, Trainium and Inferentia, enable you to build and deploy generative AI models at higher performance and lower cost. The Datadog dashboard offers a detailed view of your AWS AI chip (Trainium or Inferentia) performance, such as the number of instances, availability, and AWS Region.

AWS

AWS ML ML Data Pipeline

Implement RAG while meeting data residency requirements using AWS hybrid and edge services

Flipboard

JANUARY 14, 2025

In this post, we show how to extend Amazon Bedrock Agents to hybrid and edge services such as AWS Outposts and AWS Local Zones to build distributed Retrieval Augmented Generation (RAG) applications with on-premises data for improved model outcomes.

AWS

AWS Database AI AI

Webinars

Automation, Evolved: Your New Playbook For Smarter Knowledge Work

MORE WEBINARS

Building an End-to-End Data Pipeline on AWS: Embedded-Based Search Engine

Analytics Vidhya

MAY 26, 2023

Introduction Discover the ultimate guide to building a powerful data pipeline on AWS! With AWS, you can unleash the full potential of your data. In today’s data-driven world, organizations need efficient pipelines to collect, process, and leverage valuable data.

Data Pipeline

Data Pipeline AWS Analytics Analytics

Build and deploy a UI for your generative AI applications with AWS and Python

AWS Machine Learning Blog

NOVEMBER 6, 2024

AWS provides a powerful set of tools and services that simplify the process of building and deploying generative AI applications, even for those with limited experience in frontend and backend development. The AWS deployment architecture makes sure the Python application is hosted and accessible from the internet to authenticated users.

AWS

AWS Python AI AI

Transcribe, translate, and summarize live streams in your browser with AWS AI and generative AI services

AWS Machine Learning Blog

NOVEMBER 13, 2024

Recognizing this need, we have developed a Chrome extension that harnesses the power of AWS AI and generative AI services, including Amazon Bedrock , an AWS managed service to build and scale generative AI applications with foundation models (FMs). The user signs in by entering a user name and a password.

AWS

AWS AI AI Natural Language Processing

Using Amazon Q Business with AWS HealthScribe to gain insights from patient consultations

AWS Machine Learning Blog

OCTOBER 17, 2024

During re:Invent 2023, we launched AWS HealthScribe , a HIPAA eligible service that empowers healthcare software vendors to build their clinical applications to use speech recognition and generative AI to automatically create preliminary clinician documentation. AWS HealthScribe will then output two files which are also stored on Amazon S3.

AWS

AWS Machine Learning Machine Learning AI

Racing into the future: How AWS DeepRacer fueled my AI and ML journey

AWS Machine Learning Blog

NOVEMBER 19, 2024

In 2018, I sat in the audience at AWS re:Invent as Andy Jassy announced AWS DeepRacer —a fully autonomous 1/18th scale race car driven by reinforcement learning. But AWS DeepRacer instantly captured my interest with its promise that even inexperienced developers could get involved in AI and ML.

AWS

AWS ML ML AI

Your guide to generative AI and ML at AWS re:Invent 2024

AWS Machine Learning Blog

NOVEMBER 19, 2024

The excitement is building for the fourteenth edition of AWS re:Invent, and as always, Las Vegas is set to host this spectacular event. Third, we’ll explore the robust infrastructure services from AWS powering AI innovation, featuring Amazon SageMaker , AWS Trainium , and AWS Inferentia under AI/ML, as well as Compute topics.

AWS

AWS ML ML AI

How AWS sales uses Amazon Q Business for customer engagement

AWS Machine Learning Blog

DECEMBER 11, 2024

Earlier this year, we published the first in a series of posts about how AWS is transforming our seller and customer journeys using generative AI. Field Advisor serves four primary use cases: AWS-specific knowledge search With Amazon Q Business, weve made internal data sources as well as public AWS content available in Field Advisors index.

AWS

AWS Database AI AI

Build a multi-tenant generative AI environment for your enterprise on AWS

AWS Machine Learning Blog

NOVEMBER 7, 2024

It also uses a number of other AWS services such as Amazon API Gateway , AWS Lambda , and Amazon SageMaker. You can use AWS services such as Application Load Balancer to implement this approach. On AWS, you can use the fully managed Amazon Bedrock Agents or tools of your choice such as LangChain agents or LlamaIndex agents.

AWS

AWS AI AI Machine Learning

How AWS Sales uses generative AI to streamline account planning

AWS Machine Learning Blog

APRIL 3, 2025

Every year, AWS Sales personnel draft in-depth, forward looking strategy documents for established AWS customers. These documents help the AWS Sales team to align with our customer growth strategy and to collaborate with the entire sales team on long-term growth ideas for AWS customers.

AWS

AWS AI AI Database

Evaluate large language models for your machine translation tasks on AWS

AWS Machine Learning Blog

JANUARY 7, 2025

This blog post with accompanying code presents a solution to experiment with real-time machine translation using foundation models (FMs) available in Amazon Bedrock. To run the project code, make sure that you have fulfilled the AWS CDK prerequisites for Python. For collection_name , use the OpenSearch Serverless collection name.

AWS

AWS Python AI AI

PEFT fine tuning of Llama 3 on SageMaker HyperPod with AWS Trainium

AWS Machine Learning Blog

DECEMBER 24, 2024

To simplify infrastructure setup and accelerate distributed training, AWS introduced Amazon SageMaker HyperPod in late 2023. In this blog post, we showcase how you can perform efficient supervised fine tuning for a Meta Llama 3 model using PEFT on AWS Trainium with SageMaker HyperPod. architectures/5.sagemaker-hyperpod/LifecycleScripts/base-config/

AWS

AWS Clustering Deep Learning Deep Learning

Deploy Meta Llama 3.1-8B on AWS Inferentia using Amazon EKS and vLLM

AWS Machine Learning Blog

NOVEMBER 26, 2024

AWS Trainium and AWS Inferentia based instances, combined with Amazon Elastic Kubernetes Service (Amazon EKS), provide a performant and low cost framework to run LLMs efficiently in a containerized environment. Adjust the following configuration to suit your needs, such as the Amazon EKS version, cluster name, and AWS Region.

AWS

AWS Clustering ML ML

Accelerating ML experimentation with enhanced security: AWS PrivateLink support for Amazon SageMaker with MLflow

AWS Machine Learning Blog

DECEMBER 9, 2024

It simplifies the often complex and time-consuming tasks involved in setting up and managing an MLflow environment, allowing ML administrators to quickly establish secure and scalable MLflow environments on AWS. AWS CodeArtifact , which provides a private PyPI repository so that SageMaker can use it to download necessary packages.

AWS

AWS ML ML Data Scientist

Principal Financial Group uses QnABot on AWS and Amazon Q Business to enhance workforce productivity with generative AI

AWS Machine Learning Blog

NOVEMBER 15, 2024

With the QnABot on AWS (QnABot), integrated with Microsoft Azure Entra ID access controls, Principal launched an intelligent self-service solution rooted in generative AI. Principal also used the AWS open source repository Lex Web UI to build a frontend chat interface with Principal branding.

AWS

AWS AI AI Machine Learning

Build a reverse image search engine with Amazon Titan Multimodal Embeddings in Amazon Bedrock and AWS managed services

AWS Machine Learning Blog

NOVEMBER 13, 2024

Prerequisites To implement the proposed solution, make sure that you have the following: An AWS account and a working knowledge of FMs, Amazon Bedrock , Amazon SageMaker , Amazon OpenSearch Service , Amazon S3 , and AWS Identity and Access Management (IAM). Amazon Titan Multimodal Embeddings model access in Amazon Bedrock.

AWS

AWS Database K-nearest Neighbors AI

Accelerate digital pathology slide annotation workflows on AWS using H-optimus-0

AWS Machine Learning Blog

JANUARY 31, 2025

Solution overview Our solution uses the AWS integrated ecosystem to create an efficient scalable pipeline for digital pathology AI workflows. Prerequisites We assume you have access to and are authenticated in an AWS account. The AWS CloudFormation template for this solution uses t3.medium

AWS

AWS Supervised Learning ML ML

Deploy Meta Llama 3.1 models cost-effectively in Amazon SageMaker JumpStart with AWS Inferentia and AWS Trainium

AWS Machine Learning Blog

NOVEMBER 25, 2024

8B and 70B inference support on AWS Trainium and AWS Inferentia instances in Amazon SageMaker JumpStart. Trainium and Inferentia, enabled by the AWS Neuron software development kit (SDK), offer high performance and lower the cost of deploying Meta Llama 3.1 An AWS Identity and Access Management (IAM) role to access SageMaker.

AWS

AWS Python ML ML

AWS Weekly Roundup: 197 new launches, AI training partnership with Anthropic, and join AWS re:Invent virtually (Nov 25, 2024)

Flipboard

NOVEMBER 25, 2024

Last week, I saw an astonishing 197 new service launches from AWS. This means we are getting closer to AWS re:Invent 2024! Our News Blog team is also …

AWS

AWS AI AI Machine Learning

Databricks Wins AWS ISV Partner of the Year Award in NAMER

databricks

NOVEMBER 28, 2023

We’re thrilled to share that Databricks has won the AWS ISV Partner of the Year award for North America. This award recognizes top I.

AWS

Apply Amazon SageMaker Studio lifecycle configurations using AWS CDK

AWS Machine Learning Blog

NOVEMBER 26, 2024

Solution overview The solution constitutes a best-practice Amazon SageMaker domain setup with a configurable list of domain user profiles and a shared SageMaker Studio space using the AWS Cloud Development Kit (AWS CDK). The AWS CDK is a framework for defining cloud infrastructure as code. The AWS CDK installed.

AWS

AWS Data Scientist ML ML

Orchestrate generative AI workflows with Amazon Bedrock and AWS Step Functions

AWS Machine Learning Blog

NOVEMBER 22, 2024

This post discusses how to use AWS Step Functions to efficiently coordinate multi-step generative AI workflows, such as parallelizing API calls to Amazon Bedrock to quickly gather answers to lists of submitted questions. sync) pattern, which automatically waits for the completion of asynchronous jobs.

AWS

AWS AI AI Database

Introducing Databricks Fleet Clusters for AWS

databricks

MAY 10, 2023

We're excited to announce the general availability of Databricks Fleet clusters on AWS. What are Fleet clusters? Databricks Fleet clusters unlock the potential.

Clustering

Clustering AWS

Serving LLMs using vLLM and Amazon EC2 instances with AWS AI chips

AWS Machine Learning Blog

NOVEMBER 26, 2024

Using vLLM on AWS Trainium and Inferentia makes it possible to host LLMs for high performance inference and scalability. Deploy vLLM on AWS Trainium and Inferentia EC2 instances In these sections, you will be guided through using vLLM on an AWS Inferentia EC2 instance to deploy Meta’s newest Llama 3.2 You will use inf2.xlarge

AWS

AWS AI AI Artificial Intelligence

Build a Travel Planner with React Native, AWS Amplify, and Amazon Bedrock Knowledge Base

Flipboard

NOVEMBER 22, 2024

In this blog post, we will learn how to build a travel planner application using React Native. With the announcement of the Amplify AI kit, we learned how to build custom UI components, conversation history and add external data to the conversation flow.

AWS

AWS AI AI Computer Science

Shaping the future: OMRON’s data-driven journey with AWS

AWS Machine Learning Blog

APRIL 3, 2025

This post explores how OMRON Europe is using Amazon Web Services (AWS) to build its advanced ODAP and its progress toward harnessing the power of generative AI. Some of these tools included AWS Cloud based solutions, such as AWS Lambda and AWS Step Functions.

AWS

AWS Data Governance Data Silos SQL

AWS re:Invent 2024 Highlights: Top takeaways from Swami Sivasubramanian to help customers manage generative AI at scale

AWS Machine Learning Blog

DECEMBER 16, 2024

We spoke with Dr. Swami Sivasubramanian, Vice President of Data and AI, shortly after AWS re:Invent 2024 to hear his impressionsand to get insights on how the latest AWS innovations help meet the real-world needs of customers as they build and scale transformative generative AI applications. Canva uses AWS to power 1.2

AWS

AWS AI AI Data Warehouse

Setup and use JupyterHub (TLJH) on AWS EC2

KDnuggets

JANUARY 23, 2023

This blog post will make you less likely to run into issues in this 15+ step process. JupyterHub is a multi-user, container-friendly version of the Jupyter Notebook. However, it can be difficult to setup.

AWS

Transforming financial analysis with CreditAI on Amazon Bedrock: Octus’s journey with AWS

AWS Machine Learning Blog

MARCH 10, 2025

We walk through the journey Octus took from managing multiple cloud providers and costly GPU instances to implementing a streamlined, cost-effective solution using AWS services including Amazon Bedrock, AWS Fargate , and Amazon OpenSearch Service. Along the way, it also simplified operations as Octus is an AWS shop more generally.

AWS

AWS Database AI AI

Unlocking insights and enhancing customer service: Intact’s transformative AI journey with AWS

AWS Machine Learning Blog

OCTOBER 16, 2024

The company developed an automated solution called Call Quality (CQ) using AI services from Amazon Web Services (AWS). In this post, we demonstrate how the CQ solution used Amazon Transcribe and other AWS services to improve critical KPIs with AI-powered contact center call auditing and analytics.

AWS

AWS AI AI Machine Learning

Create a generative AI–powered custom Google Chat application using Amazon Bedrock

AWS Machine Learning Blog

OCTOBER 31, 2024

AWS offers powerful generative AI services , including Amazon Bedrock , which allows organizations to create tailored use cases such as AI chat-based assistants that give answers based on knowledge contained in the customers’ documents, and much more. The following figure illustrates the high-level design of the solution.

AWS

AWS AI AI Python

Amazon Q Business simplifies integration of enterprise knowledge bases at scale

Flipboard

FEBRUARY 11, 2025

Enhancing AWS Support Engineering efficiency The AWS Support Engineering team faced the daunting task of manually sifting through numerous tools, internal sources, and AWS public documentation to find solutions for customer inquiries. Then we introduce the solution deployment using three AWS CloudFormation templates.

AWS

AWS ML ML Machine Learning

Announcing the General Availability of Private Link and CMK for Databricks on AWS

databricks

MARCH 22, 2023

We are excited to announce that PrivateLink and using customer-managed keys (CMK) for encryption are now Generally Available (GA) for Databricks on AWS.

AWS

Understanding prompt engineering: Unlock the creative potential of Stability AI models on AWS

AWS Machine Learning Blog

NOVEMBER 14, 2024

About the Authors Isha Dua is a Senior Solutions Architect based in the San Francisco Bay Area working with GENAI Model providers and helping customer optimize their GENAI workloads on AWS.

AWS

AWS AI AI Machine Learning

AWS DeepRacer: Closing time at AWS re:Invent 2024 –How did that physical racing go?

AWS Machine Learning Blog

FEBRUARY 27, 2025

Having spent the last years studying the art of AWS DeepRacer in the physical world, the author went to AWS re:Invent 2024. In AWS DeepRacer: How to master physical racing? , I wrote in detail about some aspects relevant to racing AWS DeepRacer in the physical world. How did it go?

AWS

AWS Analytics Analytics AI

Automate Amazon Bedrock batch inference: Building a scalable and efficient pipeline

AWS Machine Learning Blog

OCTOBER 29, 2024

Refer to Supported Regions and models for batch inference for current supporting AWS Regions and models. To address this consideration and enhance your use of batch inference, we’ve developed a scalable solution using AWS Lambda and Amazon DynamoDB. Amazon S3 invokes the {stack_name}-create-batch-queue-{AWS-Region} Lambda function.

AWS

AWS Data Scientist AI AI

Best Practices and Guidance for Cloud Engineers to Deploy Databricks on AWS: Part 3

databricks

JULY 28, 2023

For the final part of our Best Practices and Guidance for Cloud Engineers to Deploy Databricks on AWS series, we'll cover an important.

AWS

Best Practices and Guidance for Cloud Engineers to Deploy Databricks on AWS: Part 2

databricks

JANUARY 26, 2023

This is part two of a three-part series in Best Practices and Guidance for Cloud Engineers to deploy Databricks on AWS. You can.

AWS

ByteDance processes billions of daily videos using their multimodal video understanding models on AWS Inferentia2

AWS Machine Learning Blog

FEBRUARY 26, 2025

At ByteDance, we collaborated with Amazon Web Services (AWS) to deploy multimodal large language models (LLMs) for video understanding using AWS Inferentia2 across multiple AWS Regions around the world. Solution overview Weve collaborated with AWS since the first generation of Inferentia chips.

AWS

AWS ML ML Clustering

Fine-tune and host SDXL models cost-effectively with AWS Inferentia2

AWS Machine Learning Blog

FEBRUARY 6, 2025

Building upon a previous Machine Learning Blog post to create personalized avatars by fine-tuning and hosting the Stable Diffusion 2.1 We show how to then prepare the fine-tuned model to run on AWS Inferentia2 powered Amazon EC2 Inf2 instances , unlocking superior price performance for your inference workloads.

AWS

AWS Machine Learning Machine Learning Deep Learning

Effectively use prompt caching on Amazon Bedrock

AWS Machine Learning Blog

APRIL 7, 2025

read()) print(json.dumps(response_body, indent=2)) response = requests.get("[link] blog = response.text chat_with_document(blog, "What is the blog writing about?") For the subsequent request, we can ask a different question: chat_with_document(blog, "what are the use cases?") Specifically, it:nn1.

AWS

AWS AI AI ML

Unlocking near real-time analytics with petabytes of transaction data using Amazon Aurora Zero-ETL integration with Amazon Redshift and dbt Cloud

Flipboard

NOVEMBER 27, 2024

To implement this solution, complete the following steps: Set up Zero-ETL integration from the AWS Management Console for Amazon Relational Database Service (Amazon RDS). An AWS Identity and Access Management (IAM) user with sufficient permissions to interact with the AWS Management Console and related AWS services.

ETL

ETL Data Warehouse Analytics Analytics

Using AWS Athena and QuickSight for Data Analysis

Enhanced observability for AWS Trainium and AWS Inferentia with Datadog

Webinars

Trending Sources

Implement RAG while meeting data residency requirements using AWS hybrid and edge services

Webinars

Building an End-to-End Data Pipeline on AWS: Embedded-Based Search Engine

Build and deploy a UI for your generative AI applications with AWS and Python

Transcribe, translate, and summarize live streams in your browser with AWS AI and generative AI services

Using Amazon Q Business with AWS HealthScribe to gain insights from patient consultations

Racing into the future: How AWS DeepRacer fueled my AI and ML journey

Your guide to generative AI and ML at AWS re:Invent 2024

How AWS sales uses Amazon Q Business for customer engagement

Build a multi-tenant generative AI environment for your enterprise on AWS

How AWS Sales uses generative AI to streamline account planning

Evaluate large language models for your machine translation tasks on AWS

PEFT fine tuning of Llama 3 on SageMaker HyperPod with AWS Trainium

Deploy Meta Llama 3.1-8B on AWS Inferentia using Amazon EKS and vLLM

Accelerating ML experimentation with enhanced security: AWS PrivateLink support for Amazon SageMaker with MLflow

Principal Financial Group uses QnABot on AWS and Amazon Q Business to enhance workforce productivity with generative AI

Build a reverse image search engine with Amazon Titan Multimodal Embeddings in Amazon Bedrock and AWS managed services

Accelerate digital pathology slide annotation workflows on AWS using H-optimus-0

Deploy Meta Llama 3.1 models cost-effectively in Amazon SageMaker JumpStart with AWS Inferentia and AWS Trainium

AWS Weekly Roundup: 197 new launches, AI training partnership with Anthropic, and join AWS re:Invent virtually (Nov 25, 2024)

Databricks Wins AWS ISV Partner of the Year Award in NAMER

Apply Amazon SageMaker Studio lifecycle configurations using AWS CDK

Orchestrate generative AI workflows with Amazon Bedrock and AWS Step Functions

Introducing Databricks Fleet Clusters for AWS

Serving LLMs using vLLM and Amazon EC2 instances with AWS AI chips

Build a Travel Planner with React Native, AWS Amplify, and Amazon Bedrock Knowledge Base

Shaping the future: OMRON’s data-driven journey with AWS

AWS re:Invent 2024 Highlights: Top takeaways from Swami Sivasubramanian to help customers manage generative AI at scale

Setup and use JupyterHub (TLJH) on AWS EC2

Transforming financial analysis with CreditAI on Amazon Bedrock: Octus’s journey with AWS

Unlocking insights and enhancing customer service: Intact’s transformative AI journey with AWS

Create a generative AI–powered custom Google Chat application using Amazon Bedrock

Amazon Q Business simplifies integration of enterprise knowledge bases at scale

Announcing the General Availability of Private Link and CMK for Databricks on AWS

Understanding prompt engineering: Unlock the creative potential of Stability AI models on AWS

AWS DeepRacer: Closing time at AWS re:Invent 2024 –How did that physical racing go?

Automate Amazon Bedrock batch inference: Building a scalable and efficient pipeline

Best Practices and Guidance for Cloud Engineers to Deploy Databricks on AWS: Part 3

Best Practices and Guidance for Cloud Engineers to Deploy Databricks on AWS: Part 2

ByteDance processes billions of daily videos using their multimodal video understanding models on AWS Inferentia2

Fine-tune and host SDXL models cost-effectively with AWS Inferentia2

Effectively use prompt caching on Amazon Bedrock

Unlocking near real-time analytics with petabytes of transaction data using Amazon Aurora Zero-ETL integration with Amazon Redshift and dbt Cloud

Stay Connected