Smart Data Collective

FEBRUARY 20, 2022

AWS (Amazon Web Services), the comprehensive and evolving cloud computing platform provided by Amazon, is comprised of infrastructure as a service (IaaS), platform as a service (PaaS) and packaged software as a service (SaaS). With its wide array of tools and convenience, AWS has already become a popular choice for many SaaS companies.

AWS 138

AWS Cloud Computing Data Lakes Database 138

Flipboard

OCTOBER 25, 2023

However, with the help of AI and machine learning (ML), new software tools are now available to unearth the value of unstructured data. In this post, we discuss how AWS can help you successfully address the challenges of extracting insights from unstructured data. The solution integrates data in three tiers.

AWS 166

AWS ML ML Analytics 166

AWS Machine Learning Blog

FEBRUARY 21, 2025

Lets assume that the question What date will AWS re:invent 2024 occur? The corresponding answer is also input as AWS re:Invent 2024 takes place on December 26, 2024. If the question was Whats the schedule for AWS events in December?, This setup uses the AWS SDK for Python (Boto3) to interact with AWS services.

AWS 130

AWS Natural Language Processing Machine Learning Machine Learning 130

Flipboard

JUNE 26, 2023

Companies are faced with the daunting task of ingesting all this data, cleansing it, and using it to provide outstanding customer experience. Typically, companies ingest data from multiple sources into their data lake to derive valuable insights from the data. Run the AWS Glue ML transform job.

AWS 123

AWS ML ML ETL 123

AWS Machine Learning Blog

NOVEMBER 22, 2023

Yes, the AWS re:Invent season is upon us and as always, the place to be is Las Vegas! are the sessions dedicated to AWS DeepRacer ! Generative AI is at the heart of the AWS Village this year. You marked your calendars, you booked your hotel, and you even purchased the airfare. And last but not least (and always fun!)

AWS 140

AWS ML ML AI 140

AWS Machine Learning Blog

JANUARY 29, 2025

Intelligent document processing , translation and summarization, flexible and insightful responses for customer support agents, personalized marketing content, and image and code generation are a few use cases using generative AI that organizations are rolling out in production.

AWS 104

AWS AI AI Database 104

AWS Machine Learning Blog

SEPTEMBER 27, 2024

Specifically, we cover the computer vision and artificial intelligence (AI) techniques used to combine datasets into a list of prioritized tasks for field teams to investigate and mitigate. About the authors Scott Patterson is a Senior Solutions Architect at AWS.

AWS 126

AWS Data Lakes ML ML 126

AWS Machine Learning Blog

AUGUST 26, 2024

At AWS, we are transforming our seller and customer journeys by using generative artificial intelligence (AI) across the sales lifecycle. Product consumption – Summaries of how customers are using AWS services over time. All data in this example summary is fictitious. The impact goes beyond just efficiency.

AWS 133

AWS AI AI K-nearest Neighbors 133

AWS Machine Learning Blog

AUGUST 8, 2024

As one of the largest AWS customers, Twilio engages with data, artificial intelligence (AI), and machine learning (ML) services to run their daily workloads. Data is the foundational layer for all generative AI and ML applications. The following diagram illustrates the solution architecture.

SQL 133

SQL Data Lakes Data Analyst AWS 133

AWS Machine Learning Blog

AUGUST 21, 2023

You can streamline the process of feature engineering and data preparation with SageMaker Data Wrangler and finish each stage of the data preparation workflow (including data selection, purification, exploration, visualization, and processing at scale) within a single visual interface.

AWS 98

AWS Data Lakes Clustering Data Preparation 98

AWS Machine Learning Blog

NOVEMBER 15, 2023

They are processing data across channels, including recorded contact center interactions, emails, chat and other digital channels. Solution requirements Principal provides investment services through Genesys Cloud CX, a cloud-based contact center that provides powerful, native integrations with AWS.

AWS 124

AWS Analytics Analytics ML 124

IBM Journey to AI blog

JUNE 11, 2024

Further to the acquisition, Broadcom decided to discontinue (link resides outside ibm.com) its AWS authorization to resell VMware Cloud on AWS as of 30 April 2024. As a result, AWS will no longer be able to offer new subscriptions or additional services.

AWS 85

AWS AI AI Data Lakes 85

Data Science 101

NOVEMBER 11, 2019

Azure Synapse Analytics This is the future of data warehousing. It combines data warehousing and data lakes into a simple query interface for a simple and fast analytics service. Call for Research Proposals Amazon is seeking proposals impact research in the Artificial Intelligence and Machine Learning areas.

Cloud Data 95

Cloud Data Data Science Azure Clustering 95

Flipboard

NOVEMBER 17, 2023

MongoDB vector data store MongoDB Atlas Vector Search is a new feature that allows you to store and search vector data in MongoDB. Vector data is a type of data that represents a point in a high-dimensional space. This type of data is often used in ML and artificial intelligence applications.

K-nearest Neighbors 170

K-nearest Neighbors AWS Clustering Database 170

IBM Journey to AI blog

MARCH 14, 2024

Businesses face significant hurdles when preparing data for artificial intelligence (AI) applications. The existence of data silos and duplication, alongside apprehensions regarding data quality, presents a multifaceted environment for organizations to manage.

AWS 93

AWS Database ETL AI 93

AWS Machine Learning Blog

JUNE 18, 2024

On December 6 th -8 th 2023, the non-profit organization, Tech to the Rescue , in collaboration with AWS, organized the world’s largest Air Quality Hackathon – aimed at tackling one of the world’s most pressing health and environmental challenges, air pollution. As always, AWS welcomes your feedback.

AWS 136

AWS AI AI Python 136

AWS Machine Learning Blog

AUGUST 21, 2024

Amazon DataZone is a data management service that makes it quick and convenient to catalog, discover, share, and govern data stored in AWS, on-premises, and third-party sources. An Amazon DataZone domain and an associated Amazon DataZone project configured in your AWS account.

Machine Learning 128

Machine Learning Machine Learning Data Governance ML 128

AWS Machine Learning Blog

MARCH 1, 2023

Flywheel creates a data lake (in Amazon S3) in your account where all the training and test data for all versions of the model are managed and stored. Periodically, the new labeled data (to retrain the model) can be made available to flywheel by creating datasets. The data can be accessed from AWS Open Data Registry.

Data Lakes 96

Data Lakes AWS ML ML 96

ODSC - Open Data Science

JUNE 7, 2023

To make your data management processes easier, here’s a primer on data lakes, and our picks for a few data lake vendors worth considering. What is a data lake? First, a data lake is a centralized repository that allows users or an organization to store and analyze large volumes of data.

Data Lakes 52

Data Lakes Azure Data Warehouse Hadoop 52

AWS Machine Learning Blog

JUNE 21, 2024

To accomplish this, eSentire built AI Investigator, a natural language query tool for their customers to access security platform data by using AWS generative artificial intelligence (AI) capabilities. eSentire has over 2 TB of signal data stored in their Amazon Simple Storage Service (Amazon S3) data lake.

AWS 132

AWS AI AI Natural Language Processing 132

AWS Machine Learning Blog

FEBRUARY 13, 2024

SageMaker Feature Store now makes it effortless to share, discover, and access feature groups across AWS accounts. With this launch, account owners can grant access to select feature groups by other accounts using AWS Resource Access Manager (AWS RAM). Review the access policy to understand permissions granted.

AWS 133

AWS ML ML Machine Learning 133

AWS Machine Learning Blog

MARCH 1, 2023

This feature also allows you to automate model retraining after new datasets are ingested and available in the flywheel´s data lake. First, let’s introduce some concepts: Flywheel – A flywheel is an AWS resource that orchestrates the ongoing training of a model for custom classification or custom entity recognition.

Data Lakes 98

Data Lakes AWS ML ML 98

AWS Machine Learning Blog

MAY 31, 2024

This means that individuals can ask companies to erase their personal data from their systems and from the systems of any third parties with whom the data was shared. FMs are trained on vast quantities of data, allowing them to be used to answer questions on a variety of subjects.

AWS 135

AWS Machine Learning Machine Learning Database 135

Flipboard

NOVEMBER 24, 2023

In this post, we will talk about how BMW Group, in collaboration with AWS Professional Services, built its Jupyter Managed (JuMa) service to address these challenges. For example, teams using these platforms missed an easy migration of their AI/ML prototypes to the industrialization of the solution running on AWS.

ML 152

ML ML AWS AI 152

AWS Machine Learning Blog

JULY 29, 2024

In Part 3 , we demonstrate how business analysts and citizen data scientists can create machine learning (ML) models, without code, in Amazon SageMaker Canvas and deploy trained models for integration with Salesforce Einstein Studio to create powerful business applications. For this post, we use the Anthropic Claude 3 Sonnet model.

AWS 129

AWS AI AI ML 129

ODSC - Open Data Science

OCTOBER 13, 2024

Be sure to check out her talk, “ Don’t Go Over the Deep End: Building an Effective OSS Management Layer for Your Data Lake ,” there! Managing a data lake can often feel like being lost at sea — especially when dealing with both structured and unstructured data.

Data Lakes 40

Data Lakes Database Data Pipeline SQL 40

AWS Machine Learning Blog

NOVEMBER 22, 2023

The IDP Well-Architected Lens is intended for all AWS customers who use AWS to run intelligent document processing (IDP) solutions and are searching for guidance on how to build secure, efficient, and reliable IDP solutions on AWS. AWS might periodically update the service limits based on various factors.

AWS 125

AWS ML ML Machine Learning 125

AWS Machine Learning Blog

JUNE 25, 2024

Amazon Bedrock , a fully managed service designed to facilitate the integration of LLMs into enterprise applications, offers a choice of high-performing LLMs from leading artificial intelligence (AI) companies like Anthropic, Mistral AI, Meta, and Amazon through a single API. The Step Functions workflow starts.

AWS 132

AWS Natural Language Processing Machine Learning Machine Learning 132

AWS Machine Learning Blog

AUGUST 15, 2024

Prepare the data with SageMaker Canvas Now that you understand your dataset characteristics and potential issues, you can use the Chat for data prep feature in SageMaker Canvas to simplify data preparation with natural language prompts. Solutions Architect at AWS. He has a background in AI/ML & big data.

ML 131

ML ML Data Preparation AWS 131

AWS Machine Learning Blog

SEPTEMBER 11, 2024

In this post, we demonstrate how to build a robust real-time anomaly detection solution for streaming time series data using Amazon Managed Service for Apache Flink and other AWS managed services. It offers an AWS CloudFormation template for straightforward deployment in an AWS account.

AWS 122

AWS ML ML Apache Kafka 122

AWS Machine Learning Blog

FEBRUARY 28, 2024

Third, despite the larger adoption of centralized analytics solutions like data lakes and warehouses, complexity rises with different table names and other metadata that is required to create the SQL for the desired sources. Our solution aims to address those challenges using Amazon Bedrock and AWS Analytics Services.

SQL 142

SQL AWS Database ML 142

AWS Machine Learning Blog

DECEMBER 20, 2023

Whether logs are coming from Amazon Web Services (AWS), other cloud providers, on-premises, or edge devices, customers need to centralize and standardize security data. Solution overview Figure 1 – Solution Architecture Enable Amazon Security Lake with AWS Organizations for AWS accounts, AWS Regions, and external IT environments.

AWS 137

AWS ML ML Algorithm 137

AWS Machine Learning Blog

NOVEMBER 9, 2023

Building out a machine learning operations (MLOps) platform in the rapidly evolving landscape of artificial intelligence (AI) and machine learning (ML) for organizations is essential for seamlessly bridging the gap between data science experimentation and deployment while meeting the requirements around model performance, security, and compliance.

AWS 128

AWS ML ML Machine Learning 128

AWS Machine Learning Blog

AUGUST 2, 2024

This is a guest post co-written with Vicente Cruz Mínguez, Head of Data and Advanced Analytics at Cepsa Química, and Marcos Fernández Díaz, Senior Data Scientist at Keepler. Generative artificial intelligence (AI) is rapidly emerging as a transformative force, poised to disrupt and reshape businesses of all sizes and across industries.

AWS 132

AWS Machine Learning Machine Learning Database 132

AWS Machine Learning Blog

MAY 30, 2024

With Bedrock’s serverless experience, one can get started quickly, privately customize FMs with their own data, and easily integrate and deploy them into applications using the AWS tools without having to manage any infrastructure. Ameer Hakme is an AWS Solutions Architect based in Pennsylvania.

AI 135

AI AI AWS Database 135

AWS Machine Learning Blog

JUNE 20, 2024

Our goal was to improve the user experience of an existing application used to explore the counters and insights data. The data is stored in a data lake and retrieved by SQL using Amazon Athena. Eitan Sela is a Generative AI and Machine Learning Specialist Solutions Architect at AWS.

SQL 121

SQL Database AWS Machine Learning 121

IBM Journey to AI blog

JULY 15, 2024

Explore VMware Modernization Assessment In this blog, we will share how IBM Consulting can help organizations with a preference for AWS-based cloud-native technologies, leveraging the contemporary tools and modern cloud services that AWS has to offer.

AWS 45

AWS AI AI Data Lakes 45