IBM Journey to AI blog

JANUARY 18, 2023

Data platform architecture has an interesting history. Towards the turn of millennium, enterprises started to realize that the reporting and business intelligence workload required a new solution rather than the transactional applications. A read-optimized platform that can integrate data from multiple applications emerged.

Data Lakes 52

Data Lakes Data Warehouse Azure Apache Hadoop 52

AWS Machine Learning Blog

NOVEMBER 15, 2023

After a few minutes, a transcript is produced with Amazon Transcribe Call Analytics and saved to another S3 bucket for processing by other business intelligence (BI) tools. PCA’s security features ensure that any PII data was redacted from the transcript, as well as from the audio file itself.

AWS 117

AWS Analytics Analytics ML 117

AWS Machine Learning Blog

APRIL 12, 2023

The PdMS includes AWS services to securely manage the lifecycle of edge compute devices and BHS assets, cloud data ingestion, storage, machine learning (ML) inference models, and business logic to power proactive equipment maintenance in the cloud. It’s an easy way to run analytics on IoT data to gain accurate insights.

AWS 107

AWS ML ML Machine Learning 107

AWS Machine Learning Blog

JUNE 25, 2024

To create and share customer feedback analysis without the need to manage underlying infrastructure, Amazon QuickSight provides a straightforward way to build visualizations, perform one-time analysis, and quickly gain business insights from customer feedback, anytime and on any device. The Step Functions workflow starts.

AWS 125

AWS Natural Language Processing Machine Learning Machine Learning 125

IBM Journey to AI blog

OCTOBER 16, 2023

It includes processes that trace and document the origin of data, models and associated metadata and pipelines for audits. An AI governance framework ensures the ethical, responsible and transparent use of AI and machine learning (ML). The development and use of these models explain the enormous amount of recent AI breakthroughs.

AI 88

AI AI Data Warehouse ML 88

The MLOps Blog

MARCH 21, 2023

From gathering and processing data to building models through experiments, deploying the best ones, and managing them at scale for continuous value in production—it’s a lot. As the number of ML-powered apps and services grows, it gets overwhelming for data scientists and ML engineers to build and deploy models at scale.

Machine Learning 69

Machine Learning Machine Learning Data Scientist ML 69

IBM Journey to AI blog

MARCH 14, 2024

.   Request a live demo or start a proof of concept with Amazon RDS for Db2 Db2 Warehouse SaaS on AWS The cloud-native Db2 Warehouse fulfills your price and performance objectives for mission-critical operational analytics, business intelligence (BI) and mixed workloads.

AWS 93

AWS Database ETL AI 93

Alation

APRIL 14, 2022

And, as organizations progress and grow, “data drift” starts to impact data usage, models, and your business. In today’s AI/ML-driven world of data analytics, explainability needs a repository just as much as those doing the explaining need access to metadata, EG, information about the data being used.

Data Governance 59

Data Governance ML ML Cloud Data 59

DagsHub

NOVEMBER 11, 2024

We use data-specific preprocessing and ML algorithms suited to each modality to filter out noise and inconsistencies in unstructured data. NLP cleans and refines content for text data, while audio data benefits from signal processing to remove background noise. Tools like Unstructured.io

AI 52

AI AI Data Lakes Database 52

Mlearning.ai

FEBRUARY 16, 2023

Today, companies are facing a continual need to store tremendous volumes of data. The demand for information repositories enabling business intelligence and analytics is growing exponentially, giving birth to cloud solutions. Data warehousing is a vital constituent of any business intelligence operation.

Data Warehouse 52

Data Warehouse Business Intelligence Business Intelligence Database 52

IBM Journey to AI blog

JULY 17, 2023

is our enterprise-ready next-generation studio for AI builders, bringing together traditional machine learning (ML) and new generative AI capabilities powered by foundation models. With watsonx.ai, businesses can effectively train, validate, tune and deploy AI models with confidence and at scale across their enterprise. IBM watsonx.ai

AI 74

AI AI Machine Learning Machine Learning 74

IBM Journey to AI blog

FEBRUARY 2, 2023

In today’s world, data warehouses are a critical component of any organization’s technology ecosystem. They provide the backbone for a range of use cases such as business intelligence (BI) reporting, dashboarding, and machine-learning (ML)-based predictive analytics, that enable faster decision making and insights.

Data Warehouse 58

Data Warehouse Cloud Data Analytics Analytics 58

IBM Journey to AI blog

JULY 3, 2024

With an open data lakehouse architecture, you can now optimize your data warehouse workloads for price performance and modernize traditional data lakes with better performance and governance for AI. With the right data, you can create a data-driven organization that drives business value and innovation.

AI 45

AI AI Data Quality Database 45

Alation

SEPTEMBER 23, 2021

What Is a Data Catalog? A data catalog is a centralized storage bank of metadata on information sources from across the enterprise, such as: Datasets. Business intelligence reports. The data catalog also stores metadata (data about data, like a conversation), which gives users context on how to use each asset.

Data Preparation 52

Data Preparation SQL Data Governance Data Analysis 52

IBM Journey to AI blog

APRIL 25, 2023

In a prior blog , we pointed out that warehouses, known for high-performance data processing for business intelligence, can quickly become expensive for new data and evolving workloads. To effectively use raw data, it often needs to be curated within a data warehouse. Some use case examples will help.

Data Warehouse 58

Data Warehouse Data Engineering Data Engineering Data Engineering 58

IBM Journey to AI blog

DECEMBER 16, 2022

For example, data catalogs have evolved to deliver governance capabilities like managing data quality and data privacy and compliance. It uses metadata and data management tools to organize all data assets within your organization.

Data Quality 52

Data Quality Data Governance Data Scientist Data Wrangling 52

Alation

MARCH 21, 2023

Having been in business for over 50 years, ARC had accumulated a massive amount of data that was stored in siloed, on-premises servers across its 7 business domains. Using Alation, ARC automated the data curation and cataloging process. “So

Analytics 52

Analytics Analytics Data Silos Big Data 52

AWS Machine Learning Blog

NOVEMBER 14, 2024

By setting up automated policy enforcement and checks, you can achieve cost optimization across your machine learning (ML) environment. The following table provides examples of a tagging dictionary used for tagging ML resources. A reference architecture for the ML platform with various AWS services is shown in the following diagram.

ML 107

ML ML AWS Machine Learning 107

AWS Machine Learning Blog

DECEMBER 3, 2024

Although generative AI is fueling transformative innovations, enterprises may still experience sharply divided data silos when it comes to enterprise knowledge, in particular between unstructured content (such as PDFs, Word documents, and HTML pages), and structured data (real-time data and reports stored in databases or data lakes).

AWS 97

AWS Database Data Silos Data Lakes 97

Flipboard

MAY 9, 2025

This pattern creates a comprehensive solution that transforms raw social media data into actionable business intelligence (BI) through advanced AI capabilities. 3B Instruct Amazon Bedrock, the system provides tailored marketing content that adds business value. By integrating LLMs such as Anthropics Claude 3.5

AWS 98

AWS Natural Language Processing AI AI 98

Pickl AI

FEBRUARY 23, 2025

Microsoft Azure HDInsight Azure HDInsight is a fully-managed cloud service that makes it easy to process Big Data using popular open-source frameworks such as Hadoop, Spark, and Kafka. Key Features : Integration with Microsoft Services : Seamlessly integrates with other Azure services like Azure Data Lake Storage.

Big Data 52

Big Data Big Data Apache Hadoop Apache Kafka 52