Alation

APRIL 18, 2023

For any data user in an enterprise today, data profiling is a key tool for resolving data quality issues and building new data solutions. In this blog, we’ll cover the definition of data profiling, top use cases, and share important techniques and best practices for data profiling today.

Data Profiling 52

Data Profiling Data Quality Data Governance Data Pipeline 52

The MLOps Blog

MAY 17, 2023

We also discuss different types of ETL pipelines for ML use cases and provide real-world examples of their use to help data engineers choose the right one. What is an ETL data pipeline in ML? Xoriant It is common to use ETL data pipeline and data pipeline interchangeably.

ETL 59

ETL Data Pipeline ML ML 59

ODSC - Open Data Science

FEBRUARY 24, 2023

Great Expectations provides support for different data backends such as flat file formats, SQL databases, Pandas dataframes and Sparks, and comes with built-in notification and data documentation functionality. You can watch it on demand here.

Exploratory Data Analysis 126

Exploratory Data Analysis Data Visualization Data Analysis Data Analysis 126

The MLOps Blog

JUNE 27, 2023

LakeFS LakeFS is an open-source platform that provides data lake versioning and management capabilities. It sits between the data lake and cloud object storage, allowing you to version and control changes to data lakes at scale.

Machine Learning 134

Machine Learning Machine Learning ML ML 134

The MLOps Blog

MARCH 15, 2023

In this post, you will learn about the 10 best data pipeline tools, their pros, cons, and pricing. A typical data pipeline involves the following steps or processes through which the data passes before being consumed by a downstream process, such as an ML model training process.

Data Pipeline 59

Data Pipeline ETL SQL Data Quality 59

Precisely

SEPTEMBER 9, 2024

. • 41% of respondents say their data quality strategy supports structured data only, even though they use all kinds of data • Only 16% have a strategy encompassing all types of relevant data 3. Enterprises have only begun to automate their data quality management processes.” Invest in training and culture.

Data Quality 64

Data Quality Data Profiling Data Lakes Analytics 64

IBM Journey to AI blog

JANUARY 5, 2023

The first generation of data architectures represented by enterprise data warehouse and business intelligence platforms were characterized by thousands of ETL jobs, tables, and reports that only a small group of specialized data engineers understood, resulting in an under-realized positive impact on the business.

Data Quality 52

Data Quality Data Lakes Data Warehouse Business Intelligence 52