Dataconomy

FEBRUARY 23, 2023

Data engineers play a crucial role in managing and processing big data. They are responsible for designing, building, and maintaining the infrastructure and tools needed to manage and process large volumes of data effectively. What is data engineering?

Big Data 91

Big Data Big Data Data Engineering Data Engineer 91

Alation

APRIL 18, 2023

For any data user in an enterprise today, data profiling is a key tool for resolving data quality issues and building new data solutions. In this blog, we’ll cover the definition of data profiling, top use cases, and share important techniques and best practices for data profiling today.

Data Profiling 52

Data Profiling Data Quality Data Governance Data Pipeline 52

The MLOps Blog

MAY 17, 2023

This article explores the importance of ETL pipelines in machine learning, a hands-on example of building ETL pipelines with a popular tool, and suggests the best ways for data engineers to enhance and sustain their pipelines. What is an ETL data pipeline in ML?

ETL 59

ETL Data Pipeline ML ML 59

The MLOps Blog

JUNE 27, 2023

Alignment to other tools in the organization’s tech stack Consider how well the MLOps tool integrates with your existing tools and workflows, such as data sources, data engineering platforms, code repositories, CI/CD pipelines, monitoring systems, etc. For example, neptune.ai

Machine Learning 134

Machine Learning Machine Learning ML ML 134

Alation

DECEMBER 7, 2021

Data teams use Bigeye’s data observability platform to detect data quality issues and ensure reliable data pipelines. If there is an issue with the data or data pipeline, the data team is immediately alerted, enabling them to proactively address the issue.

Data Quality 52

Data Quality Data Pipeline Data Observability Data Profiling 52

Pickl AI

OCTOBER 11, 2023

What is Data Observability? It is the practice of monitoring, tracking, and ensuring data quality, reliability, and performance as it moves through an organization’s data pipelines and systems. Data quality tools help maintain high data quality standards. Tools Used in Data Observability?

Data Observability 52

Data Observability Data Quality Data Pipeline Data Governance 52

IBM Journey to AI blog

JANUARY 5, 2023

The first generation of data architectures represented by enterprise data warehouse and business intelligence platforms were characterized by thousands of ETL jobs, tables, and reports that only a small group of specialized data engineers understood, resulting in an under-realized positive impact on the business.

Data Quality 52

Data Quality Data Lakes Data Warehouse Big Data 52