Iguazio

FEBRUARY 17, 2024

Global Financial Data (GDF) An extensive database of current and historical financial data, providing updated information alongside data from hundreds of years ago. The database covers topics like market indicators, exchange rates, commodities, incomes and more. Get the datasets here 4. Get the datasets here 7.

Machine Learning 40

Machine Learning Machine Learning ML ML 40

The MLOps Blog

MARCH 15, 2023

This is a difficult decision at the onset, as the volume of data is a factor of time and keeps varying with time, but an initial estimate can be quickly gauged by analyzing this aspect by running a pilot. Also, the industry best practices suggest performing a quick data profiling to understand the data growth.

Data Pipeline 59

Data Pipeline ETL SQL Data Quality 59

The MLOps Blog

JUNE 27, 2023

It integrates with Git and provides a Git-like interface for data versioning, allowing you to track changes, manage branches, and collaborate with data teams effectively. Dolt Dolt is an open-source relational database system built on Git. Metaplane supports collaboration, anomaly detection, and data quality rule management.

Machine Learning 134

Machine Learning Machine Learning ML ML 134

Alation

MAY 24, 2022

Prime examples of this in the data catalog include: Trust Flags — Allow the data community to endorse, warn, and deprecate data to signal whether data can or can’t be used. Data Profiling — Statistics such as min, max, mean, and null can be applied to certain columns to understand its shape.

Data Quality 98

Data Quality Data Governance ETL Data Observability 98

The MLOps Blog

MAY 17, 2023

Each subsystem is essential, and sequentially, each sub-system feeds into the next until data reaches its destination. ETL data pipeline architecture | Source: Author Data Discovery: Data can be sourced from various types of systems, such as databases, file systems, APIs, or streaming sources.

ETL 59

ETL Data Pipeline ML ML 59