Smart Data Collective

OCTOBER 17, 2022

Data pipelines automatically fetch information from various disparate sources for further consolidation and transformation into high-performing data storage. There are a number of challenges in data storage , which data pipelines can help address. Choosing the right data pipeline solution.

Data Pipeline 130

Data Pipeline Data Warehouse ETL Exploratory Data Analysis 130

DagsHub

AUGUST 23, 2024

When bad data is inputted, it inevitably leads to poor outcomes. A coding error impacted credit scoring In 2022, Equifax - a major credit bureau - reported inaccurate credit scores for millions of consumers. In 2022, the company ingested bad data from one of its major customers.

Data Quality 52

Data Quality Data Governance Machine Learning Machine Learning 52

Snorkel AI

JULY 3, 2023

Jason Goldfarb, senior data scientist at State Farm , gave a presentation entitled “Reusable Data Cleaning Pipelines in Python” at Snorkel AI’s Future of Data-Centric AI virtual conference in August 2022. It has always amazed me how much time the data cleaning portion of my job takes to complete.

Exploratory Data Analysis 52

Exploratory Data Analysis Data Pipeline Machine Learning Machine Learning 52

Snorkel AI

JULY 3, 2023

Jason Goldfarb, senior data scientist at State Farm , gave a presentation entitled “Reusable Data Cleaning Pipelines in Python” at Snorkel AI’s Future of Data-Centric AI virtual conference in August 2022. It has always amazed me how much time the data cleaning portion of my job takes to complete.

Exploratory Data Analysis 52

Exploratory Data Analysis Data Pipeline Data Scientist Machine Learning 52

Snorkel AI

JULY 3, 2023

Jason Goldfarb, senior data scientist at State Farm , gave a presentation entitled “Reusable Data Cleaning Pipelines in Python” at Snorkel AI’s Future of Data-Centric AI virtual conference in August 2022. It has always amazed me how much time the data cleaning portion of my job takes to complete.

Exploratory Data Analysis 52

Exploratory Data Analysis Data Pipeline Data Scientist Machine Learning 52

Alation

JULY 7, 2022

Once data is found and cleaned, data scientists and analysts still need to understand the methods by which the data was collected, the limitations on proper use, and any other contextual information that may impact the insights derived from a particular data set. Another limiting factor is that of context.

Data Scientist 52

Data Scientist Data Analyst Analytics Analytics 52

Snorkel AI

MAY 12, 2023

Three experts from Capital One ’s data science team spoke as a panel at our Future of Data-Centric AI conference in 2022. To borrow another example from Andrew Ng, improving the quality of data can have a tremendous impact on model performance. This is to say that clean data can better teach our models.

Machine Learning 52

Machine Learning Machine Learning ML ML 52