IBM Journey to AI blog

MARCH 29, 2024

GraphQL is defined by API schema written in the GraphQL schema definition language. Each schema specifies the types of data the user can query or modify, and the relationships between the types. GraphQL GraphQL is a query language and API runtime that Facebook developed internally in 2012 before it became open source in 2015.

Data Profiling 104

Data Profiling Database Data Modeling Data Models 104

phData

AUGUST 17, 2023

These logs can be used for compliance reporting, audit purposes, or investigation of data-related issues. Version Control and Deployment Many tools facilitate version control and deployment of data pipelines. Include tasks to ensure data integrity, accuracy, and consistency.

Data Engineering 52

Data Engineering Data Engineer Data Engineering Data Engineering 52

Precisely

JUNE 26, 2023

As organizations embark on data quality improvement initiatives, they need to develop a clear definition of the metrics and standards suited to their specific needs and objectives.

Data Quality 52

Data Quality Data Silos Data Governance Artificial Intelligence 52

Alation

MAY 24, 2022

Prime examples of this in the data catalog include: Trust Flags — Allow the data community to endorse, warn, and deprecate data to signal whether data can or can’t be used. Data Profiling — Statistics such as min, max, mean, and null can be applied to certain columns to understand its shape.

Data Quality 98

Data Quality Data Governance ETL Data Observability 98

AWS Machine Learning Blog

APRIL 18, 2023

The sample set of de-identified, already publicly shared data included thousands of anonymized user profiles, with more than fifty user-metadata points, but many had inconsistent or missing meta-data/profile information. For the definitions of all available offline metrics, refer to Metric definitions.

AWS 83

AWS Machine Learning Machine Learning ML 83

Pickl AI

AUGUST 30, 2024

Summary: This article provides a comprehensive overview of data migration, including its definition, importance, processes, common challenges, and popular tools. By understanding these aspects, organisations can effectively manage data transfers and enhance their data management strategies for improved operational efficiency.

Data Quality 52

Data Quality Data Governance Azure Database 52

phData

JUNE 26, 2023

Data Source Tool Updates The data source tool has a number of use cases, as it has the ability to profile your data sources and take the resulting JSON to perform whatever action you want to take. SQL Translation Updates SQL Translation is another major component of the Toolkit CLI.

SQL 52

SQL Data Profiling Data Pipeline Data Governance 52

phData

SEPTEMBER 1, 2023

Data Quality Inaccurate data can have negative impacts on patient interactions or loss of productivity for the business. Sigma and Snowflake offer data profiling to identify inconsistencies, errors, and duplicates. Learn more about Sigma’s reusable data definition feature called Metrics 5.

Analytics 52

Analytics Analytics Data Analysis Data Analysis 52

Alation

AUGUST 26, 2021

And types of metadata — or data about data — abound. Some high-level metadata categories in a data catalog include: Behavioral : Records who is using data, and how they are using it. Technical: Shows schema or table definitions. Business: Policies on how to handle different kinds of data appropriately.

Data Governance 64

Data Governance ML ML Artificial Intelligence 64

Alation

JULY 6, 2021

These features add context to the data for effective “hands-free” governance. New business terms are auto-added to glossaries, aligning teams on shared definitions. Automated governance tracks data lineage so users can see data’s origin and transformation. For example, how old is too old?

Data Governance 52

Data Governance Data Quality Data Silos Data Profiling 52