Dataversity

MAY 26, 2022

A data lake becomes a data swamp in the absence of comprehensive data quality validation and does not offer a clear link to value creation. Organizations are rapidly adopting the cloud data lake as the data lake of choice, and the need for validating data in real time has become critical.

Data Lakes 52

Data Lakes Machine Learning Machine Learning Data Quality 52

Data Science Blog

JUNE 27, 2023

The batch views within the Lambda architecture allow for the application of more complex or resource-intensive rules, resulting in superior data quality and reduced bias over time. On the other hand, the real-time views provide immediate access to the most current data. The post Big Data – Lambda or Kappa Architecture?

Big Data 130

Big Data Big Data Apache Kafka Database 130

Alation

OCTOBER 5, 2021

It’s on Data Governance Leaders to identify the issues with the business process that causes users to act in these ways. Inconsistencies in expectations can create enormous negative issues regarding data quality and governance. Establish a data governance program that drives business value by aligning team roles to KPIs.

Data Governance 96

Data Governance Data Quality Data Silos Analytics 96

Alation

SEPTEMBER 7, 2021

This is the last of the 4-part blog series. In the previous blog , we discussed how Alation provides a platform for data scientists and analysts to complete projects and analysis at speed. In this blog we will discuss how Alation helps minimize risk with active data governance. Find Trusted Data.

Data Governance 59

Data Governance Data Scientist Data Quality Data Profiling 59

Alation

AUGUST 30, 2022

These range from data sources , including SaaS applications like Salesforce; ELT like Fivetran; cloud data warehouses like Snowflake; and data science and BI tools like Tableau. This expansive map of tools constitutes today’s modern data stack. Read Q&A blog with Raj. Subscribe to Alation's Blog.

Data Governance 52

Data Governance Data Quality Tableau Data Analyst 52

Alation

AUGUST 16, 2022

This week, IDC released its second IDC MarketScape for Data Catalogs report, and we’re excited to share that Alation was recognized as a leader for the second consecutive time. And with our Open Connector Framework , customers and partners can easily build connectors to even more data sources. Subscribe to Alation's Blog.

Data Quality 52

Data Quality Data Governance Cloud Data Data Engineering 52

AWS Machine Learning Blog

DECEMBER 1, 2023

Choose Amazon S3 as the data source and connect it to the dataset. After the dataset is loaded, create a data flow using that dataset. Switch to the analyses tab and create a Data Quality and Insights Report. This is a recommended step to analyze the quality of the input dataset.

Machine Learning 123

Machine Learning Machine Learning Data Preparation ML 123

IBM Journey to AI blog

MAY 15, 2024

Organizations require reliable data for robust AI models and accurate insights, yet the current technology landscape presents unparalleled data quality challenges. As a result, users boost pipeline performance while ensuring data security and controls. However, businesses scaling AI face entry barriers.

Data Pipeline 85

Data Pipeline ETL SQL Database 85

phData

FEBRUARY 5, 2024

In this blog, we’re going to answer these questions and more. Walking you through the biggest challenges we have found when migrating our customer’s data from a legacy system to Snowflake. You’re in luck because this blog is for anyone ready to move or thinking about moving to Snowflake who wants to know what’s in store for them.

SQL 52

SQL Database Data Quality Data Warehouse 52

phData

NOVEMBER 1, 2024

In an effort to better understand where data governance is heading, we spoke with top executives from IT, healthcare, and finance to hear their thoughts on the biggest trends, key challenges, and what insights they would recommend. This blog is a collection of those insights, but for the full trendbook, we recommend downloading the PDF.

Data Governance 52

Data Governance Data Quality ML ML 52

Alation

OCTOBER 18, 2022

Alation is pleased to be named a dbt Metrics Partner and to announce the start of a partnership with dbt, which will bring dbt data into the Alation data catalog. In the modern data stack, dbt is a key tool to make data ready for analysis. Subscribe to Alation's Blog. We’re looking forward to great things to come!

Data Analyst 52

Data Analyst Data Engineer Data Engineering Data Engineering 52

Alation

MARCH 28, 2023

Central to this is a culture where decisions are made based solely on data, rather than gut feel, seniority, or consensus. Introduced in late 2021 by the EDM Council, The Cloud Data Management Framework ( CDMC ), sets out best practices and capabilities for data management challenges in the cloud.

Data Silos 52

Data Silos Cloud Data Data Quality Data Governance 52

Alation

NOVEMBER 30, 2022

Alation is the leading platform for data intelligence , delivering critical context about data to empower smarter use; to this end, it centralizes technical, operational, business, and behavioral metadata from a broad variety of sources. With this context, Tableau users can assess reports to determine their quality and trustworthiness.

Tableau 52

Tableau SQL Database Data Analyst 52

Dataversity

FEBRUARY 25, 2022

Welcome to the Dear Laura blog series! As I’ve been working to challenge the status quo on Data Governance – I get a lot of questions about how it will “really” work. In 2019, I wrote the book “Disrupting Data Governance” because I firmly believe that […].

Data Governance 52

Data Governance Data Quality Cloud Data Analytics 52

phData

JANUARY 24, 2024

Whether making well-informed investment choices or ensuring adherence to regulations, having access to timely, precise, and secure data can be a game-changer. And that’s where Fivetran comes in – the data connector solution changing how financial services organizations manage their data.

Data Warehouse 52

Data Warehouse Data Pipeline Data Governance Cloud Data 52

Alation

DECEMBER 15, 2022

March 2015: Alation emerges from stealth mode to launch the first official data catalog to empower people in enterprises to easily find, understand, govern and use data for informed decision making that supports the business. May 2016: Alation named a Gartner Cool Vendor in their Data Integration and Data Quality, 2016 report.

Data Governance 52

Data Governance Data Quality Data Warehouse Data Scientist 52

phData

SEPTEMBER 20, 2023

It’s all about breaking down data silos, empowering domain teams to take ownership of their data, and fostering a culture of data collaboration. And when it comes to implementing a data mesh, one platform has been making waves in the data world: the Snowflake Data Cloud.

Data Silos 52

Data Silos Database Data Quality Data Engineering 52

AWS Machine Learning Blog

NOVEMBER 16, 2023

This is a joint blog with AWS and Philips. Data Management – Efficient data management is crucial for AI/ML platforms. Regulations in the healthcare industry call for especially rigorous data governance. Philips is a health technology company focused on improving people’s lives through meaningful innovation.

ML 125

ML ML AWS AI 125

AWS Machine Learning Blog

AUGUST 4, 2023

In the data flow view, you can now see a new node added to the visual graph. For more information on how you can use SageMaker Data Wrangler to create Data Quality and Insights Reports, refer to Get Insights On Data and Data Quality. SageMaker Data Wrangler offers over 300 built-in transformations.

ML 96

ML ML AWS AI 96

phData

JULY 23, 2024

In this blog, we’ll explain how data can be used to make informed decisions to healthcare-related questions like these, why phData should be your choice to take you through your data journey, and an example of how phData has helped a healthcare company like yours. How can we improve clinical diagnoses?

Machine Learning 52

Machine Learning Machine Learning Data Engineer Data Engineering 52

Alation

AUGUST 11, 2022

And now with some of these cloud data warehouses becoming such behemoths, everything is getting centralized again. So we have to be very careful about giving the domains the right and authority to fix data quality. Let’s take data privacy as an example. Subscribe to Alation's Blog.

Data Warehouse 52

Data Warehouse Data Engineer Data Engineering Data Engineering 52

phData

OCTOBER 12, 2022

Upon a quick trial and look at dbt Cloud, the primary things you might notice are the IDE as well as the ease of managing deployments. However, dbt Cloud offers you much more than that. In this blog post, we’ll dive into six of the most powerful dbt Cloud features and many others that you probably don’t know about.

SQL 52

SQL Data Warehouse Data Visualization Cloud Data 52

Alation

MARCH 22, 2022

As the latest iteration in this pursuit of high-quality data sharing, DataOps combines a range of disciplines. It synthesizes all we’ve learned about agile, data quality , and ETL/ELT. With Accenture, teams can avoid the costly investment of integrating a broad array of cloud services.

DataOps 52

DataOps Data Pipeline Data Engineer Data Engineering 52

phData

OCTOBER 11, 2024

If any of the AI applications covered in this blog interest you, phData can help your business implement them. phData helps with the entire data and analytics lifecycle – from strategy to implementation – so you can make sense of your data and use it to solve complex business problems.

AI 52

AI AI Data Pipeline ML 52

Dataversity

MARCH 22, 2021

This announcement is interesting and causes some of us in the tech industry to step back and consider many of the factors involved in providing data technology […]. The post Where Is the Data Technology Industry Headed? Click here to learn more about Heine Krog Iversen.

Data Lakes 98

Data Lakes Data Warehouse Data Quality Data Models 98

Dataversity

SEPTEMBER 20, 2021

Click to learn more about author Balaji Ganesan. Sources indicate 40% more Americans will travel in 2021 than those in 2020, meaning travel companies will collect an enormous amount of personally identifiable information (PII) from passengers engaging in “revenge” travel.

Data Governance 98

Data Governance Data Quality Cloud Data 98

Dataversity

AUGUST 7, 2023

In the era of digital transformation, data has become the new oil. Businesses increasingly rely on real-time data to make informed decisions, improve customer experiences, and gain a competitive edge. However, managing and handling real-time data can be challenging due to its volume, velocity, and variety.

Data Silos 98

Data Silos Data Quality Cloud Data Analytics 98

Dataversity

JUNE 14, 2022

Online security has always been an area of concern; however, with recent global events, the world we now live in has become increasingly cloud-centric. With that, I’ve long believed that for most large cloud platform providers offering managed services, such as document editing and storage, email services and calendar […].

Data Governance 98

Data Governance Data Quality Cloud Data Artificial Intelligence 98

Dataversity

APRIL 8, 2022

While the mounting cost of raw materials may not be the culprit, enterprises are simultaneously watching the cost of data starting to rise as well. The post The Rise of Enterprise Data Inflation appeared first on DATAVERSITY. Inflation is on everyone’s minds, with consumer prices soaring by 7.9% What do I […].

Data Governance 98

Data Governance Data Quality Cloud Data 98

Dataversity

SEPTEMBER 24, 2021

We have seen an unprecedented increase in modern data warehouse solutions among enterprises in recent years. Experts believe that this trend will continue: The global data warehousing market is projected to reach $51.18 The reason is pretty obvious – businesses want to leverage the power of data […]. billion by 2028.

Data Warehouse 97

Data Warehouse Data Quality Data Governance Cloud Data 97

Dataversity

JANUARY 3, 2022

Data cleaning (or data cleansing) is the process of checking your data for correctness, validity, and consistency and fixing it when necessary. No matter what type of data you are handling, its quality is crucial. What are the specifics of data […].

Clean Data 90

Clean Data Data Quality Data Governance Cloud Data 90

Alation

JANUARY 25, 2022

Data fabric is now on the minds of most data management leaders. In our previous blog, Data Mesh vs. Data Fabric: A Love Story , we defined data fabric and outlined its uses and motivations. The data catalog is a foundational layer of the data fabric. Spoiler alert!

DataOps 52

DataOps SQL ML ML 52

phData

JULY 19, 2023

Are you tired of spending hours manually extracting, transforming, and loading data into your business systems? In this blog post, we’ll dive into the amazing advantages of using Fivetran , a powerful data integration platform that will revolutionize the way you handle your data pipelines. Look no further!

Data Warehouse 52

Data Warehouse Database Data Pipeline SQL 52

phData

JULY 19, 2023

Are you tired of spending hours manually extracting, transforming, and loading data into your business systems? In this blog post, we’ll dive into the amazing advantages of using Fivetran , a powerful data integration platform that will revolutionize the way you handle your data pipelines. Look no further!

Data Warehouse 52

Data Warehouse Database Data Pipeline SQL 52

Alation

AUGUST 11, 2021

The catalog played a key role in their Data Cloud migration strategy: ensuring that data governance was active and that the business was on board. To do this, Anthony and his team partnered with their business leaders to create a program called Cloud Data Stewardship. Subscribe to Alation's Blog.

Data Governance 52

Data Governance Data Warehouse Data Classification Cloud Data 52

Dataversity

MAY 3, 2021

The data value chain goes all the way from data capture and collection to reporting and sharing of information and actionable insights. As data doesn’t differentiate between industries, different sectors go through the same stages to gain value from it. Click to learn more about author Helena Schwenk.

Data Preparation 78

Data Preparation Data Quality Data Governance Cloud Data 78

phData

MAY 6, 2024

Whether you’re building a team for master data management (MDM), implementing a composable customer data platform (CDP), or just having challenges identifying the unique customers for your analytical use cases—understanding the fundamentals of identity resolution will guide you in making the best decision possible for your organization.

Data Lakes 52

Data Lakes Data Warehouse SQL Cloud Data 52