Dataversity

JANUARY 28, 2021

It has been ten years since Pentaho Chief Technology Officer James Dixon coined the term “data lake.” While data warehouse (DWH) systems have had longer existence and recognition, the data industry has embraced the more […]. The post A Bridge Between Data Lakes and Data Warehouses appeared first on DATAVERSITY.

Data Lakes 59

Data Lakes Data Warehouse Data Quality Data Governance 59

Data Science Blog

MAY 15, 2023

tl;dr Ein Data Lakehouse ist eine moderne Datenarchitektur, die die Vorteile eines Data Lake und eines Data Warehouse kombiniert. Organisationen können je nach ihren spezifischen Bedürfnissen und Anforderungen zwischen einem Data Warehouse und einem Data Lakehouse wählen.

Data Warehouse 147

Data Warehouse Data Lakes Azure AWS 147

Dataversity

DECEMBER 11, 2023

Organizations learned a valuable lesson in 2023: It isn’t sufficient to rely on securing data once it has landed in a cloud data warehouse or analytical store. As a result, data owners are highly motivated to explore technologies in 2024 that can protect data from the moment it begins its journey in the source systems.

Data Governance 111

Data Governance Data Warehouse Cloud Data Analytics 111

phData

JULY 17, 2023

Over the past few decades, the corporate data landscape has changed significantly. The shift from on-premise databases and spreadsheets to the modern era of cloud data warehouses and AI/ LLMs has transformed what businesses can do with data. Designed to cheaply and efficiently process large quantities of data.

Data Warehouse 52

Data Warehouse Data Pipeline Cloud Data ETL 52

phData

JUNE 6, 2024

Marketing and business professionals must effectively manage and leverage their customer data to stay competitive. In this blog, we will explore how marketing professionals have approached the challenge of effectively using their vast amount of customer data using Composable CDPs. Why use Fivetran for Composable CDP?

Data Warehouse 52

Data Warehouse Cloud Data ETL Data Models 52

Dataversity

MARCH 2, 2022

Without effective and comprehensive validation, a data warehouse becomes a data swamp. With the accelerating adoption of Snowflake as the cloud data warehouse of choice, the need for autonomously validating data has become critical.

Data Quality 52

Data Quality Data Warehouse Cloud Data Data Governance 52

phData

AUGUST 9, 2023

If you’ve been watching how Snowflake Data Cloud has been growing and changing over the years, you’ll see that two tools have made very large impacts on the Modern Data Stack: Fivetran and dbt. This is unlike the more traditional ETL method, where data is transformed before loading into the data warehouse.

ETL 52

ETL Data Warehouse Cloud Data Big Data 52

phData

SEPTEMBER 2, 2024

In this blog, we will cover the best practices for developing jobs in Matillion, an ETL/ELT tool built specifically for cloud database platforms. The blog will be divided into three broad sections: Design, SDLC, and Security, each with its best practices. What Are Matillion Jobs and Why Do They Matter?

ETL 52

ETL Data Warehouse SQL Database 52

Dataversity

NOVEMBER 29, 2021

There’s been a lot of talk about the modern data stack recently. Much of this focus is placed on the innovations around the movement, transformation, and governance of data as it relates to the shift from on-premise to cloud data warehouse-centric architectures.

Analytics 52

Analytics Analytics Data Warehouse Cloud Data 52

phData

APRIL 29, 2024

In our previous blog, Top 5 Fivetran Connectors for Financial Services , we explored Fivetran’s capabilities that address the data integration needs of the finance industry. Now, let’s cover the healthcare industry, which also has a surging demand for data and analytics, along with the underlying processes to make it happen.

SQL 52

SQL Data Warehouse Azure Cloud Data 52

Alation

JANUARY 17, 2023

The modern data stack is a combination of various software tools used to collect, process, and store data on a well-integrated cloud-based data platform. It is known to have benefits in handling data due to its robustness, speed, and scalability. Data ingestion/integration services. Data orchestration tools.

Data Warehouse 52

Data Warehouse ETL Tableau Cloud Data 52

IBM Journey to AI blog

JULY 24, 2024

Optimizing performance with fit-for-purpose query engines In the realm of data management, the diverse nature of data workloads demands a flexible approach to query processing. The integration with established data warehouse engines ensures compatibility with existing systems and workflows.

Data Governance 79

Data Governance Data Warehouse AI AI 79

Data Science Blog

SEPTEMBER 3, 2024

Prinzipielle Architektur-Darstellung eines Data Lakehouse Systems unter Einsatz von Databricks auf der Goolge / Amazon / Microsoft Azure Cloud nach dem Data Mesh Konzept zur Bereitstellung von Data Products für Process Mining, BI und Data Science Applikationen. appeared first on Data Science Blog.

Data Science 130

Data Science Power BI Azure Data Warehouse 130

IBM Journey to AI blog

MAY 9, 2023

Watsonx.data will allow users to access their data through a single point of entry and run multiple fit-for-purpose query engines across IT environments. Through workload optimization an organization can reduce data warehouse costs by up to 50 percent by augmenting with this solution. [1]

Data Warehouse 98

Data Warehouse AWS AI AI 98

IBM Journey to AI blog

JULY 11, 2023

Data warehouses are a critical component of any organization’s technology ecosystem. The next generation of IBM Db2 Warehouse brings a host of new capabilities that add cloud object storage support with advanced caching to deliver 4x faster query performance than previously, while cutting storage costs by 34x 1.

Data Warehouse 72

Data Warehouse Database Cloud Data Business Intelligence 72

phData

MARCH 8, 2023

Fivetran, a cloud-based automated data integration platform, has emerged as a leading choice among businesses looking for an easy and cost-effective way to unify their data from various sources. Fivetran is used by businesses to centralize data from various sources into a single, comprehensive data warehouse.

Data Warehouse 96

Data Warehouse Data Engineer Data Engineering Data Engineering 96

IBM Journey to AI blog

MAY 9, 2023

With watsonx.data , businesses can quickly connect to data, get trusted insights and reduce data warehouse costs. A data store built on open lakehouse architecture, it runs both on premises and across multi-cloud environments. Savings may vary depending on configurations, workloads and vendors.

AI 111

AI AI Data Warehouse Machine Learning 111

Dataversity

FEBRUARY 7, 2022

Data paradigms are changing. The concept of a data warehouse as the only solution for integrating data sources should be questioned. This approach is increasingly at odds with the realities of how data is transacted and used in enterprises. Instead of a few data sources, there can be 20, 30, 40, even more.

Data Warehouse 52

Data Warehouse Database Cloud Data 52

phData

NOVEMBER 28, 2023

In this blog, we will show you how easy it is to get your Data Productivity Cloud environment up and running and how you can start your studies on the platform. What is Matillion Data Productivity Cloud? Now is the time to enjoy your new Data Productivity Cloud environment! No problem.

Data Warehouse 52

Data Warehouse Data Pipeline ETL Azure 52

Dataversity

AUGUST 5, 2021

According to Gartner, data fabric is an architecture and set of data services that provides consistent functionality across a variety of environments, from on-premises to the cloud. Data fabric simplifies and integrates on-premises and cloud Data Management by accelerating digital transformation.

Cloud Data 98

Cloud Data Data Silos Data Lakes Data Warehouse 98

phData

MARCH 11, 2024

This blog was co-written by Alex Roed, Luke Kline, Sam Hall, Alec Haase, and Christian Franklin. The depreciation of third-party cookies has only compounded this problem, leaving companies scrambling to figure out how to implement the systems needed to power growth with their first-party customer data. Modern marketing is changing.

Data Warehouse 52

Data Warehouse Cloud Data Data Modeling Data Models 52

phData

OCTOBER 12, 2023

This blog was co-written by Sam Hall and Dakota Kelley In our previous blog , we discussed some ways Fivetran and dbt solve ELT for enterprise data consumption and analytics. As your data organization grows, the scalability of your data platform matters. These allow you to scale your pipelines quickly.

Data Warehouse 52

Data Warehouse Database Cloud Data Data Pipeline 52

Alation

JULY 13, 2021

The Data Race to the Cloud. This recent cloud migration applies to all who use data. We have seen the COVID-19 pandemic accelerate the timetable of cloud data migration , as companies evolve from the traditional data warehouse to a data cloud, which can host a cloud computing environment.

Cloud Data 52

Cloud Data Data Governance Data Mining Data Mining 52

Alation

JULY 30, 2021

A part of that journey often involves moving fragmented on-premises data to a cloud data warehouse. You clearly shouldn’t move everything from your on-premises data warehouses. Otherwise, you can end up with a data swamp. Subscribe to Alation's Blog.

Data Warehouse 52

Data Warehouse Data Governance Cloud Data Machine Learning 52

Alation

APRIL 14, 2023

Last week, the Alation team had the privilege of joining IT professionals, business leaders, and data analysts and scientists for the Modern Data Stack Conference in San Francisco. Practitioners and hands-on data users were thrilled to be there, and many connected as they shared their progress on their own data stack journeys.

Data Pipeline 52

Data Pipeline Data Warehouse Cloud Data ETL 52

IBM Journey to AI blog

SEPTEMBER 11, 2023

Db2 Warehouse SaaS, on the other hand, is a fully managed elastic cloud data warehouse with our columnar technology. watsonx.data integration At Think, IBM announced watsonx.data as a new open, hybrid and governed data store optimized for all data, analytics, and AI workloads.

Database 105

Database SQL Data Warehouse Machine Learning 105

phData

OCTOBER 9, 2023

As organizations embrace the benefits of data vault, it becomes crucial to ensure optimal performance in the underlying data platform. One such platform that has revolutionized cloud data warehousing is the Snowflake Data Cloud. How do I build a data vault? This blog is an excellent place to start.

ETL 69

ETL Clustering Data Warehouse SQL 69

phData

NOVEMBER 8, 2024

Open Table Format (OTF) architecture now provides a solution for efficient data storage, management, and processing while ensuring compatibility across different platforms. In this blog, we will discuss: What is the Open Table format (OTF)? Delta Lake became popular for making data lakes more reliable and easy to manage.

Data Lakes 52

Data Lakes Data Warehouse Database Azure 52

phData

FEBRUARY 14, 2023

Data integration is essentially the Extract and Load portion of the Extract, Load, and Transform (ELT) process. Data ingestion involves connecting your data sources, including databases, flat files, streaming data, etc, to your data warehouse. Snowflake provides native ways for data ingestion.

Data Warehouse 59

Data Warehouse Azure AWS Database 59

phData

AUGUST 14, 2024

In this blog, we’ll explain a bit about Fivetran and Coalesce, what this integration does for you, and how to connect your accounts so you can start using it today. It provides businesses with an efficient way to move and centralize data from all their sources. What Is Fivetran and Coalesce?

Data Warehouse 52

Data Warehouse Data Pipeline SQL Cloud Data 52

phData

JANUARY 4, 2023

However, as technology has evolved, the need for more advanced, agile data warehousing solutions has become apparent. The Snowflake Data Cloud is a modern data warehouse that allows companies to take advantage of its cloud-based architecture to improve efficiencies while at the same time reducing costs.

Data Warehouse 52

Data Warehouse SQL Database ETL 52

phData

SEPTEMBER 27, 2024

In this blog, I’ll guide you through creating and sharing a Matillion job. We’ll leverage Matillion’s Data Productivity Cloud —designed for cloud data platforms like Snowflake, Databricks, and AWS Redshift—to build an example shared job. What is a Matillion Job? Name the Output Column to month_name.

Data Engineer 52

Data Engineer Data Engineering Data Engineering Data Engineering 52

Alation

MARCH 1, 2022

Lineage helps them identify the source of bad data to fix the problem fast. Manual lineage will give ARC a fuller picture of how data was created between AWS S3 data lake, Snowflake cloud data warehouse and Tableau (and how it can be fixed). Time is money,” said Leonard Kwok, Senior Data Analyst, ARC.

Data Warehouse 52

Data Warehouse Data Lakes Cloud Data Database 52

phData

MAY 4, 2023

This blog was co-written by Arnab Mondal & David Beyer. In the modern era, data reigns supreme, often regarded as the new oil of this century. To maintain a competitive edge, organizations must not only amass vast quantities of data but also skillfully harness its potential. What is Teradata?

SQL 52

SQL Data Warehouse Azure Big Data 52

phData

JULY 10, 2024

These tools allow users to handle more advanced data tasks and analyses. In this blog, we’ll explain why custom SQL and CSVs are important, demonstrate how to use these features in Sigma Computing, and provide some best practices to help you get started. Choose your desired data source type (e.g.,

SQL 52

SQL Data Warehouse Data Analysis Data Analysis 52

IBM Journey to AI blog

JULY 17, 2023

In this blog, I will cover: What is watsonx.ai? sales conversation summaries, insurance coverage, meeting transcripts, contract information) Generate: Generate text content for a specific purpose, such as marketing campaigns, job descriptions, blogs or articles, and email drafting support. What capabilities are included in watsonx.ai?

AI 75

AI AI Machine Learning Machine Learning 75

phData

SEPTEMBER 18, 2024

Fivetran is a data movement platform that offers multiple system architectures that extract data from source systems and centralize it in cloud data warehouses like Snowflake AI Data Cloud , Redshift, and others.

Data Warehouse 52

Data Warehouse System Architecture Data Pipeline Cloud Data 52