Dataversity

FEBRUARY 1, 2021

In Part 1 and Part 2 of this series, we described how data warehousing (DW) and business intelligence (BI) projects are a high priority for many organizations. Project sponsors seek to empower more and better data-driven decisions and actions throughout their enterprise; they intend to expand their […].

Data Warehouse 59

Data Warehouse Business Intelligence Business Intelligence Data Profiling 59

Dataversity

JANUARY 11, 2021

In Part 1 of this series, we described how data warehousing (DW) and business intelligence (BI) projects are a high priority for many organizations. Project sponsors seek to empower more and better data-driven decisions and actions throughout their enterprise; they intend to expand their user base for […].

Data Warehouse 59

Data Warehouse Business Intelligence Business Intelligence Data Profiling 59

The Data Administration Newsletter

SEPTEMBER 14, 2021

Data lake is a newer IT term created for a new category of data store. But just what is a data lake? According to IBM, “a data lake is a storage repository that holds an enormous amount of raw or refined data in native format until it is accessed.” That makes sense. I think the […].

Data Lakes 91

Data Lakes Data Warehouse Business Intelligence Business Intelligence 91

Dataversity

JANUARY 25, 2023

The emergence of advanced data storage technologies, such as cloud computing, data hubs, and data lakes, makes us question the role of traditional data warehouses in modern data architecture. Data warehouses were first introduced in the […] The post Are Data Warehouses Still Relevant?

Data Warehouse 52

Data Warehouse Data Lakes Cloud Computing Data Pipeline 52

The Data Administration Newsletter

APRIL 6, 2021

A metadata-driven data warehouse (MDW) offers a modern approach that is designed to make EDW development much more simplified and faster. It makes use of metadata (data about your data) as its foundation and combines data modeling and ETL functionalities to build data warehouses.

Data Warehouse 52

Data Warehouse ETL Data Modeling Data Models 52

Dataconomy

MARCH 24, 2023

In today’s fast-paced business landscape, companies need to stay ahead of the curve to remain competitive. Business intelligence (BI) has emerged as a key solution to help companies gain insights into their operations and market trends. What is business intelligence?

Business Intelligence 70

Business Intelligence Business Intelligence Data Analysis Data Analysis 70

Dataconomy

MARCH 24, 2023

In today’s fast-paced business landscape, companies need to stay ahead of the curve to remain competitive. Business intelligence (BI) has emerged as a key solution to help companies gain insights into their operations and market trends. What is business intelligence?

Business Intelligence 70

Business Intelligence Business Intelligence Data Analysis Data Analysis 70

ODSC - Open Data Science

SEPTEMBER 27, 2023

As data lakes gain prominence as a preferred solution for storing and processing enormous datasets, the need for effective data version control mechanisms becomes increasingly evident. Understanding Data Lakes A data lake is a centralized repository that stores structured, semi-structured, and unstructured data in its raw format.

Data Lakes 98

Data Lakes Data Warehouse Database Big Data 98

Dataconomy

MARCH 4, 2025

Data mining is a fascinating field that blends statistical techniques, machine learning, and database systems to reveal insights hidden within vast amounts of data. Businesses across various sectors are leveraging data mining to gain a competitive edge, improve decision-making, and optimize operations.

Data Mining 91

Data Mining Data Mining Data Mining Decision Trees 91

Dataversity

DECEMBER 15, 2021

The abilities of an organization towards capturing, storing, and analyzing data; searching, sharing, transferring, visualizing, querying, and updating data; and meeting compliance and regulations are mandatory for any sustainable organization. For example, most data warehouses […].

Data Warehouse 98

Data Warehouse Data Lakes Database Business Intelligence 98

Smart Data Collective

JULY 9, 2023

ETL (Extract, Transform, Load) is a crucial process in the world of data analytics and business intelligence. In this article, we will explore the significance of ETL and how it plays a vital role in enabling effective decision making within businesses. What is ETL? Let’s break down each step: 1.

ETL 105

ETL Data Quality Data Warehouse Analytics 105

IBM Journey to AI blog

APRIL 25, 2023

In a prior blog , we pointed out that warehouses, known for high-performance data processing for business intelligence, can quickly become expensive for new data and evolving workloads. To do so, Presto and Spark need to readily work with existing and modern data warehouse infrastructures.

Data Warehouse 58

Data Warehouse Data Engineer Data Engineering Data Engineering 58

The Data Administration Newsletter

APRIL 19, 2022

Introduction We are living in the age of a data revolution, and more corporations are realizing that to lead—or in some cases, to survive—they need to harness their data wealth effectively.

Data Warehouse 72

Data Warehouse Data Modeling Data Models Business Intelligence 72

ODSC - Open Data Science

FEBRUARY 24, 2023

While machine learning frameworks and platforms like PyTorch, TensorFlow, and scikit-learn can perform data exploration well, it’s not their primary intent. There are also plenty of data visualization libraries available that can handle exploration like Plotly, matplotlib, D3, Apache ECharts, Bokeh, etc.

Exploratory Data Analysis 126

Exploratory Data Analysis Data Visualization Data Analysis Data Analysis 126

ODSC - Open Data Science

JUNE 12, 2023

The Datamarts capability opens endless possibilities for organizations to achieve their data analytics goals on the Power BI platform. This article is an excerpt from the book Expert Data Modeling with Power BI, Third Edition by Soheil Bakhshi, a completely updated and revised edition of the bestselling guide to Power BI and data modeling.

Power BI 52

Power BI Data Warehouse ETL Data Preparation 52

Mlearning.ai

FEBRUARY 16, 2023

Today, companies are facing a continual need to store tremendous volumes of data. The demand for information repositories enabling business intelligence and analytics is growing exponentially, giving birth to cloud solutions. Snowflake data warehouses deliver greater capacity without the need for any additional equipment.

Data Warehouse 52

Data Warehouse Business Intelligence Business Intelligence Database 52

Alation

JANUARY 17, 2023

In this article, I will explain the modern data stack in detail, list some benefits, and discuss what the future holds. What Is the Modern Data Stack? The modern data stack is a combination of various software tools used to collect, process, and store data on a well-integrated cloud-based data platform.

Data Warehouse 52

Data Warehouse ETL Tableau Cloud Data 52

ODSC - Open Data Science

FEBRUARY 8, 2023

Common databases appear unable to cope with the immense increase in data volumes. This is where the BigQuery data warehouse comes into play. BigQuery operation principles Business intelligence projects presume collecting information from different sources into one database. You only pay for the resources you use.

Database 97

Database Data Science Big Data Big Data 97

The Data Administration Newsletter

MAY 31, 2022

As we enter a new cloud-first era, advancements in technology have helped companies capture and capitalize on data as much as possible. Deciding between which cloud architecture to use has always been a debate between two options: data warehouses and data lakes.

Data Lakes 52

Data Lakes Data Warehouse Data Governance Business Intelligence 52

Dataconomy

APRIL 27, 2023

But the true power of OLTP databases lies beyond the mere execution of transactions, and delving into their inner workings is to unravel a complex tapestry of data management, high-performance computing, and real-time responsiveness. OLAP systems support business intelligence, data mining, and other decision support applications.

Database 159

Database Data Scientist Data Mining Data Mining 159

IBM Journey to AI blog

JANUARY 18, 2023

Data platform architecture has an interesting history. Towards the turn of millennium, enterprises started to realize that the reporting and business intelligence workload required a new solution rather than the transactional applications. A read-optimized platform that can integrate data from multiple applications emerged.

Data Lakes 52

Data Lakes Data Warehouse Azure Apache Hadoop 52

ODSC - Open Data Science

FEBRUARY 6, 2024

This open-source streaming platform enables the handling of high-throughput data feeds, ensuring that data pipelines are efficient, reliable, and capable of handling massive volumes of data in real-time. Each platform offers unique features and benefits, making it vital for data engineers to understand their differences.

Data Engineering 52

Data Engineering Data Engineering Data Engineering Data Engineer 52

Smart Data Collective

FEBRUARY 20, 2022

What are the ties between DAM and data loss prevention (DLP) systems? This article will provide the answers. Therefore, protecting them against intruders should be top of mind for businesses. Does DAM need a user behavior analytics (UBA) module? What is the role of machine learning in monitoring database activity?

Database 130

Database Machine Learning Machine Learning Data Warehouse 130

The MLOps Blog

MAY 17, 2023

Often the Data Team, comprising Data and ML Engineers , needs to build this infrastructure, and this experience can be painful. Focus Area ETL helps to transform the raw data into a structured format that can be easily available for data scientists to create models and interpret for any data-driven decision.

ETL 59

ETL Data Pipeline ML ML 59

ODSC - Open Data Science

JANUARY 30, 2024

This involves extracting data from various sources, transforming it into a usable format, and loading it into data warehouses or other storage systems. Think of it as building plumbing for data to flow smoothly throughout the organization. So get your pass today, and keep yourself ahead of the curve.

Data Engineering 52

Data Engineering Data Engineering Data Engineering Data Engineer 52

IBM Journey to AI blog

JULY 17, 2023

sales conversation summaries, insurance coverage, meeting transcripts, contract information) Generate: Generate text content for a specific purpose, such as marketing campaigns, job descriptions, blogs or articles, and email drafting support. ” Vitaly Tsivin, EVP Business Intelligence at AMC Networks.

AI 74

AI AI Machine Learning Machine Learning 74

Alation

JULY 19, 2022

Modern data catalogs surface a wide range of data asset types. For instance, Alation can return wiki-like articles, conversations, and business intelligence objects, in addition to traditional tables. Finally, data catalogs can help data scientists promulgate the results of their projects.

Data Scientist 59

Data Scientist Data Quality Data Science Data Analyst 59

Precisely

JANUARY 25, 2024

This article explores the nuances of mainframe optimization, outlining the drivers, common patterns, and key methods and tools for effective implementation. Cloud-based DevOps provides a modern, agile environment for developing and maintaining applications and services that interact with the organization’s mainframe data.

Data Governance 69

Data Governance Database Cloud Data Data Lakes 69

ODSC - Open Data Science

JANUARY 18, 2024

ETL (Extract, Transform, Load) This is a core data engineering process for moving data from one or more sources to a destination, typically a data warehouse or data lake. The reason this is an important skill is that ETL is a critical process for data warehousing and business intelligence.

Data Engineering 52

Data Engineering Data Engineering Data Engineering Data Engineer 52

Dataversity

SEPTEMBER 6, 2021

The rush to become data-driven is more heated, important, and pronounced than it has ever been. Businesses understand that if they continue to lead by guesswork and gut feeling, they’ll fall behind organizations that have come to recognize and utilize the power and potential of data. Click to learn more about author Mike Potter.

Data Warehouse 98

Data Warehouse Data Lakes ETL Cloud Data 98

Pickl AI

DECEMBER 10, 2024

AI, hybrid cloud, and advanced analytics empower businesses to achieve operational excellence and drive digital transformation. Introduction This article explores Oracles engineered systemsExalytics, Exalogic, and Exadatahighlighting their transformative role in modern IT infrastructure.

Database 52

Database Analytics Analytics Business Intelligence 52

Alation

JANUARY 26, 2023

These data requirements could be satisfied with a strong data governance strategy. Governance can — and should — be the responsibility of every data user, though how that’s achieved will depend on the role within the organization. This article will focus on how data engineers can improve their approach to data governance.

Data Governance 52

Data Governance Data Engineering Data Engineering Data Engineering 52

Pickl AI

APRIL 26, 2024

This article aims to guide you through the intricacies of Data Analyst interviews, offering valuable insights with a comprehensive list of top questions. Additionally, we’ve got your back if you consider enrolling in the best data analytics courses. Explain the Extract, Transform, Load (ETL) process.

Data Analyst 52

Data Analyst Data Analysis Data Analysis Machine Learning 52

Dataversity

APRIL 1, 2021

In the data-driven world we live in today, the field of analytics has become increasingly important to remain competitive in business. In fact, a study by McKinsey Global Institute shows that data-driven organizations are 23 times more likely to outperform competitors in customer acquisition and nine times […].

Analytics 69

Analytics Analytics Data Silos Data Lakes 69

phData

MAY 11, 2023

When a new entrant to ETL development reads this article, they could easily have mastered Matillion Designer’s methods or read through the Matillion Versioning Documentation to develop their own approach to ZDLC. A common data type transformation is to convert date fields that were loaded as strings into actual DATE or DATETIME data types.

ETL 52

ETL Analytics Analytics Data Models 52

DagsHub

AUGUST 23, 2024

Image generated with Midjourney Organizations increasingly rely on data to make business decisions, develop strategies, or even make data or machine learning models their key product. As such, the quality of their data can make or break the success of the company. What is a data quality framework?

Data Quality 52

Data Quality Data Governance Machine Learning Machine Learning 52

The Data Administration Newsletter

JANUARY 3, 2023

For a while now, vendors have been advocating that people put their data in a data lake when they put their data in the cloud. The Data Lake The idea is that you put your data into a data lake. Then, at a later point in time, the end user analyst can come along and […].

Data Lakes 59

Data Lakes Data Warehouse Big Data Big Data 59