Smart Data Collective

NOVEMBER 24, 2021

According to Cognizant, nearly 70% of teams that made major or significant changes to their analytical models now make more accurate predictions, compared to 45% who preferred to leave things as they were. In this article, we’ll take a closer look at why companies should seek new approaches to data analytics.

Analytics 134

Analytics Analytics Business Intelligence Business Intelligence 134

ODSC - Open Data Science

SEPTEMBER 27, 2023

As data lakes gain prominence as a preferred solution for storing and processing enormous datasets, the need for effective data version control mechanisms becomes increasingly evident. Storage Optimization: Data warehouses use columnar storage formats and indexing to enhance query performance and data compression.

Data Lakes 98

Data Lakes Data Warehouse Database Big Data 98

Smart Data Collective

JULY 9, 2023

ETL (Extract, Transform, Load) is a crucial process in the world of data analytics and business intelligence. In this article, we will explore the significance of ETL and how it plays a vital role in enabling effective decision making within businesses.

ETL 105

ETL Data Quality Data Warehouse Analytics 105

Pickl AI

FEBRUARY 18, 2025

Summary: Power BI is a business analytics tool transforming data into actionable insights. Key features include AI-powered analytics, extensive data connectivity, customisation options, and robust data modelling. Key Takeaways It transforms raw data into actionable, interactive visualisations. Why Power BI?

Power BI 52

Power BI Azure SQL Business Intelligence 52

The Data Administration Newsletter

OCTOBER 2, 2024

Enterprise Intelligence,” by Eugene Asahara, is one such book. Eugene takes three basic ingredients that are not so new (business intelligence, knowledge graphs, and large language models), […]

Business Intelligence 52

Business Intelligence Business Intelligence Data Modeling Data Models 52

Dataversity

FEBRUARY 19, 2021

Enterprises are modernizing their data platforms and associated tool-sets to serve the fast needs of data practitioners, including data scientists, data analysts, business intelligence and reporting analysts, and self-service-embracing business and technology personnel.

Data Analyst 59

Data Analyst Data Scientist Business Intelligence Business Intelligence 59

ODSC - Open Data Science

JUNE 12, 2023

This article is an excerpt from the book Expert Data Modeling with Power BI, Third Edition by Soheil Bakhshi, a completely updated and revised edition of the bestselling guide to Power BI and data modeling. Then we have some other ETL processes to constantly land the past 5 years of data into the Datamarts.

Power BI 52

Power BI Data Warehouse ETL Data Preparation 52

ODSC - Open Data Science

OCTOBER 30, 2023

In the digital era, data visualization stands as an indispensable tool in the realm of business intelligence. It represents the graphical display of data and information, transforming complex datasets into intuitive and understandable visuals. One of the most powerful techniques in data modeling is drill-through.

Data Visualization 52

Data Visualization Power BI Business Intelligence Business Intelligence 52

The Data Administration Newsletter

APRIL 20, 2021

Steve Hoberman has been a long-time contributor to The Data Administration Newsletter (TDAN.com), including his The Book Look column since 2016, and his The Data Modeling Addict column years before that.

Data Governance 52

Data Governance Data Modeling Data Models Business Intelligence 52

The Data Administration Newsletter

APRIL 6, 2021

A metadata-driven data warehouse (MDW) offers a modern approach that is designed to make EDW development much more simplified and faster. It makes use of metadata (data about your data) as its foundation and combines data modeling and ETL functionalities to build data warehouses.

Data Warehouse 52

Data Warehouse ETL Data Modeling Data Models 52

ODSC - Open Data Science

MAY 10, 2023

Unfortunately, even the data science industry — which should recognize tabular data’s true value — often underestimates its relevance in AI. Many mistakenly equate tabular data with business intelligence rather than AI, leading to a dismissive attitude toward its sophistication.

Data Scientist 87

Data Scientist Data Science Deep Learning Deep Learning 87

The Data Administration Newsletter

MAY 1, 2024

In my first article, I laid out the basic premise for this series: an examination of how Agile has gone from the darling of the application development community to a virtual pariah that nobody wants to be associated with, and an exploration of the very important question of what we should replace it with. We […]

Data Modeling 52

Data Modeling Data Models Business Intelligence Business Intelligence 52

Pickl AI

MARCH 4, 2024

Optimising Power BI reports for performance ensures efficient data analysis. Power BI proficiency opens doors to lucrative data analytics and business intelligence opportunities, driving organisational success in today’s data-driven landscape. Calculated columns help create new fields based on existing data.

Power BI 52

Power BI Data Analysis Data Analysis Data Modeling 52

Mlearning.ai

FEBRUARY 16, 2023

Today, companies are facing a continual need to store tremendous volumes of data. The demand for information repositories enabling business intelligence and analytics is growing exponentially, giving birth to cloud solutions. Data warehousing is a vital constituent of any business intelligence operation.

Data Warehouse 52

Data Warehouse Business Intelligence Business Intelligence Database 52

The Data Administration Newsletter

DECEMBER 20, 2022

Over the past few months, my team in Castlebridge and I have been working with clients delivering training to business and IT teams on data management skills like data governance, data quality management, data modelling, and metadata management.

Data Governance 52

Data Governance Data Quality Data Modeling Data Models 52

Pickl AI

NOVEMBER 18, 2024

Selecting the right alternative ensures efficient data-driven decision-making and aligns with your organisation’s goals and budget. Introduction Power BI has become one of the most popular business intelligence (BI) tools, offering powerful Data Visualisation, reporting, and decision-making features. billion to USD 54.27

Power BI 52

Power BI Tableau Data Analysis Data Analysis 52

Alation

JULY 19, 2022

The traditional data science workflow , as defined by Joe Blitzstein and Hanspeter Pfister of Harvard University, contains 5 key steps: Ask a question. Get the data. Explore the data. Model the data. A data catalog can assist directly with every step, but model development.

Data Scientist 59

Data Scientist Data Quality Data Science Data Analyst 59

The Data Administration Newsletter

JANUARY 17, 2024

Eric Siegel’s “The AI Playbook” serves as a crucial guide, offering important insights for data professionals and their internal customers on effectively leveraging AI within business operations.

AI 122

AI AI Data Quality Data Governance 122

Cambridge Intelligence

OCTOBER 19, 2023

Multi-model databases combine graphs with two other NoSQL data models – document and key-value stores. RDF vs property graphs Another way to categorize graph databases is by their data structure. RDF vs property graphs Another way to categorize graph databases is by their data structure.

Database 59

Database Azure SQL Analytics 59

The Data Administration Newsletter

JANUARY 1, 2025

Graphs, charts with colors, lines and shapes can often tell a story and communicate issues, challenges and opportunities in a business environment. Research has shown that many people learn best when they see a story or information depicted in an image.

Data Visualization 52

Data Visualization Data Modeling Data Models Business Intelligence 52

The Data Administration Newsletter

AUGUST 17, 2021

If you are planning on using predictive algorithms, such as machine learning or data mining, in your business, then you should be aware that the amount of data collected can grow exponentially over time.

Data Mining 115

Data Mining Data Mining Data Mining Big Data 115

The Data Administration Newsletter

AUGUST 31, 2021

The purpose of data visualization is to facilitate the perception of information arrays and to identify patterns that are difficult to notice in a text table. To make a useful and powerful infographic, you need to follow the laws and regulations of data visualization.

Data Visualization 94

Data Visualization Data Modeling Data Models Big Data 94

The Data Administration Newsletter

JANUARY 3, 2023

NoSQL database systems continue to gain traction, but they are still not widely understood. There is more than one type of NoSQL database and a large number of individual NoSQL DBMSs. There are more than 225 NoSQL DBMSs listed on the NoSQL Database website alone and it just is not possible to review and understand every option. […].

Database 84

Database Data Modeling Data Models Business Intelligence 84

Dataversity

DECEMBER 9, 2020

In an industry as competitive as eCommerce retail, the ability to turn data into actionable insights presents the opportunity to make business decisions that drive more revenue and control costs. Click to learn more about author Maurice Lacroix.

Analytics 95

Analytics Analytics Data Modeling Data Models 95

Pickl AI

OCTOBER 16, 2024

Summary: Relational Database Management Systems (RDBMS) are the backbone of structured data management, organising information in tables and ensuring data integrity. This article explores RDBMS’s features, advantages, applications across industries, the role of SQL, and emerging trends shaping the future of data management.

SQL 52

SQL Database Big Data Big Data 52

The Data Administration Newsletter

JUNE 21, 2022

Twenty-five years ago today, I published the first issue of The Data Administration Newsletter. It only took a few months to recognize that there was an audience for an “online” publication focused on data administration. […].

Data Quality 78

Data Quality Data Governance Data Modeling Data Models 78

phData

MAY 11, 2023

When a new entrant to ETL development reads this article, they could easily have mastered Matillion Designer’s methods or read through the Matillion Versioning Documentation to develop their own approach to ZDLC. One scenario could be multiple team members who will each work on ingesting and processing data from one of the source systems.

ETL 52

ETL Analytics Analytics Data Models 52

The Data Administration Newsletter

APRIL 19, 2022

Introduction We are living in the age of a data revolution, and more corporations are realizing that to lead—or in some cases, to survive—they need to harness their data wealth effectively.

Data Warehouse 72

Data Warehouse Data Modeling Data Models Business Intelligence 72

The MLOps Blog

JANUARY 11, 2023

Taking them into account, different cloud providers nowadays offer services and tools with many hypothetical scenarios and solutions, nevertheless, the reality is often far from what you read in blogs and articles. Architectural design The environment architecture is shown in figure 1 as a whole with all its resources.

AWS 52

AWS Machine Learning Machine Learning ML 52

The Data Administration Newsletter

MAY 15, 2024

In discussions with data management professionals, conversations often veer toward the technical intricacies of migration to the cloud or algorithm optimization, overshadowing the core business objectives that originally spurred these initiatives.

Analytics 52

Analytics Analytics Algorithm AI 52

The Data Administration Newsletter

APRIL 17, 2024

The focus of my last column, titled Crossing the Data Divide: Data Catalogs and the Generative AI Wave, was on the impact of large language models (LLM) and generative artificial intelligence (AI) and how we disseminate knowledge throughout the enterprise and the future role of the data catalogs.

Artificial Intelligence 52

Artificial Intelligence Artificial Intelligence AI AI 52

Dataversity

SEPTEMBER 28, 2022

Data engineering is a fascinating and fulfilling career – you are at the helm of every business operation that requires data, and as long as users generate data, businesses will always need data engineers. The journey to becoming a successful data engineer […].

Data Engineer 52

Data Engineer Data Engineering Data Engineering Data Engineering 52

DagsHub

NOVEMBER 11, 2024

Social media conversations, comments, customer reviews, and image data are unstructured in nature and hold valuable insights, many of which are still being uncovered through advanced techniques like Natural Language Processing (NLP) and machine learning. Many find themselves swamped by the volume and complexity of unstructured data.

AI 52

AI AI Data Lakes Database 52

The Data Administration Newsletter

FEBRUARY 19, 2025

Data often arrives from multiple sources in inconsistent forms, including duplicate entries from CRM systems, incomplete spreadsheet records, and mismatched naming conventions across databases. These issues slow analysis pipelines and demand time-consuming cleanup.

Data Preparation 52

Data Preparation Machine Learning Machine Learning Database 52