The Data Administration Newsletter

JUNE 20, 2023

These days, there is much conversation about the necessity of the data model. The data model has been around for several decades now and can be classified as an artifact of an earlier day and age. But is the data model really out of date? And exactly why do we need a data model, anyway? […]

Data Modeling 52

Data Modeling Data Models Data Governance 52

Pickl AI

JUNE 28, 2023

Data is driving most business decisions. In this, data modeling tools play a crucial role in developing and maintaining the information system. Moreover, it involves the creation of a conceptual representation of data and its relationship. Data modeling tools play a significant role in this.

Data Modeling 52

Data Modeling Data Models Database SQL 52

Dataversity

FEBRUARY 5, 2024

Therefore, it was just a matter of time before this chess-inspired outlook permeated my professional life as a data practitioner. In both chess and data modeling, the […] The post Data’s Chess Game: Strategic Moves in Data Modeling for Competitive Advantage appeared first on DATAVERSITY.

Data Modeling 59

Data Modeling Data Models 59

Dataversity

JANUARY 18, 2021

So, I had to cut down my January 2021 list of things of importance in Data Modeling in this new, fine year (I hope)! The post 2021: Three Game-Changing Data Modeling Perspectives appeared first on DATAVERSITY. Common wisdom has it that we humans can only focus on three things at a time.

Data Modeling 98

Data Modeling Data Models Database SQL 98

Data Science Blog

MAY 20, 2024

It offers full BI-Stack Automation, from source to data warehouse through to frontend. It supports a holistic data model, allowing for rapid prototyping of various models. It also supports a wide range of data warehouses, analytical databases, data lakes, frontends, and pipelines/ETL. Mixed approach of DV 2.0

Data Pipeline 262

Data Pipeline Data Warehouse Azure Data Lakes 262

Dataversity

JUNE 24, 2022

Data models play an integral role in the development of effective data architecture for modern businesses. They are key to the conceptualization, planning, and building of an integrated data repository that drives advanced analytics and BI.

Data Modeling 52

Data Modeling Data Models Data Warehouse Analytics 52

phData

SEPTEMBER 19, 2023

However, to fully harness the potential of a data lake, effective data modeling methodologies and processes are crucial. Data modeling plays a pivotal role in defining the structure, relationships, and semantics of data within a data lake. Consistency of data throughout the data lake.

Data Lakes 52

Data Lakes Data Modeling Data Models Data Warehouse 52

Data Science Blog

NOVEMBER 15, 2023

New big data architectures and, above all, data sharing concepts such as Data Mesh are ideal for creating a common database for many data products and applications. The Event Log Data Model for Process Mining Process Mining as an analytical system can very well be imagined as an iceberg.

Data Modeling 245

Data Modeling Data Models Business Intelligence Business Intelligence 245

Dataversity

FEBRUARY 14, 2024

This requires a strategic approach, in which CxOs should define business objectives, prioritize data quality, leverage technology, build a data-driven culture, collaborate with […] The post Facing a Big Data Blank Canvas: How CxOs Can Avoid Getting Lost in Data Modeling Concepts appeared first on DATAVERSITY.

Big Data 59

Big Data Big Data Data Modeling Data Models 59

Dataversity

MAY 16, 2022

As more and more companies start to use data-related applications to manage their huge assets of data, the concepts of data modeling and analytics are becoming increasingly important. Companies use data analysis to clean, transform, and model their sets of data, whereas they […].

Data Modeling 52

Data Modeling Data Models Analytics Analytics 52

The Data Administration Newsletter

FEBRUARY 1, 2022

The COVID-19 pandemic has shown that data-driven decisions have influence over all our lives over the last two years. But decisions made without proper data foundations, such as well constructed and updated data models, can lead to potentially disastrous results.

Data Modeling 52

Data Modeling Data Models Analytics Analytics 52

The Data Administration Newsletter

FEBRUARY 1, 2022

The COVID-19 pandemic has shown that data-driven decisions have influence over all our lives over the last two years. But decisions made without proper data foundations, such as well constructed and updated data models, can lead to potentially disastrous results.

Data Modeling 52

Data Modeling Data Models Analytics Analytics 52

Data Science Dojo

MARCH 8, 2024

This blog delves into a detailed comparison between the two data management techniques. In today’s digital world, businesses must make data-driven decisions to manage huge sets of information. Hence, databases are important for strategic data handling and enhanced operational efficiency.

Database 370

Database Natural Language Processing Clustering SQL 370

Dataversity

OCTOBER 4, 2021

And we have short delivery cycles, sprints, and a lot of peers to share data models with. The post Quick, Easy, and Flexible Data Model Diagrams appeared first on DATAVERSITY. Many of us have a lot to do. In search of something lightweight, which is quick and easy, and may be produced (or consumed) by other programs?

Data Modeling 52

Data Modeling Data Models Database 52

Dataversity

FEBRUARY 4, 2022

But decisions made without proper data foundations, such as well-constructed and updated data models, can lead to potentially disastrous results. For example, the Imperial College London epidemiology data model was used by the U.K. Government in 2020 […].

Data Modeling 52

Data Modeling Data Models Data Quality Data Governance 52

Towards AI

FEBRUARY 7, 2024

What is the purpose of this… Read the full blog for free on Medium. Join thousands of data leaders on the AI newsletter. Convert these to a string: df['a'] = 'a' + df['a'].astype(str)df['b'] astype(str)df['b'] = 'b' + df['b'].astype(str)df['c']

Data Modeling 86

Data Modeling Data Models Algorithm AI 86

Data Science Connect

JANUARY 27, 2023

It is the process of collecting, storing, managing, and analyzing large amounts of data, and data engineers are responsible for designing and implementing the systems and infrastructure that make this possible. Learn about data modeling: Data modeling is the process of creating a conceptual representation of data.

Data Engineer 130

Data Engineer Data Engineering Data Engineering Data Engineering 130

Dataversity

FEBRUARY 24, 2021

They deliver a single access point for all data regardless of location — whether it’s at rest or in motion. Experts agree that data fabrics are the future of data analytics and […]. The post Maximizing Your Data Fabric’s ROI via Entity Data Modeling appeared first on DATAVERSITY.

Data Modeling 64

Data Modeling Data Models Analytics Analytics 64

Dataversity

JULY 26, 2021

aka Data Modeling What?) Sometimes the obvious is not that … obvious. Many people know that I am on the graph-y side of the house. But explaining a simple matter like […]. The post What’s in a Name? appeared first on DATAVERSITY.

Data Modeling 52

Data Modeling Data Models Database 52

The Data Administration Newsletter

JUNE 15, 2021

Data Governance describes the practices and processes organizations use to manage the access, use, quality and security of an organizations data assets. The data-driven business era has seen a rapid rise in the value of organization’s data resources.

Data Governance 105

Data Governance Data Modeling Data Models 105

Towards AI

NOVEMBER 12, 2024

Sources of Hallucinations: Generalized Training Data: Models trained on non-specialized data may lack depth in healthcare-specific contexts.Probabilistic Generation: LLMs generate text based on probability, which sometimes leads them to select… Read the full blog for free on Medium.

AI 94

AI AI Data Models Data Modeling 94

IBM Journey to AI blog

MAY 29, 2024

Designing data models and generating Entity-Relationship Diagrams (ERDs) demand significant effort and expertise. Data model creation : Based on use cases and user stories, watsonx can generate robust data models representing the software’s data structure.

Data Modeling 91

Data Modeling Data Models Database AI 91

phData

DECEMBER 2, 2024

Power BI’s, and now Fabric’s ability to centralize dashboards and Semantic Models (formerly datasets) so that reporting is easily accessible and data can be shared without unnecessarily duplicating is second to none in the business intelligence product realm. What are Dataflows, and Why are They So Great?

Power BI 52

Power BI Data Models Data Modeling Data Visualization 52

phData

AUGUST 29, 2023

This blog was written by Spencer Baucke and updated for 2023 by Gavin Pedersen. Letting your Power BI data model get disorganized is a feeling every Power BI developer knows all too well, and it’s something that can occur very quickly when developing. Open the model view by clicking the data model icon on the left.

Power BI 52

Power BI Data Modeling Data Models 52

phData

NOVEMBER 26, 2024

In this blog, we’ll discuss OLS and how it compares to RLS and show a brief example of implementing it using a third-party tool called Tabular Editor. Row-Level Security (RLS) is a data security feature that restricts access to specific rows of data for designated users or groups of users. Contact phData Today!

Power BI 52

Power BI Data Modeling Data Models 52

Towards AI

JANUARY 11, 2024

Tabular data is the data in the typical table — some columns and rows are structured well, like in Excel or SQL data. It's the most common usage of data forms in many data use cases. With the power of LLM, we would learn how to explore the data and perform data modeling. How do we do?

Clean Data 106

Clean Data Python SQL Data Science 106

phData

FEBRUARY 15, 2024

In this blog, we will explore different app types available in Microsoft PowerApps, discuss their pros and cons, and explain when it is most appropriate to use each one. The data model drives the app’s layout and business processes. Pros Rapid Development: Quick creation of apps based on existing data models.

Data Modeling 52

Data Modeling Data Models Database 52

IBM Journey to AI blog

APRIL 5, 2024

An industry-standard data model A uniform data model is necessary to get a full view of combined systems with information flowing across the ecosystem. Technical, financial, geographical, operational and transactional data attributes are all parts of a data structure.

Data Models 91

Data Models Data Modeling Machine Learning Machine Learning 91

IBM Journey to AI blog

APRIL 8, 2024

Acquisitions and mergers Consider this fictional example: A company that sells three-wheeled cars has created a robust data model where it is easy to get to any piece of data and the format is understood across the business. The new company’s data model is completely different from the original company.

Data Governance 83

Data Governance Data Models Data Modeling AI 83

IBM Journey to AI blog

JUNE 28, 2024

In a previous blog, we presented the three-layered model for efficient network operations. The main challenges in the context of applying generative AI across these layers are: Data layer : Generative AI initiatives are data projects at their core, with inadequate data comprehension being one of the primary complexities.

AI 93

AI AI Analytics Analytics 93

phData

MARCH 22, 2023

Sigma Computing’s Metrics are a powerful tool for simplifying this complexity and making it easier for business users to access and understand data. In this blog, we will explore what Metrics are, how they work, and why they should be used in data modeling. appeared first on phData.

Data Modeling 52

Data Modeling Data Models Data Quality Database 52

Towards AI

JULY 17, 2024

I’m not going to go into huge details on this as if you follow AI / LLM (which I assume you do if you are reading this) but in a nutshell, RAG is the process whereby you feed external data into an LLM alongside prompts to ensure it has all of the information it needs to make decisions. What is GraphRAG? Why use Graphs and what are they?

Database 85

Database Data Modeling Data Models SQL 85

ODSC - Open Data Science

NOVEMBER 19, 2024

ODSC West 2024 showcased a wide range of talks and workshops from leading data science, AI, and machine learning experts. This blog highlights some of the most impactful AI slides from the world’s best data science instructors, focusing on cutting-edge advancements in AI, data modeling, and deployment strategies.

Deep Learning 52

Deep Learning Deep Learning AI AI 52

Dataversity

AUGUST 12, 2024

One of the most important questions about using AI responsibly has very little to do with data, models, or anything technical. How can […] The post Ask a Data Ethicist: How Can We Set Realistic Expectations About AI? It has to do with the power of a captivating story about magical thinking.

AI 59

AI AI Data Modeling Data Models 59

phData

MARCH 28, 2024

In this blog, we will cover what tables and pivot tables are, the advantages and limitations of each, and the factors to consider when choosing which element to use. At the end of this blog, you will have a firm understanding of both elements and how to utilize each in your day-to-day data exploration.

Data Models 52

Data Models Data Modeling Data Visualization SQL 52

Mlearning.ai

AUGUST 4, 2023

Landing page for Admin view Building API Logic GreatAPI is built on top of FastAPI, which allows you to easily implement your API logic for building a powerful API[such as blogs in this case]. Here’s a quick guide on how to do that: Step 1: Add Models Define your data models in the myapp/models.py offset(skip).limit(limit).all()

Python 52

Python Machine Learning Machine Learning Database 52

Dataversity

JULY 14, 2023

My background as a data modeler over many years makes me shiver a little bit, because what the friendly AI helpers help us produce is subjected to cognitive processes, where we, the readers, process […] The post Generative AI and Semantic Compliance appeared first on DATAVERSITY. But there are loads of them.

AI 52

AI AI Data Modeling Data Models 52