Dataversity

DECEMBER 20, 2021

Reading Larry Burns’ “Data Model Storytelling” (TechnicsPub.com, 2021) was a really good experience for a guy like me (i.e., someone who thinks that data models are narratives). The post Tales of Data Modelers appeared first on DATAVERSITY. The post Tales of Data Modelers appeared first on DATAVERSITY.

Data Modeling 98

Data Modeling Data Models Database SQL 98

Dataversity

JANUARY 18, 2021

So, I had to cut down my January 2021 list of things of importance in Data Modeling in this new, fine year (I hope)! The post 2021: Three Game-Changing Data Modeling Perspectives appeared first on DATAVERSITY. Common wisdom has it that we humans can only focus on three things at a time.

Data Modeling 98

Data Modeling Data Models Database SQL 98

Data Science Dojo

FEBRUARY 9, 2023

Data is an essential component of any business, and it is the role of a data analyst to make sense of it all. Power BI is a powerful data visualization tool that helps them turn raw data into meaningful insights and actionable decisions. Check out this course and learn Power BI today!

Power BI 221

Power BI Data Analyst Data Visualization Data Analysis 221

Towards AI

JANUARY 11, 2024

Tabular data is the data in the typical table — some columns and rows are structured well, like in Excel or SQL data. It's the most common usage of data forms in many data use cases. With the power of LLM, we would learn how to explore the data and perform data modeling.

Python 126

Python Clean Data SQL Data Science 126

Pickl AI

JUNE 28, 2023

Data is driving most business decisions. In this, data modeling tools play a crucial role in developing and maintaining the information system. Moreover, it involves the creation of a conceptual representation of data and its relationship. Data modeling tools play a significant role in this.

Data Modeling 52

Data Modeling Data Models Database SQL 52

phData

JULY 10, 2024

Sigma Computing , a cloud-based analytics platform, helps data analysts and business professionals maximize their data with collaborative and scalable analytics. One of Sigma’s key features is its support for custom SQL queries and CSV file uploads. These tools allow users to handle more advanced data tasks and analyses.

SQL 52

SQL Data Warehouse Analytics Analytics 52

phData

SEPTEMBER 19, 2023

However, to fully harness the potential of a data lake, effective data modeling methodologies and processes are crucial. Data modeling plays a pivotal role in defining the structure, relationships, and semantics of data within a data lake. Consistency of data throughout the data lake.

Data Lakes 52

Data Lakes Data Modeling Data Models Data Warehouse 52

Towards AI

JULY 17, 2024

I’m not going to go into huge details on this as if you follow AI / LLM (which I assume you do if you are reading this) but in a nutshell, RAG is the process whereby you feed external data into an LLM alongside prompts to ensure it has all of the information it needs to make decisions. What is GraphRAG? Why use Graphs and what are they?

Database 111

Database Data Modeling Data Models SQL 111

AWS Machine Learning Blog

FEBRUARY 21, 2025

Data exploration and model development were conducted using well-known machine learning (ML) tools such as Jupyter or Apache Zeppelin notebooks. Apache Hive was used to provide a tabular interface to data stored in HDFS, and to integrate with Apache Spark SQL. HBase is employed to offer real-time key-based access to data.

Data Science 72

Data Science AWS Hadoop Data Scientist 72

Hacker News

JULY 18, 2023

What if you could automatically shard your PostgreSQL database across any number of servers and get industry-leading performance at scale without any special data modelling steps? In this blog post, you’ll get a high-level overview of schema-based sharding and other new Citus 12 features: What is schema-based sharding?

Database 123

Database SQL Data Modeling Data Models 123

Pickl AI

MARCH 3, 2025

Summary: Business Intelligence Analysts transform raw data into actionable insights. They use tools and techniques to analyse data, create reports, and support strategic decisions. Key skills include SQL, data visualization, and business acumen. Introduction We are living in an era defined by data.

Business Intelligence 52

Business Intelligence Business Intelligence Data Analyst Data Visualization 52

phData

OCTOBER 9, 2023

However, to harness the full potential of Snowflake’s performance capabilities, it is essential to adopt strategies tailored explicitly for data vault modeling. Because of data vault’s modeling structure, transformation queries for moving data between these layers can become exceedingly complex.

ETL 69

ETL Clustering Data Warehouse SQL 69

phData

SEPTEMBER 13, 2023

Sigma Computing is a powerful data modeling and analysis platform designed to leverage the power of modern cloud technology. Once connected to Snowflake , Sigma utilizes Machine Generated SQL to produce the most optimal results. Check out this blog to master the fundamentals. True or False. True or False.

SQL 52

SQL Data Modeling Data Models Analytics 52

Dataversity

NOVEMBER 21, 2022

The new ISO 39075 Graph Query Language Standard is to hit the data streets in late 2023 (?). If graph databases are standardized pretty soon, what will happen to SQL? Not simply because legacy SQL has a tremendous inertia, but because relational database paradigms […]. They will very likely stay around for a long time.

SQL 52

SQL Database Data Models Data Modeling 52

Pickl AI

JULY 3, 2023

It is the process of converting raw data into relevant and practical knowledge to help evaluate the performance of businesses, discover trends, and make well-informed choices. Data gathering, data integration, data modelling, analysis of information, and data visualization are all part of intelligence for businesses.

Business Intelligence 52

Business Intelligence Business Intelligence SQL Data Visualization 52

phData

MAY 25, 2023

The June 2021 release of Power BI Desktop introduced Custom SQL queries to Snowflake in DirectQuery mode. In 2021, Microsoft enabled Custom SQL queries to be run to Snowflake in DirectQuery mode further enhancing the connection capabilities between the platforms.

Power BI 84

Power BI Analytics Analytics Azure 84

phData

AUGUST 10, 2023

In this blog, our focus will be on exploring the data lifecycle along with several Design Patterns, delving into their benefits and constraints. Data architects can leverage these patterns as starting points or reference models when designing and implementing data vault architectures.

SQL 52

SQL Data Observability Data Quality Data Pipeline 52

DagsHub

DECEMBER 11, 2023

Best 8 data version control tools for 2023 (Source: DagsHub ) Introduction With business needs changing constantly and the growing size and structure of datasets, it becomes challenging to efficiently keep track of the changes made to the data, which leads to unfortunate scenarios such as inconsistencies and errors in data.

Machine Learning 98

Machine Learning Machine Learning Data Lakes Big Data 98

Pickl AI

DECEMBER 17, 2024

This blog explores PostgreSQL vs MySQL, two popular RDBMS solutions, highlighting their differences to help you choose the right one for your needs. It is open-source and uses Structured Query Language (SQL) to manage and manipulate data. PostgreSQLs architecture is highly flexible, supporting many data models and workloads.

SQL 52

SQL Database Analytics Analytics 52

IBM Journey to AI blog

SEPTEMBER 19, 2023

And you should have experience working with big data platforms such as Hadoop or Apache Spark. Additionally, data science requires experience in SQL database coding and an ability to work with unstructured data of various types, such as video, audio, pictures and text.

Data Science 94

Data Science Analytics Analytics Data Scientist 94

phData

JULY 11, 2023

Power BI Datamarts provides a low/no code experience directly within Power BI Service that allows developers to ingest data from disparate sources, perform ETL tasks with Power Query, and load data into a fully managed Azure SQL database. Note: At the time of writing this blog, Power BI Datamarts is in preview.

Power BI 40

Power BI SQL Azure ETL 40

Pickl AI

APRIL 6, 2023

Accordingly, one of the most demanding roles is that of Azure Data Engineer Jobs that you might be interested in. The following blog will help you know about the Azure Data Engineering Job Description, salary, and certification course. Having experience using at least one end-to-end Azure data lake project.

Azure 52

Azure Data Engineering Data Engineer Data Engineering 52

Pickl AI

JULY 25, 2023

Data engineers are essential professionals responsible for designing, constructing, and maintaining an organization’s data infrastructure. They create data pipelines, ETL processes, and databases to facilitate smooth data flow and storage. Data Visualization: Matplotlib, Seaborn, Tableau, etc.

Data Engineering 52

Data Engineering Data Engineer Data Engineering Data Engineering 52

phData

JUNE 27, 2023

All of which have a specific role used to collect, store, process, and analyze data. This blog will hone in on the new collaboration, how to implement it into your workbooks, and why Sigma users should be excited about the feature. Using SQL-centric transformations to model data to be deployed.

SQL 52

SQL Database Data Quality Data Warehouse 52

phData

MARCH 28, 2024

In this blog, we will cover what tables and pivot tables are, the advantages and limitations of each, and the factors to consider when choosing which element to use. At the end of this blog, you will have a firm understanding of both elements and how to utilize each in your day-to-day data exploration.

Data Modeling 52

Data Modeling Data Models Data Visualization SQL 52

phData

AUGUST 16, 2023

To address these complexities, a powerful data warehousing solution like the Snowflake Data Cloud , coupled with an effective data modeling approach such as the Data Vault architecture, can be a winning combination. What is a Data Vault Architecture? Contact phData!

Data Warehouse 52

Data Warehouse Data Governance SQL Data Modeling 52

Cambridge Intelligence

OCTOBER 19, 2023

The answer probably depends more on the complexity of your queries than the connectedness of your data. Relational databases (with recursive SQL queries), document stores, key-value stores, etc., Multi-model databases combine graphs with two other NoSQL data models – document and key-value stores.

Database 59

Database Azure SQL Analytics 59

Pickl AI

AUGUST 9, 2024

Summary: This blog delves into hierarchies in dimensional modelling, highlighting their significance in data organisation and analysis. Real-world examples illustrate their application, while tools and technologies facilitate effective hierarchical data management in various industries.

Data Warehouse 52

Data Warehouse Data Quality ETL Business Intelligence 52

Alation

SEPTEMBER 7, 2021

This is the last of the 4-part blog series. In the previous blog , we discussed how Alation provides a platform for data scientists and analysts to complete projects and analysis at speed. In this blog we will discuss how Alation helps minimize risk with active data governance. Two problems arise. In Summary.

Data Governance 59

Data Governance Data Scientist Data Quality Data Profiling 59

Pickl AI

SEPTEMBER 20, 2024

Both databases are designed to handle large volumes of data, but they cater to different use cases and exhibit distinct architectural designs. Key Features of Apache Cassandra Scalability: Cassandra can scale horizontally by adding more servers to accommodate growing data needs. Here’s a detailed comparison of their key differences.

Database 52

Database Clustering Data Modeling Data Models 52

IBM Journey to AI blog

JULY 6, 2023

It uses advanced tools to look at raw data, gather a data set, process it, and develop insights to create meaning. Areas making up the data science field include mining, statistics, data analytics, data modeling, machine learning modeling and programming. appeared first on IBM Blog.

Machine Learning 70

Machine Learning Machine Learning Data Science Big Data 70

Pickl AI

JANUARY 9, 2025

With organisations prioritising efficiency, sustainability, and data-backed decision-making, Operations Analysts now play a pivotal role in streamlining processes and optimising performance. They bridge the gap between data insights and actionable strategies, ensuring businesses stay competitive.

Power BI 52

Power BI Machine Learning Machine Learning Tableau 52

phData

FEBRUARY 8, 2024

Data Modeling, dbt has gradually emerged as a powerful tool that largely simplifies the process of building and handling data pipelines. dbt is an open-source command-line tool that allows data engineers to transform, test, and document the data into one single hub which follows the best practices of software engineering.

Data Modeling 52

Data Modeling Data Models Data Warehouse Database 52

phData

OCTOBER 27, 2023

If that leaves you looking for more background context, you can jump to our blog called What is a Feature Store? This blog will walk through how to build your own feature platform with batch feature engineering pipelines using Airflow and dbt on the Snowflake Data Cloud. The answer to both questions is no.

Machine Learning 52

Machine Learning Machine Learning Python ML 52

phData

OCTOBER 17, 2024

Getting your data into Snowflake, creating analytics applications from the data, and even ensuring your Snowflake account runs smoothly all require some sort of tool. In this blog, we’ll review some of the best free tools for use with Snowflake Data Cloud , what they can do for you, and how to use them without breaking the bank.

AI 52

AI AI SQL Data Quality 52

phData

DECEMBER 13, 2023

In this blog, we will discuss dbt packages, when you should use a package, and how to use them in your project. You can also transform Facebook Ads or AdWords spend data into a consistent format and keep the data segregated. You can generate SQL code to unite two relations and create surrogate keys or pivot columns.

SQL 52

SQL Python Azure Data Models 52

phData

NOVEMBER 2, 2023

The Snowflake Data Cloud has introduced a groundbreaking feature that promises to simplify and supercharge this process: Snowflake Dynamic Tables. These dynamic tables are not just another table type; they represent a game-changing approach to data pipeline development and management. What are Snowflake Dynamic Tables?

Data Pipeline 52

Data Pipeline SQL Data Warehouse Data Engineering 52