Data Science Blog

NOVEMBER 15, 2023

Example Event Log for Process Mining The following example SQL-query is inserting Event-Activities from a SAP ERP System into an existing event log database table. And that´s why you should host any object-centric data model not in a dedicated tool for analysis but centralized on a Data Lakehouse System.

Data Modeling 245

Data Modeling Data Models Business Intelligence Business Intelligence 245

Alation

FEBRUARY 20, 2020

For many enterprises, a hybrid cloud data lake is no longer a trend, but becoming reality. With a cloud deployment, enterprises can leverage a “pay as you go” model; reducing the burden of incurring capital costs. Due to these needs, hybrid cloud data lakes emerged as a logical middle ground between the two consumption models.

Data Lakes 52

Data Lakes Cloud Data AWS Tableau 52

Data Science Dojo

JULY 3, 2024

In this blog, we will explore the arena of data science bootcamps and lay down a guide for you to choose the best data science bootcamp. What do Data Science Bootcamps Offer? Big Data Technologies : Handling and processing large datasets using tools like Hadoop, Spark, and cloud platforms such as AWS and Google Cloud.

Data Science 150

Data Science Machine Learning Machine Learning Data Visualization 150

IBM Journey to AI blog

SEPTEMBER 11, 2023

Codd published his famous paper “ A Relational Model of Data for Large Shared Data Banks.” Boyce to create Structured Query Language (SQL). Developers can leverage features like REST APIs, JSON support and enhanced SQL compatibility to easily build cloud-native applications. Chamberlin and Raymond F.

Database 101

Database SQL Data Warehouse Machine Learning 101

phData

APRIL 29, 2024

In our previous blog, Top 5 Fivetran Connectors for Financial Services , we explored Fivetran’s capabilities that address the data integration needs of the finance industry. Now, let’s cover the healthcare industry, which also has a surging demand for data and analytics, along with the underlying processes to make it happen.

SQL 52

SQL Data Warehouse Azure Cloud Data 52

Data Science Dojo

SEPTEMBER 5, 2024

While data science leverages vast datasets to extract actionable insights, computer science forms the backbone of software development, cybersecurity, and artificial intelligence. This blog aims to answer the data science vs computer science confusion, providing insights to help readers decide which field to pursue.

Computer Science 195

Computer Science Computer Science Data Science Machine Learning 195

Data Science Dojo

SEPTEMBER 5, 2024

While data science leverages vast datasets to extract actionable insights, computer science forms the backbone of software development, cybersecurity, and artificial intelligence. This blog aims to answer the data science vs computer science confusion, providing insights to help readers decide which field to pursue.

Computer Science 195

Computer Science Computer Science Data Science Machine Learning 195

Data Science Blog

MAY 15, 2023

Data Warehousing ist seit den 1980er Jahren die wichtigste Lösung für die Speicherung und Verarbeitung von Daten für Business Intelligence und Analysen. Mit der zunehmenden Datenmenge und -vielfalt wurde die Verwaltung von Data Warehouses jedoch immer schwieriger und teurer. The post Was ist ein Data Lakehouse?

Data Warehouse 147

Data Warehouse Data Lakes Azure AWS 147

IBM Journey to AI blog

MAY 15, 2024

As a result, users boost pipeline performance while ensuring data security and controls. Hybrid cloud data integration Traditional data integration solutions often face latency and scalability challenges when integrating data across hybrid cloud environments.

Data Pipeline 85

Data Pipeline ETL SQL Database 85

phData

AUGUST 1, 2024

It involves multiple steps, including multiple interactions with the underlying data platform. In this blog, we will learn how to build one step by step, with thorough explanations. A prime example of this is automating repetitive code performed in many models or implementing a new feature introduced in your cloud data warehouse.

SQL 52

SQL Database Data Warehouse Cloud Data 52

Flipboard

AUGUST 17, 2023

Amazon Redshift is the most popular cloud data warehouse that is used by tens of thousands of customers to analyze exabytes of data every day. You can use query_string to filter your dataset by SQL and unload it to Amazon S3. If you’re familiar with SageMaker and writing Spark code, option B could be your choice.

ML 123

ML ML AWS Data Warehouse 123

IBM Journey to AI blog

MAY 12, 2023

Organizations that move forward with implementing strategies for sustainability capitalize on the operational, cost, resource utilization and competitive benefits of solution features like load-based “just in time” scaling, offerings of managed services like Azure, cloud data center proximity and database right-sizing through caching.

Azure 93

Azure Database Data Visualization Clustering 93

phData

NOVEMBER 28, 2024

“ Vector Databases are completely different from your cloud data warehouse.” – You might have heard that statement if you are involved in creating vector embeddings for your RAG-based Gen AI applications. In this blog, we will discuss: What is Text Splitting, and what is its importance in Vector Embedding?

Python 52

Python Database SQL Machine Learning 52

Data Science Blog

SEPTEMBER 3, 2024

Celonis unterscheidet sich von den meisten anderen Tools noch dahingehend, dass es versucht, die ganze Kette des Process Minings in einer einzigen und ausschließlichen Cloud-Anwendung in einer Suite bereitzustellen. appeared first on Data Science Blog. Vielleicht haben wir auch das ein Stück weit Celonis zu verdanken.

Data Science 130

Data Science Power BI Azure Data Warehouse 130

IBM Journey to AI blog

MAY 9, 2023

“We recognize the importance of watsonx.data and the development of the open-source components that it’s built upon,” said Das Kamhout, VP and Senior Principal Engineer of the Cloud and Enterprise Solutions Group at Intel. Savings may vary depending on configurations, workloads and vendors. [2]

Data Warehouse 92

Data Warehouse AWS AI AI 92

phData

SEPTEMBER 2, 2024

In this blog, we will cover the best practices for developing jobs in Matillion, an ETL/ELT tool built specifically for cloud database platforms. The blog will be divided into three broad sections: Design, SDLC, and Security, each with its best practices. What Are Matillion Jobs and Why Do They Matter?

ETL 52

ETL Data Warehouse SQL Database 52

phData

JULY 17, 2023

Over the past few decades, the corporate data landscape has changed significantly. The shift from on-premise databases and spreadsheets to the modern era of cloud data warehouses and AI/ LLMs has transformed what businesses can do with data. Designed to cheaply and efficiently process large quantities of data.

Data Warehouse 52

Data Warehouse Data Pipeline Cloud Data ETL 52

phData

MARCH 8, 2023

Fivetran, a cloud-based automated data integration platform, has emerged as a leading choice among businesses looking for an easy and cost-effective way to unify their data from various sources. Fast and Simple Centralizing of Many Different Data Sources Into a Single Cloud-Based Target (i.e.

Data Warehouse 96

Data Warehouse Data Engineer Data Engineering Data Engineering 96

Alation

NOVEMBER 30, 2022

Alation is the leading platform for data intelligence , delivering critical context about data to empower smarter use; to this end, it centralizes technical, operational, business, and behavioral metadata from a broad variety of sources. Within Slack, she searches for an Alation SQL query about customers by industry.

Tableau 52

Tableau SQL Database Data Analyst 52

phData

OCTOBER 9, 2023

As organizations embrace the benefits of data vault, it becomes crucial to ensure optimal performance in the underlying data platform. One such platform that has revolutionized cloud data warehousing is the Snowflake Data Cloud. This can make it nearly impossible to “handwrite” these SQL queries.

ETL 69

ETL Clustering Data Warehouse SQL 69

phData

MAY 4, 2023

This blog was co-written by Arnab Mondal & David Beyer. In the modern era, data reigns supreme, often regarded as the new oil of this century. To maintain a competitive edge, organizations must not only amass vast quantities of data but also skillfully harness its potential. What is Teradata?

SQL 52

SQL Data Warehouse Azure Big Data 52

Alation

SEPTEMBER 7, 2021

This is the last of the 4-part blog series. In the previous blog , we discussed how Alation provides a platform for data scientists and analysts to complete projects and analysis at speed. In this blog we will discuss how Alation helps minimize risk with active data governance. Two problems arise.

Data Governance 59

Data Governance Data Scientist Data Quality Data Profiling 59

IBM Journey to AI blog

JULY 11, 2023

Cloud object storage support The next generation of Db2 Warehouse introduces support for cloud object storage as a new storage medium within its storage hierarchy. Summary Db2 Warehouse Gen3 delivers an enhanced approach to cloud data warehousing, especially for always-on, mission-critical analytics workloads.

Data Warehouse 60

Data Warehouse Database Cloud Data Big Data 60

phData

MAY 31, 2023

The Snowflake Data Cloud is a powerful and industry-leading cloud data platform. In this blog, we will compare how to leverage Snowflake with Alteryx Designer Desktop vs. From there, you can choose a table or write a custom query. The SQL editor is quite helpful as it allows you to customize your query as needed.

SQL 52

SQL Database Cloud Data Data Governance 52

phData

AUGUST 9, 2023

If you’ve been watching how Snowflake Data Cloud has been growing and changing over the years, you’ll see that two tools have made very large impacts on the Modern Data Stack: Fivetran and dbt. Thus, the early data lakes began following more of the EL-style flow. Why ELT Has Succeeded Today, ELT has become the norm.

Data Warehouse 52

Data Warehouse ETL Cloud Data Big Data 52

phData

MARCH 27, 2024

While learning Snowflake presents its challenges, the benefits for any data professional are immense. In this blog, I’ll guide you towards success in your Snowflake learning journey. Snowflake’s SnowPro Advanced Certifications assess advanced Snowflake knowledge and skills relating to five data science roles.

Data Analyst 52

Data Analyst Data Engineering Data Engineering Data Engineering 52

phData

OCTOBER 12, 2022

Upon a quick trial and look at dbt Cloud, the primary things you might notice are the IDE as well as the ease of managing deployments. However, dbt Cloud offers you much more than that. In this blog post, we’ll dive into six of the most powerful dbt Cloud features and many others that you probably don’t know about.

SQL 52

SQL Data Warehouse Data Visualization Cloud Data 52

phData

JUNE 23, 2023

The Snowflake Data Cloud was built natively for the cloud. When we think about cloud data transformations, one crucial building block is User Defined Functions (UDFs). In this blog, we will highlight some of the offerings of each language, which may aid in deciding which language best fulfills your needs.

SQL 52

SQL Python Algorithm Big Data 52

phData

FEBRUARY 5, 2024

In this blog, we’re going to answer these questions and more. Walking you through the biggest challenges we have found when migrating our customer’s data from a legacy system to Snowflake. You’re in luck because this blog is for anyone ready to move or thinking about moving to Snowflake who wants to know what’s in store for them.

SQL 52

SQL Database Data Quality Data Warehouse 52

phData

NOVEMBER 8, 2024

Open Table Format (OTF) architecture now provides a solution for efficient data storage, management, and processing while ensuring compatibility across different platforms. In this blog, we will discuss: What is the Open Table format (OTF)? Amazon S3, Azure Data Lake, or Google Cloud Storage). Why should we use it?

Data Lakes 52

Data Lakes Data Warehouse Database Azure 52

phData

NOVEMBER 30, 2023

The Snowflake Data Cloud is a leading cloud data platform that provides various features and services for data storage, processing, and analysis. A new feature that Snowflake offers is the ability to create alerts based on data in Snowflake. Reach out today for advice, guidance, and best practices!

SQL 52

SQL Cloud Data Database ETL 52

phData

JANUARY 4, 2023

The Snowflake Data Cloud is a modern data warehouse that allows companies to take advantage of its cloud-based architecture to improve efficiencies while at the same time reducing costs. In this blog post, we will explore the reasons why many organizations are choosing to migrate from Netezza to Snowflake.

Data Warehouse 52

Data Warehouse SQL Database ETL 52

phData

JUNE 14, 2023

In this blog, we will explore the benefits of enabling the CI/CD pipeline for database platforms. We will specifically focus on how to enable it for the Snowflake cloud platform, taking into consideration the account and schema-level object hierarchy. Automating this process significantly reduces administrative burdens and cycle times.

Data Pipeline 52

Data Pipeline Database SQL Data Engineering 52

phData

MAY 25, 2023

One big issue that contributes to this resistance is that although Snowflake is a great cloud data warehousing platform, Microsoft has a data warehousing tool of its own called Synapse. The June 2021 release of Power BI Desktop introduced Custom SQL queries to Snowflake in DirectQuery mode.

Power BI 84

Power BI Analytics Analytics Azure 84

phData

MAY 11, 2023

There are many frameworks for testing software, but the right way to test the data and SQL scripts that change data are less obvious. This is because databases and the data therein are constantly changing. To truly test the effects of a deployment, you need to have an environment with the exact data that is in Production.

Database 52

Database SQL DataOps Data Warehouse 52

phData

DECEMBER 4, 2023

This blog was originally written by Erik Hyrkas and updated for 2024 by Justin Delisi This isn’t meant to be a technical how-to guide — most of those details are readily available via a quick Google search — but rather an opinionated review of key processes and potential approaches. And once again, for loading data, do not use SQL Inserts.

Clustering 98

Clustering Database SQL Data Pipeline 98

IBM Journey to AI blog

JULY 17, 2023

In this blog, I will cover: What is watsonx.ai? sales conversation summaries, insurance coverage, meeting transcripts, contract information) Generate: Generate text content for a specific purpose, such as marketing campaigns, job descriptions, blogs or articles, and email drafting support. What capabilities are included in watsonx.ai?

AI 74

AI AI Machine Learning Machine Learning 74