Smart Data Collective

APRIL 29, 2020

Usually the term refers to the practices, techniques and tools that allow access and delivery through different fields and data structures in an organisation. Data management approaches are varied and may be categorised in the following: Cloud data management. Master data management. Microsoft Azure.

Data Warehouse 98

Data Warehouse SQL Azure ETL 98

Data Science Dojo

SEPTEMBER 11, 2024

With this full-fledged solution, you don’t have to spend all your time and effort combining different services or duplicating data. OneLake, being built on Azure Data Lake Storage (ADLS), supports various data formats, including Delta, Parquet, CSV, and JSON.

Power BI 250

Power BI Data Pipeline Data Warehouse Data Engineering 250

Data Science Blog

NOVEMBER 15, 2023

Example Event Log for Process Mining The following example SQL-query is inserting Event-Activities from a SAP ERP System into an existing event log database table. They enable quicker data processing and decision-making, support advanced analytics and AI with standardized data formats, and are adaptable to changing business needs.

Data Models 245

Data Models Data Modeling Business Intelligence Business Intelligence 245

IBM Journey to AI blog

MAY 12, 2023

IBM’s recommendations included API-specific improvements, bot UX optimization, workflow optimization, DevOps microservices and design consideration, and best practices for Azure manage services.

Azure 93

Azure Database Clustering Data Visualization 93

Data Science Blog

SEPTEMBER 3, 2024

Celonis unterscheidet sich von den meisten anderen Tools noch dahingehend, dass es versucht, die ganze Kette des Process Minings in einer einzigen und ausschließlichen Cloud-Anwendung in einer Suite bereitzustellen. auf den Analyse-Ressourcen der Microsoft Azure Cloud oder in auf der databricks-Plattform.

Data Science 130

Data Science Power BI Azure Data Warehouse 130

phData

MAY 25, 2023

One big issue that contributes to this resistance is that although Snowflake is a great cloud data warehousing platform, Microsoft has a data warehousing tool of its own called Synapse. In a perfect world, Microsoft would have clients push even more storage and compute to its Azure Synapse platform.

Power BI 84

Power BI Analytics Analytics Azure 84

Data Science Dojo

JULY 3, 2024

Big Data Technologies : Handling and processing large datasets using tools like Hadoop, Spark, and cloud platforms such as AWS and Google Cloud. Data Processing and Analysis : Techniques for data cleaning, manipulation, and analysis using libraries such as Pandas and Numpy in Python.

Data Science 150

Data Science Machine Learning Machine Learning Data Visualization 150

phData

APRIL 29, 2024

Fivetran enables healthcare organizations to ingest data securely and effectively from a variety of sources into their target destinations, such as Snowflake or other cloud data platforms, for further analytics or curation for sharing data with external providers or customers.

SQL 52

SQL Data Warehouse Azure Cloud Data 52

IBM Journey to AI blog

SEPTEMBER 11, 2023

Codd published his famous paper “ A Relational Model of Data for Large Shared Data Banks.” Boyce to create Structured Query Language (SQL). Developers can leverage features like REST APIs, JSON support and enhanced SQL compatibility to easily build cloud-native applications. Chamberlin and Raymond F.

Database 101

Database SQL Data Warehouse Machine Learning 101

phData

NOVEMBER 8, 2024

Versioning also ensures a safer experimentation environment, where data scientists can test new models or hypotheses on historical data snapshots without impacting live data. Note : Cloud Data warehouses like Snowflake and Big Query already have a default time travel feature.

Data Lakes 52

Data Lakes Data Warehouse Database Azure 52

phData

SEPTEMBER 2, 2024

Matillion is a SaaS-based data integration platform that can be hosted in AWS, Azure, or GCP. It offers a cloud-agnostic data productivity hub called Matillion Data Productivity Cloud. This will ensure if anyone is rerunning the entire job after resolving the failure, data duplication won’t happen.

ETL 52

ETL Data Warehouse SQL Database 52

phData

FEBRUARY 14, 2023

Fivetran works with all three Snowflake cloud providers. If using a network policy with Snowflake, be sure to add Fivetran’s IP address list , which will ensure Azure Data Factory (ADF) Azure Data Factory is a fully managed, serverless data integration service built by Microsoft.

Data Warehouse 59

Data Warehouse Azure AWS Database 59

phData

DECEMBER 4, 2023

However, if there’s one thing we’ve learned from years of successful cloud data implementations here at phData, it’s the importance of: Defining and implementing processes Building automation, and Performing configuration …even before you create the first user account. And once again, for loading data, do not use SQL Inserts.

Clustering 98

Clustering Database SQL Data Pipeline 98

DataRobot Blog

MARCH 17, 2022

DataRobot AI Cloud 8.0 DataRobot For the AI-driven Business: Empower Your Business with No-Code Solutions that Deliver Timely, Continuous, and Trusted Insights from more of Your Data. DataRobot AI Cloud 8.0 Together, these new capabilities will help every business more intelligently navigate the most unpredictable of markets.

AI 52

AI AI Machine Learning Machine Learning 52

Mlearning.ai

FEBRUARY 16, 2023

The platform enables quick, flexible, and convenient options for storing, processing, and analyzing data. The solution was built on top of Amazon Web Services and is now available on Google Cloud and Microsoft Azure. Therefore, the tool is referred to as cloud-agnostic. What does Snowflake do?

Data Warehouse 52

Data Warehouse Business Intelligence Business Intelligence Database 52

phData

MAY 4, 2023

Cloud-Based Computing While Teradata was once successful at managing and analyzing large data sets, the growing volume, variety, and speed of data now require more advanced data analytics provided by cloud-based solutions. This can make it easier for companies to build a comprehensive, cloud-based data stack.

SQL 52

SQL Data Warehouse Azure Big Data 52

phData

MAY 11, 2023

There are many frameworks for testing software, but the right way to test the data and SQL scripts that change data are less obvious. This is because databases and the data therein are constantly changing. To truly test the effects of a deployment, you need to have an environment with the exact data that is in Production.

Database 52

Database SQL DataOps Data Warehouse 52

phData

JUNE 3, 2024

Snowflake AI Data Cloud has become a premier cloud data warehousing solution. Maybe you’re just getting started looking into a cloud solution for your organization, or maybe you’ve already got Snowflake and are wondering what features you’re missing out on. Snowflake has you covered with Cortex.

Machine Learning 52

Machine Learning Machine Learning Database Cloud Data 52

Alation

APRIL 14, 2022

This two-part series will explore how data discovery, fragmented data governance , ongoing data drift, and the need for ML explainability can all be overcome with a data catalog for accurate data and metadata record keeping. The Cloud Data Migration Challenge. Data pipeline orchestration.

Data Governance 59

Data Governance ML ML Cloud Data 59

phData

AUGUST 6, 2024

Organizations must ensure their data pipelines are well designed and implemented to achieve this, especially as their engagement with cloud data platforms such as the Snowflake Data Cloud grows. For customers in Snowflake, Snowpark is a powerful tool for building these effective and scalable data pipelines.

Data Pipeline 52

Data Pipeline Python Data Engineering Data Engineer 52

Alation

FEBRUARY 8, 2022

Examples include public cloud vendors like AWS, Azure, and GCP. Plane 2: Data Product Developer Experience Plane. This plane uses “ declarative interfaces to manage the lifecycle of a data product ” to help developers, for example, build, deploy, and monitor data products.

Data Governance 52

Data Governance Data Engineering Data Engineer Data Engineering 52

phData

SEPTEMBER 27, 2024

Some modern CDPs are starting to incorporate these concepts, allowing for more flexible and evolving customer data models. It also requires a shift in how we query our customer data. Instead of simple SQL queries, we often need to use more complex temporal query languages or rely on derived views for simpler querying.

Data Modeling 52

Data Modeling Data Models Apache Kafka Data Lakes 52

phData

OCTOBER 28, 2024

Understanding Matillion and Snowflake, the Python Component, and Why it is Used Matillion is a SaaS-based data integration platform that can be hosted in AWS, Azure, or GCP and supports multiple cloud data warehouses. Matillion supports writing code in Python, Bash Script, and native ANSI SQL commands.

Python 52

Python ETL AWS Database 52

Women in Big Data

DECEMBER 9, 2024

Lookers strength lies in its ability to connect to a wide variety of data sources. Examples include SQl, DWH, and Cloud based systems (Google Bigquery). With Looker, you can share dashboards and visualizations seamlessly across teams, providing stakeholders with access to real-time data.

Big Data 52

Big Data Big Data Power BI Tableau 52

phData

JULY 18, 2023

With the birth of cloud data warehouses, data applications, and generative AI , processing large volumes of data faster and cheaper is more approachable and desired than ever. First up, let’s dive into the foundation of every Modern Data Stack, a cloud-based data warehouse.

Data Warehouse 52

Data Warehouse Analytics Analytics SQL 52

Alation

JULY 18, 2022

And the highlight, for us data intelligence folks, was the Databricks’ announcement that Unity Catalog , its unified governance solution for all data assets on its Lakehouse platform, will soon be available on AWS and Azure in the upcoming weeks. A simple model to control access to data via a UI or SQL.

AI 52

AI AI Data Lakes Azure 52