IBM Journey to AI blog

JANUARY 10, 2023

Background on the Netezza Performance Server capability demo. This allows data that exists in cloud object storage to be easily combined with existing data warehouse data without data movement. Prerequisites for the demo.

Data Warehouse 52

Data Warehouse Data Analysis Data Analysis SQL 52

IBM Journey to AI blog

SEPTEMBER 25, 2023

Every day, millions of riders use the Uber app, unwittingly contributing to a complex web of data-driven decisions. This blog takes you on a journey into the world of Uber’s analytics and the critical role that Presto, the open source SQL query engine, plays in driving their success. What is Presto?

Data Lakes 102

Data Lakes Analytics Analytics Clustering 102

Alation

FEBRUARY 7, 2023

There was a software product demo showcasing its ability to scan every layer of your application code, and I was intrigued to see how it worked. It wouldn’t be until 2013 that the topic of data lineage would surface again – this time while working on a data warehouse project. Twenty years ago, I saw into the future.

Data Warehouse 52

Data Warehouse ETL Business Intelligence Business Intelligence 52

phData

NOVEMBER 28, 2024

“ Vector Databases are completely different from your cloud data warehouse.” – You might have heard that statement if you are involved in creating vector embeddings for your RAG-based Gen AI applications. We have loaded this data into an input table named – TEXT_INPUT as a VARCHAR column named TEXTDATA in Snowflake.

Python 52

Python Database SQL Machine Learning 52

IBM Journey to AI blog

NOVEMBER 3, 2023

When you make it easier to work with events, other users like analysts and data engineers can start gaining real-time insights and work with datasets when it matters most. As a result, you reduce the skills barrier and increase your speed of data processing by preventing important information from getting stuck in a data warehouse.

Apache Kafka 79

Apache Kafka Data Warehouse Data Pipeline Big Data 79

phData

AUGUST 22, 2024

Snowflake Cortex stood out as the ideal choice for powering the model due to its direct access to data, intuitive functionality, and exceptional performance in handling SQL tasks. I used a demo project that I frequently work with and introduced syntax errors and data quality problems.

SQL 52

SQL Data Quality Python Data Warehouse 52

Alation

MAY 24, 2022

Prime examples of this in the data catalog include: Trust Flags — Allow the data community to endorse, warn, and deprecate data to signal whether data can or can’t be used. Data Profiling — Statistics such as min, max, mean, and null can be applied to certain columns to understand its shape. Book a demo today.

Data Quality 98

Data Quality Data Governance ETL Data Observability 98

The MLOps Blog

OCTOBER 20, 2023

Example template for an exploratory notebook | Source: Author How to organize code in Jupyter notebook For exploratory tasks, the code to produce SQL queries, pandas data wrangling, or create plots is not important for readers. in a pandas DataFrame) but in the company’s data warehouse (e.g., documentation.

SQL 52

SQL Database Data Scientist Python 52

phData

MARCH 1, 2024

This process introduces considerable time and effort into the overall data ingestion workflow, delaying the availability of data to end consumers. Fortunately, the client has opted for Snowflake Data Cloud as their target data warehouse. The Snowflake account is set up with a demo database and schema to load data.

Data Engineer 52

Data Engineer Data Engineering Data Engineering Data Engineering 52

Pickl AI

APRIL 26, 2024

This comprehensive blog outlines vital aspects of Data Analyst interviews, offering insights into technical, behavioural, and industry-specific questions. It covers essential topics such as SQL queries, data visualization, statistical analysis, machine learning concepts, and data manipulation techniques.

Data Analyst 52

Data Analyst Data Analysis Data Analysis Machine Learning 52

Alation

SEPTEMBER 7, 2021

Organizations need to ensure that data use adheres to policies (both organizational and regulatory). In an ideal world, you’d get compliance guidance before and as you use the data. Imagine writing a SQL query or using a BI dashboard with flags & warnings on compliance best practice within your natural workflow.

Data Governance 59

Data Governance Data Scientist Data Quality Data Profiling 59

Snorkel AI

JANUARY 24, 2023

Snowpark, which is Snowflake’s developer framework that extends the benefits of the Data Cloud beyond SQL to Python, Scala, and Java, can be used to scale batch inference across your Snowflake data warehouse. Schedule a custom demo tailored to your use case with our ML experts today.

AI 52

AI AI ML ML 52

Snorkel AI

JANUARY 24, 2023

Snowpark, which is Snowflake’s developer framework that extends the benefits of the Data Cloud beyond SQL to Python, Scala, and Java, can be used to scale batch inference across your Snowflake data warehouse. Schedule a custom demo tailored to your use case with our ML experts today.

AI 52

AI AI ML ML 52

IBM Journey to AI blog

MARCH 14, 2024

  Request a live demo or start a proof of concept with Amazon RDS for Db2 Db2 Warehouse SaaS on AWS The cloud-native Db2 Warehouse fulfills your price and performance objectives for mission-critical operational analytics, business intelligence (BI) and mixed workloads. . With

AWS 93

AWS Database ETL AI 93

phData

OCTOBER 25, 2024

Data Quality Monitoring implements quality checks in operational data processes to ensure that the data meets pre-defined standards and business rules. This results in poor credibility and data consistency after some time, leading businesses to mistrust the data pipelines and processes.

Data Quality 52

Data Quality Data Pipeline Data Governance Database 52

Alation

JUNE 20, 2023

By then I had converted that small Heights data dictionary to the Snowflake sources. But everything CURO was still on SQL. Will: CURO was primarily a Microsoft SQL house and still is in some ways. We did have an existing data warehouse solution, but it was so rarely used by outside teams, and I can’t even remember the name.

Data Governance 52

Data Governance Database SQL Data Engineer 52

Alation

SEPTEMBER 6, 2022

Michael: I saw the actual product demo, and Aaron Kalb showed me a working version of Compose – our intelligent SQL editor. He also shared the data catalog, along with his vision for what Alation wanted the world of data to be and how that would solve pain points for people. At first I told him, no way!

Database 52

Database Data Warehouse Computer Science Computer Science 52

phData

NOVEMBER 13, 2023

If you want to know more about data mesh, check out these links: What is dbt Mesh & How to Adopt It dbt Labs’ Perspective on Data Mesh How we build our dbt Mesh Projects Data Mesh Architecture: How did we get here? What are the four principles of data mesh?

Database 52

Database Business Intelligence Business Intelligence Data Silos 52