Data Science Blog

NOVEMBER 15, 2023

New big data architectures and, above all, data sharing concepts such as Data Mesh are ideal for creating a common database for many data products and applications. The Event Log Data Model for Process Mining Process Mining as an analytical system can very well be imagined as an iceberg.

Data Models 245

Data Models Data Modeling Business Intelligence Business Intelligence 245

phData

JUNE 13, 2023

While the front-end report visuals are important and the most visible to end users, a lot goes on behind the scenes that contribute heavily to the end product, including data modeling. In this blog, we’ll describe data modeling and its significance in Power BI. What is Data Modeling?

Power BI 93

Power BI Data Models Data Modeling Data Warehouse 93

Towards AI

NOVEMBER 12, 2024

Sources of Hallucinations: Generalized Training Data: Models trained on non-specialized data may lack depth in healthcare-specific contexts.Probabilistic Generation: LLMs generate text based on probability, which sometimes leads them to select… Read the full blog for free on Medium.

AI 111

AI AI Data Models Data Modeling 111

Dataversity

JANUARY 18, 2021

So, I had to cut down my January 2021 list of things of importance in Data Modeling in this new, fine year (I hope)! The post 2021: Three Game-Changing Data Modeling Perspectives appeared first on DATAVERSITY. Common wisdom has it that we humans can only focus on three things at a time.

Data Models 98

Data Models Data Modeling Database SQL 98

Dataversity

MAY 29, 2023

A unified data model allows businesses to make better-informed decisions. By providing organizations with a more comprehensive view of the data sources they’re using, which makes it easier to understand their customers’ experiences. appeared first on DATAVERSITY.

Data Models 90

Data Models Data Modeling 90

The Data Administration Newsletter

JUNE 15, 2021

Data Governance describes the practices and processes organizations use to manage the access, use, quality and security of an organizations data assets. The data-driven business era has seen a rapid rise in the value of organization’s data resources.

Data Governance 105

Data Governance Data Models Data Modeling 105

Towards AI

FEBRUARY 7, 2024

What is the purpose of this… Read the full blog for free on Medium. Join thousands of data leaders on the AI newsletter. Convert these to a string: df['a'] = 'a' + df['a'].astype(str)df['b'] astype(str)df['b'] = 'b' + df['b'].astype(str)df['c']

Data Models 111

Data Models Data Modeling Algorithm AI 111

Data Science Connect

JANUARY 27, 2023

It is the process of collecting, storing, managing, and analyzing large amounts of data, and data engineers are responsible for designing and implementing the systems and infrastructure that make this possible. Learn about data modeling: Data modeling is the process of creating a conceptual representation of data.

Data Engineering 130

Data Engineering Data Engineer Data Engineering Data Engineering 130

phData

JULY 18, 2023

Throughout my analytics journey, I’ve encountered all sorts of data models, from simple to incredibly complex. I’ve also helped everyone, from data newbies and data experts, implement a wide range of solutions in Sigma Computing. Benefits Enhanced flexibility for modeling and data changes.

Data Models 52

Data Models Data Modeling Database Data Analysis 52

The Data Administration Newsletter

JUNE 20, 2023

These days, there is much conversation about the necessity of the data model. The data model has been around for several decades now and can be classified as an artifact of an earlier day and age. But is the data model really out of date? And exactly why do we need a data model, anyway? […]

Data Models 52

Data Models Data Modeling Data Governance 52

Pickl AI

JUNE 28, 2023

Data is driving most business decisions. In this, data modeling tools play a crucial role in developing and maintaining the information system. Moreover, it involves the creation of a conceptual representation of data and its relationship. Data modeling tools play a significant role in this.

Data Models 52

Data Models Data Modeling Database SQL 52

Dataversity

MAY 31, 2024

In the contemporary business environment, the integration of data modeling and business structure is not only advantageous but crucial. This dynamic pair of documents serves as the foundation for strategic decision-making, providing organizations with a distinct pathway toward success.

Data Models 52

Data Models Data Modeling 52

Dataversity

FEBRUARY 5, 2024

Therefore, it was just a matter of time before this chess-inspired outlook permeated my professional life as a data practitioner. In both chess and data modeling, the […] The post Data’s Chess Game: Strategic Moves in Data Modeling for Competitive Advantage appeared first on DATAVERSITY.

Data Models 59

Data Models Data Modeling 59

phData

SEPTEMBER 19, 2023

However, to fully harness the potential of a data lake, effective data modeling methodologies and processes are crucial. Data modeling plays a pivotal role in defining the structure, relationships, and semantics of data within a data lake. Consistency of data throughout the data lake.

Data Lakes 52

Data Lakes Data Models Data Modeling Data Warehouse 52

Dataversity

FEBRUARY 14, 2024

This requires a strategic approach, in which CxOs should define business objectives, prioritize data quality, leverage technology, build a data-driven culture, collaborate with […] The post Facing a Big Data Blank Canvas: How CxOs Can Avoid Getting Lost in Data Modeling Concepts appeared first on DATAVERSITY.

Big Data 59

Big Data Big Data Data Models Data Modeling 59

Towards AI

JANUARY 11, 2024

Tabular data is the data in the typical table — some columns and rows are structured well, like in Excel or SQL data. It's the most common usage of data forms in many data use cases. With the power of LLM, we would learn how to explore the data and perform data modeling. How do we do?

Clean Data 126

Clean Data Python SQL Data Science 126

IBM Journey to AI blog

MAY 29, 2024

Designing data models and generating Entity-Relationship Diagrams (ERDs) demand significant effort and expertise. Data model creation : Based on use cases and user stories, watsonx can generate robust data models representing the software’s data structure.

Data Models 87

Data Models Data Modeling Database AI 87

Data Science Blog

SEPTEMBER 19, 2023

This ensures that the data models and queries developed by data professionals are consistent with the underlying infrastructure. Enhanced Security and Compliance Data Warehouses often store sensitive information, making security a paramount concern. appeared first on Data Science Blog.

Data Warehouse 259

Data Warehouse Azure SQL Database 259

Cassie Kozyrkov

NOVEMBER 13, 2024

This blog post, however, is sponsored by Intel, not espresso because… there I was, an AI person without an AI laptop. One of the things I’m excited to do with them is take some of my time series data modeling off the cloud. It turns out I’m an espresso-based lifeform.)

AI 100

AI AI Natural Language Processing Data Modeling 100

Dataversity

AUGUST 12, 2024

One of the most important questions about using AI responsibly has very little to do with data, models, or anything technical. How can […] The post Ask a Data Ethicist: How Can We Set Realistic Expectations About AI? It has to do with the power of a captivating story about magical thinking.

AI 105

AI AI Data Models Data Modeling 105

Towards AI

JULY 17, 2024

I’m not going to go into huge details on this as if you follow AI / LLM (which I assume you do if you are reading this) but in a nutshell, RAG is the process whereby you feed external data into an LLM alongside prompts to ensure it has all of the information it needs to make decisions. What is GraphRAG? Why use Graphs and what are they?

Database 111

Database Data Modeling Data Models SQL 111

Data Science Dojo

FEBRUARY 9, 2023

Data is an essential component of any business, and it is the role of a data analyst to make sense of it all. Power BI is a powerful data visualization tool that helps them turn raw data into meaningful insights and actionable decisions. Check out this course and learn Power BI today!

Power BI 221

Power BI Data Analyst Data Visualization Data Analysis 221

AWS Machine Learning Blog

DECEMBER 9, 2024

For your reference, this blog post demonstrates a solution to create a VPC with no internet connection using an AWS CloudFormation template. Run ML experimentation with MLflow using the @remote decorator from the open-source SageMaker Python SDK. The overall solution architecture is shown in the following figure.

AWS 97

AWS ML ML Data Scientist 97

Data Science Dojo

JULY 12, 2023

In this blog, we’ll explore the defining traits, benefits, use cases, and key factors to consider when choosing between SQL and NoSQL databases. SQL or NoSQL SQL Database SQL databases are relational databases that store data in tables. So, let’s dive in!

SQL 195

SQL Database Big Data Big Data 195

Data Science Dojo

JANUARY 10, 2023

Data science myths are one of the main obstacles preventing newcomers from joining the field. In this blog, we bust some of the biggest myths shrouding the field. The US Bureau of Labor Statistics predicts that data science jobs will grow up to 36% by 2031.

Data Science 195

Data Science Data Scientist Data Analyst Machine Learning 195

IBM Journey to AI blog

APRIL 5, 2024

An industry-standard data model A uniform data model is necessary to get a full view of combined systems with information flowing across the ecosystem. Technical, financial, geographical, operational and transactional data attributes are all parts of a data structure.

Data Models 82

Data Models Data Modeling Machine Learning Machine Learning 82

IBM Journey to AI blog

JUNE 28, 2024

In a previous blog, we presented the three-layered model for efficient network operations. The main challenges in the context of applying generative AI across these layers are: Data layer : Generative AI initiatives are data projects at their core, with inadequate data comprehension being one of the primary complexities.

AI 86

AI AI Analytics Analytics 86

phData

SEPTEMBER 11, 2023

Row-level security is a powerful data governance capability across many business intelligence platforms, and Power BI is no exception. In this blog, we will provide a high-level summary of row-level security, why it’s important for your team, when to use it, and how to set it up in Power BI. In the new window, click Manage roles.

Power BI 101

Power BI Data Models Data Modeling Data Governance 101

IBM Journey to AI blog

MARCH 29, 2024

Enterprise applications serve as repositories for extensive data models, encompassing historical and operational data in diverse databases. Generative AI foundational models train on massive amounts of unstructured and structured data, but the orchestration is critical to success.

AI 104

AI AI Artificial Intelligence Artificial Intelligence 104

IBM Journey to AI blog

APRIL 18, 2023

ISO 20022 data improves payment efficiency The impact of ISO 20022 on payment systems data is significant, as it allows for more detailed information in payment messages. appeared first on IBM Blog. Talk to the IBM Payments Center team The post ISO 20022: Are your payment systems ready?

Analytics 131

Analytics Analytics Data Modeling Data Models 131

Data Science Dojo

JANUARY 16, 2023

Every individual analysis the data obtained via their experience to generate a final decision. Put more concretely, data analysis involves sifting through data, modeling it, and transforming it to yield information that guides strategic decision-making.

Data Analysis 195

Data Analysis Data Analysis Data Analyst Big Data 195

IBM Journey to AI blog

APRIL 8, 2024

Acquisitions and mergers Consider this fictional example: A company that sells three-wheeled cars has created a robust data model where it is easy to get to any piece of data and the format is understood across the business. The new company’s data model is completely different from the original company.

Data Governance 71

Data Governance Data Models Data Modeling AI 71

Data Science Blog

AUGUST 22, 2024

Just as a chef’s masterpiece depends on the quality of the ingredients, your AI outcomes will depend on the data you prepare. Investing in your data can only lead to positive results. The post Looking Ahead: The Future of Data Preparation for Generative AI appeared first on Data Science Blog.

Data Preparation 130

Data Preparation Data Quality AI AI 130

AWS Machine Learning Blog

NOVEMBER 6, 2024

For the past 20 years, he has been helping customers build enterprise data strategies, advising them on Generative AI, cloud implementations, migrations, reference architecture creation, data modeling best practices, and data lake/warehouse architectures.

AWS 118

AWS Python Machine Learning Machine Learning 118

phData

AUGUST 29, 2023

This blog was written by Spencer Baucke and updated for 2023 by Gavin Pedersen. Letting your Power BI data model get disorganized is a feeling every Power BI developer knows all too well, and it’s something that can occur very quickly when developing. Open the model view by clicking the data model icon on the left.

Power BI 52

Power BI Data Models Data Modeling 52

phData

MARCH 22, 2023

Sigma Computing’s Metrics are a powerful tool for simplifying this complexity and making it easier for business users to access and understand data. In this blog, we will explore what Metrics are, how they work, and why they should be used in data modeling. appeared first on phData.

Data Models 52

Data Models Data Modeling Data Quality Database 52

Hacker News

JULY 18, 2023

What if you could automatically shard your PostgreSQL database across any number of servers and get industry-leading performance at scale without any special data modelling steps? In this blog post, you’ll get a high-level overview of schema-based sharding and other new Citus 12 features: What is schema-based sharding?

Database 123

Database SQL Data Modeling Data Models 123