Data Science Blog

NOVEMBER 15, 2023

The creation of this data model requires the data connection to the source system (e.g. SAP ERP), the extraction of the data and, above all, the data modeling for the event log. DATANOMIQ Data Mesh Cloud Architecture – This image is animated! Central data models in a cloud-based Data Mesh Architecture (e.g.

Data Models 245

Data Models Data Modeling Business Intelligence Business Intelligence 245

phData

NOVEMBER 8, 2024

Data Versioning and Time Travel Open Table Formats empower users with time travel capabilities, allowing them to access previous dataset versions. The first insert statement loads data having c_custkey between 30001 and 40000 – INSERT INTO ib_customers2 SELECT *, '11111111111111' AS HASHKEY FROM snowflake_sample_data.tpch_sf1.customer

Data Lakes 52

Data Lakes Data Warehouse Database Azure 52

ODSC - Open Data Science

FEBRUARY 17, 2023

Cloud Computing, APIs, and Data Engineering NLP experts don’t go straight into conducting sentiment analysis on their personal laptops. BERT is still very popular over the past few years and even though the last update from Google was in late 2019 it is still widely deployed.

Deep Learning 111

Deep Learning Deep Learning Data Science Natural Language Processing 111

AWS Machine Learning Blog

MAY 15, 2023

We outline how we built an automated demand forecasting pipeline using Forecast and orchestrated by AWS Step Functions to predict daily demand for SKUs. On an ongoing basis, we calculate mean absolute percentage error (MAPE) ratios with product-based data, and optimize model and feature ingestion processes.

Algorithm 81

Algorithm Data Scientist Machine Learning Machine Learning 81

AWS Machine Learning Blog

OCTOBER 25, 2023

In this blog post, we show you how you can use Sentinel 2 satellite imagery hosted on the AWS Registry of Open Data in combination with Amazon SageMaker geospatial capabilities to detect point sources of CH4 emissions and monitor them over time. About the authors Dr. Karsten Schroer is a Solutions Architect at AWS.

Machine Learning 111

Machine Learning Machine Learning AWS ML 111

AWS Machine Learning Blog

APRIL 19, 2023

The DJL was created at Amazon and open-sourced in 2019. The DJL continues to grow in its ability to support different hardware, models, and engines. It also includes support for new hardware like ARM (both in servers like AWS Graviton and laptops with Apple M1 ) and AWS Inferentia.

ML 87

ML ML Deep Learning Deep Learning 87

Women in Big Data

JULY 10, 2023

She finished her second Masters in Computer Engineering and Cybersecurity in 2019 from San Jose State University. Security and Data Science are interlayered sciences that are used to create solutions for companies looking to protect themselves from cyber-criminal threats. Reena covered these two areas in the presentation.

Big Data 52

Big Data Big Data Data Science Data Engineering 52

AWS Machine Learning Blog

SEPTEMBER 19, 2023

It lets engineers provide simple data transformation functions, then handles running them at scale on Spark and managing the underlying infrastructure. This enables data scientists and data engineers to focus on the feature engineering logic rather than implementation details. SageMaker Studio set up.

ML 118

ML ML AWS SQL 118

Flipboard

FEBRUARY 2, 2023

Models were trained and cross-validated on the 2018, 2019, and 2020 seasons and tested on the 2021 season. Marc van Oudheusden is a Senior Data Scientist with the Amazon ML Solutions Lab team at Amazon Web Services. Marc van Oudheusden is a Senior Data Scientist with the Amazon ML Solutions Lab team at Amazon Web Services.

Cross Validation 123

Cross Validation ML ML Machine Learning 123

phData

JANUARY 31, 2024

Utilizing Streamlit as a Front-End At this point, we have all of our data processing, model training, inference, and model evaluation steps set up with Snowpark. Streamlit, an open-source Python package for building web-apps, has grown in popularity since its launch in 2019. Let’s continue by creating a front-end to enable analysts.

Machine Learning 52

Machine Learning Machine Learning Python Data Scientist 52

AWS Machine Learning Blog

FEBRUARY 5, 2024

According to health organizations such as the Centers for Disease Control and Prevention ( CDC ) and the World Health Organization ( WHO ), a spillover event at a wet market in Wuhan, China most likely caused the coronavirus disease 2019 (COVID-19). Janosch Woschitz is a Senior Solutions Architect at AWS, specializing in geospatial AI/ML.

ML 107

ML ML AWS Analytics 107

AWS Machine Learning Blog

FEBRUARY 10, 2023

Advances in neural information processing systems 32 (2019). Visualizing data using t-SNE.” He helps AWS customers identify and build ML solutions to address their business challenges in areas such as logistics, personalization and recommendations, computer vision, fraud prevention, forecasting and supply chain optimization.

ML 78

ML ML Machine Learning Machine Learning 78

The MLOps Blog

MARCH 20, 2023

These practices are essential for data scientists, data engineers, or machine learning engineers to provide a comprehensive guide for managing dataset versions in a project that is supposed to run for a long time. Data Management at Scale. This section explores best practices that address these challenges.

ML 59

ML ML Machine Learning Machine Learning 59

phData

MAY 25, 2023

The December 2019 release of Power BI Desktop introduced a native Snowflake connector that supported SSO and did not require driver installation. However, Snowflake runs better on Azure than it does on AWS – so even though it’s not the ideal situation, Microsoft still sees Azure consumption when organizations host Snowflake on Azure.

Power BI 84

Power BI Analytics Analytics Azure 84

Alation

FEBRUARY 8, 2022

Data mesh inverts the common model of having a centralized team (such as a data engineering team), who manage and transform data for wider consumption. In contrast to this common, centralized approach, a data mesh architecture calls for responsibilities to be distributed to the people closest to the data.

Data Governance 52

Data Governance Data Engineering Data Engineering Data Engineer 52