ODSC - Open Data Science

APRIL 23, 2025

Confluent Confluent provides a robust data streaming platform built around Apache Kafka. AI credits from Confluent can be used to implement real-time data pipelines, monitor data flows, and run stream-based ML applications. Modal Modal offers serverless compute tailored for data-intensive workloads.

Data Scientist 52

Data Scientist Azure Apache Kafka ML 52

AWS Machine Learning Blog

JANUARY 6, 2023

TR used AWS Glue DataBrew and AWS Batch jobs to perform the extract, transform, and load (ETL) jobs in the ML pipelines, and SageMaker along with Amazon Personalize to tailor the recommendations. Then the events are ingested into TR’s centralized streaming platform, which is built on top of Amazon Managed Streaming for Kafka (Amazon MSK).

AWS 100

AWS Data Warehouse ML ML 100

Pickl AI

NOVEMBER 4, 2024

They are responsible for building and maintaining data architectures, which include databases, data warehouses, and data lakes. Their work ensures that data flows seamlessly through the organisation, making it easier for Data Scientists and Analysts to access and analyse information.

Data Engineering 52

Data Engineering Data Engineer Data Engineering Data Engineering 52

Mlearning.ai

MAY 16, 2023

There are various architectural design patterns in data engineering that are used to solve different data-related problems. This article discusses five commonly used architectural design patterns in data engineering and their use cases. Finally, the transformed data is loaded into the target system.

Data Engineering 52

Data Engineering Data Engineer Data Engineering Data Engineering 52

Dataconomy

FEBRUARY 23, 2023

They are responsible for designing, building, and maintaining the infrastructure and tools needed to manage and process large volumes of data effectively. This involves working closely with data analysts and data scientists to ensure that data is stored, processed, and analyzed efficiently to derive insights that inform decision-making.

Big Data 91

Big Data Big Data Data Engineering Data Engineer 91

ODSC - Open Data Science

OCTOBER 9, 2024

Confirmed sessions related to software engineering include: Building Data Contracts with Open-Source Tools Chronon — Open Source Data Platform for AI/ML Creating APIs That Data Scientists Will Love with FastAPI, SQLAlchemy, and Pydantic Using APIs in Data Science Without Breaking Anything Don’t Go Over the Deep End: Building an Effective OSS Management (..)

Apache Kafka 40

Apache Kafka AI AI Machine Learning 40

DagsHub

APRIL 7, 2024

Image generated with Midjourney In today’s fast-paced world of data science, building impactful machine learning models relies on much more than selecting the best algorithm for the job. Data scientists and machine learning engineers need to collaborate to make sure that together with the model, they develop robust data pipelines.

Machine Learning 59

Machine Learning Machine Learning ML ML 59