ODSC - Open Data Science

MAY 31, 2023

Be sure to check out his talk, “ Apache Kafka for Real-Time Machine Learning Without a Data Lake ,” there! The combination of data streaming and machine learning (ML) enables you to build one scalable, reliable, but also simple infrastructure for all machine learning tasks using the Apache Kafka ecosystem.

Data Lakes 131

Data Lakes Machine Learning Machine Learning Apache Kafka 131

Pickl AI

DECEMBER 4, 2024

The field has evolved significantly from traditional statistical analysis to include sophisticated Machine Learning algorithms and Big Data technologies. Issues such as algorithmic bias, data privacy, and transparency are becoming critical topics of discussion within the industry.

Data Science 52

Data Science Data Scientist Machine Learning Machine Learning 52

Pickl AI

DECEMBER 2, 2024

For example, financial institutions utilise high-frequency trading algorithms that analyse market data in milliseconds to make investment decisions. Cloud Storage: Services like Amazon S3, Google Cloud Storage, and Microsoft Azure Blob Storage provide scalable storage solutions that can accommodate massive datasets with ease.

Big Data 52

Big Data Big Data Data Lakes Apache Hadoop 52

Pickl AI

NOVEMBER 25, 2024

For example, financial institutions utilise high-frequency trading algorithms that analyse market data in milliseconds to make investment decisions. Cloud Storage: Services like Amazon S3, Google Cloud Storage, and Microsoft Azure Blob Storage provide scalable storage solutions that can accommodate massive datasets with ease.

Big Data 52

Big Data Big Data Data Lakes Apache Hadoop 52

DagsHub

OCTOBER 23, 2024

Popular data lake solutions include Amazon S3 , Azure Data Lake , and Hadoop. Apache Kafka Apache Kafka is a distributed event streaming platform for real-time data pipelines and stream processing. Data Processing Tools These tools are essential for handling large volumes of unstructured data.

Machine Learning 52

Machine Learning Machine Learning Data Lakes AI 52

Data Science Dojo

MARCH 9, 2023

Data Science Dojo is offering Memphis broker for FREE on Azure Marketplace preconfigured with Memphis, a platform that provides a P2P architecture, scalability, storage tiering, fault-tolerance, and security to provide real-time processing for modern applications suitable for large volumes of data.

Apache Kafka 284

Apache Kafka Azure Data Science Data Pipeline 284

phData

SEPTEMBER 27, 2024

Technologies like Apache Kafka, often used in modern CDPs, use log-based approaches to stream customer events between systems in real-time. This can be invaluable for auditing your marketing efforts, debugging personalization algorithms, or reprocessing customer data later when you have new ideas for segmentation or analysis.

Data Modeling 52

Data Modeling Data Models Apache Kafka Data Lakes 52