IBM Journey to AI blog

SEPTEMBER 4, 2024

Apache Kafka is an open-source , distributed streaming platform that allows developers to build real-time, event-driven applications. With Apache Kafka, developers can build applications that continuously use streaming data records and deliver real-time experiences to users. How does Apache Kafka work?

Apache Kafka 59

Apache Kafka Internet of Things Data Pipeline Clustering 59

Analytics Vidhya

SEPTEMBER 22, 2022

Dale Carnegie” Apache Kafka is a Software Framework for storing, reading, and analyzing streaming data. The Internet of Things(IoT) devices can generate a large […]. Introduction “Learning is an active process. We learn by doing. Only knowledge that is used sticks in your mind.-

Data Pipeline 255

Data Pipeline Apache Kafka Internet of Things Data Science 255

ODSC - Open Data Science

MAY 31, 2023

Be sure to check out his talk, “ Apache Kafka for Real-Time Machine Learning Without a Data Lake ,” there! The combination of data streaming and machine learning (ML) enables you to build one scalable, reliable, but also simple infrastructure for all machine learning tasks using the Apache Kafka ecosystem.

Data Lakes 131

Data Lakes Machine Learning Machine Learning Apache Kafka 131

Data Science Dojo

JULY 24, 2023

Internet of Things (IoT) Data Processing: Stream processing is vital for handling continuous data streams from IoT devices, enabling real-time monitoring and control. Fraud Detection: Stream processing allows the identification of fraudulent activities in real-time, helping prevent financial losses and ensuring data security.

Big Data 195

Big Data Big Data Data Engineering Data Engineer 195

Pickl AI

JULY 24, 2023

Real-Time Data Ingestion Examples Here are some examples of real-time data ingestion applications: Internet of Things (IoT) Devices: IoT devices generate a vast amount of data, such as temperature, humidity, location, and sensor readings.

Internet of Things 52

Internet of Things Apache Kafka ETL Azure 52

Pickl AI

JULY 30, 2024

ETL (Extract, Transform, Load) Processes Apache NiFi can streamline ETL processes by extracting data from multiple sources, transforming it into the desired format, and loading it into target systems such as data warehouses or databases. Its visual interface allows users to design complex ETL workflows with ease.

ETL 52

ETL Data Lakes Big Data Big Data 52

Pickl AI

JULY 29, 2024

Internet of Things (IoT) Hadoop clusters can handle the massive amounts of data generated by IoT devices, enabling real-time processing and analysis of sensor data. Limited Support for Real-Time Processing While Hadoop excels at batch processing, it is not inherently designed for real-time data processing.

Hadoop 52

Hadoop Clustering Big Data Big Data 52