IBM Journey to AI blog

SEPTEMBER 4, 2024

Producers and consumers A ‘producer’, in Apache Kafka architecture, is anything that can create data—for example a web server, application or application component, an Internet of Things (IoT) , device and many others. Here are a few of the most striking examples.

Apache Kafka 59

Apache Kafka Internet of Things Data Pipeline Clustering 59

IBM Journey to AI blog

AUGUST 6, 2024

Today, all leading CSPs, including Amazon Web Services (AWS Lambda), Microsoft Azure (Azure Functions) and IBM (IBM Cloud Code Engine) offer serverless platforms. Today, serverless helps developers build scalable big data pipelines without having to manage the underlying infrastructure.

Cloud Computing 45

Cloud Computing Internet of Things Big Data Big Data 45

Smart Data Collective

SEPTEMBER 21, 2021

Recognizing the potential of data, organizations are trying to extract values from their data in various ways to create new revenue streams and reduce the cost and resources required for operations. The increased amounts and types of data, stored in various locations eventually made the management of data more challenging.

Data Quality 108

Data Quality Data Pipeline Database Internet of Things 108

The MLOps Blog

FEBRUARY 5, 2023

This pipeline facilitates the smooth, automated flow of information, preventing many problems that enterprises face, such as data corruption, conflict, and duplication of data entries. A streaming data pipeline is an enhanced version which is able to handle millions of events in real-time at scale. Happy Learning!

Machine Learning 72

Machine Learning Machine Learning Data Pipeline Apache Kafka 72