Analytics Vidhya

SEPTEMBER 22, 2022

This article was published as a part of the Data Science Blogathon. Dale Carnegie” Apache Kafka is a Software Framework for storing, reading, and analyzing streaming data. The post Build a Simple Realtime Data Pipeline appeared first on Analytics Vidhya. We learn by doing.

Data Pipeline 270

Data Pipeline Apache Kafka Internet of Things Data Science 270

Dataconomy

MAY 26, 2017

Data processing today is done in form of pipelines which include various steps like aggregation, sanitization, filtering and finally generating insights by applying various statistical models. Amazon Kinesis is a platform to build pipelines for streaming data at the scale of terabytes per hour.

Apache Kafka 155

Apache Kafka Big Data Big Data Data Analysis 155

IBM Journey to AI blog

NOVEMBER 3, 2023

It allows your business to ingest continuous data streams as they happen and bring them to the forefront for analysis, enabling you to keep up with constant changes. Apache Kafka boasts many strong capabilities, such as delivering a high throughput and maintaining a high fault tolerance in the case of application failure.

Apache Kafka 79

Apache Kafka Data Warehouse Data Pipeline Big Data 79

ODSC - Open Data Science

APRIL 23, 2025

In todays fast-moving machine learning and AI landscape, access to top-tier tools and infrastructure is a game-changer for any data science team. At ODSC East 2025 , were proud to partner with leading AI and data companies offering these credits to help data professionals test, build, and scale their work.

Data Scientist 52

Data Scientist Azure Apache Kafka ML 52

Pickl AI

JULY 8, 2024

Summary: This blog explains how to build efficient data pipelines, detailing each step from data collection to final delivery. Introduction Data pipelines play a pivotal role in modern data architecture by seamlessly transporting and transforming raw data into valuable insights.

Data Pipeline 52

Data Pipeline Data Quality Database Apache Kafka 52

ODSC - Open Data Science

FEBRUARY 6, 2024

Spark offers a versatile range of functionalities, from batch processing to stream processing, making it a comprehensive solution for complex data challenges. Apache Kafka For data engineers dealing with real-time data, Apache Kafka is a game-changer.

Data Engineering 52

Data Engineering Data Engineer Data Engineering Data Engineering 52

Pickl AI

NOVEMBER 4, 2024

Effective data governance enhances quality and security throughout the data lifecycle. What is Data Engineering? Data Engineering is designing, constructing, and managing systems that enable data collection, storage, and analysis. They are crucial in ensuring data is readily available for analysis and reporting.

Data Engineering 52

Data Engineering Data Engineer Data Engineering Data Engineering 52