AWS Machine Learning Blog

OCTOBER 9, 2024

To learn more, see the blog post , watch the introductory video , or see the documentation. To learn more about the beta offering, see Anomaly detection in streaming time series data with online learning using Amazon Managed Service for Apache Flink. How do I delete my Amazon Lookout for Metrics resources? Choose Delete.

AWS 94

AWS ML ML Data Quality 94

IBM Journey to AI blog

NOVEMBER 9, 2023

Apache Kafka is a high-performance, highly scalable event streaming platform. To unlock Kafka’s full potential, you need to carefully consider the design of your application. It’s all too easy to write Kafka applications that perform poorly or eventually hit a scalability brick wall. So, what can you do?

Apache Kafka 78

Apache Kafka Algorithm Clustering 78

AWS Machine Learning Blog

NOVEMBER 3, 2023

m How it’s implemented In our quest to accurately determine shot speed during live matches, we’ve implemented a cutting-edge solution using Amazon Managed Streaming for Apache Kafka (Amazon MSK). Simultaneously, the shot speed data finds its way to a designated topic within our MSK cluster. km/h with a distance to goal of 20.61

AWS 125

AWS Apache Kafka Data Scientist Data Science 125

IBM Journey to AI blog

JULY 12, 2024

With its intuitive UI, it makes it easy to produce a valid AsyncAPI document for any Kafka cluster or system that adheres to the Apache Kafka protocol. One of the key benefits of event endpoint management is that it allows you to describe events in a standardized way according to the AysncAPI specification.

Apache Kafka 40

Apache Kafka Clustering 40

IBM Journey to AI blog

AUGUST 22, 2024

In recognizing the benefits of event-driven architectures, many companies have turned to Apache Kafka for their event streaming needs. Apache Kafka enables scalable, fault-tolerant and real-time processing of streams of data—but how do you manage and properly utilize the sheer amount of data your business ingests every second?

EDA 40

EDA Apache Kafka Clustering 40

AWS Machine Learning Blog

MARCH 30, 2023

To ensure real-time updates of ball recovery times, we have implemented Amazon Managed Streaming for Apache Kafka (Amazon MSK) as a central solution for data streaming and messaging. Additionally, the ball recovery times are sent to a specific topic in the MSK cluster, where they can be accessed by other Bundesliga Match Facts.

AWS 100

AWS Machine Learning Machine Learning Apache Kafka 100

DagsHub

JANUARY 14, 2025

This data proliferates across websites, blogs, and social media primarily via automated content creation, SEO-optimized spun text, chatbot interactions, and similar systems. For in depth knowledge, please refer to this blog post. Clustering: Clustering can group texts using features like embedding vectors or TF-IDF vectors.

Machine Learning 52

Machine Learning Machine Learning Clustering Algorithm 52

Pickl AI

AUGUST 9, 2024

This blog aims to provide a comprehensive overview of a typical Big Data syllabus, covering essential topics that aspiring data professionals should master. Some of the most notable technologies include: Hadoop An open-source framework that allows for distributed storage and processing of large datasets across clusters of computers.

Big Data 52

Big Data Big Data Big Data Analytics Big Data Analytics 52

Pickl AI

JULY 30, 2024

This blog delves into the fundamentals of Apache NiFi, its architecture, and how it can leverage for effective data flow management. What is Apache NiFi? Apache NiFi is a robust data integration tool that facilitates the automation of data flows between different systems.

ETL 52

ETL Data Lakes Big Data Big Data 52

The MLOps Blog

MARCH 15, 2023

Typical examples include: Airbyte Talend Apache Kafka Apache Beam Apache Nifi While getting control over the process is an ideal position an organization wants to be in, the time and effort needed to build such systems are immense and frequently exceeds the license fee of a commercial offering. It connects to many DBs.

Data Pipeline 59

Data Pipeline ETL SQL Data Quality 59

The MLOps Blog

AUGUST 11, 2023

This blog will answer these questions by exploring the following: 1 What is pipeline architecture and design consideration, and what are the advantages of understanding it? Apache Kafka, Amazon Kinesis) 2 Data Preprocessing (e.g., References Netflix Tech Blog: Meson Workflow Orchestration for Netflix Recommendations Netflix.

ML 52

ML ML Machine Learning Machine Learning 52

AWS Machine Learning Blog

APRIL 18, 2025

Solution overview: Build a generative AI stock price analyzer with RAG For this post, we implement a RAG architecture with Amazon Bedrock Knowledge Bases using a custom connector and topics built with Amazon Managed Streaming for Apache Kafka (Amazon MSK) for a user who may be interested to understand stock price trends.

Apache Kafka 90

Apache Kafka AWS Clustering Database 90

Pickl AI

MARCH 13, 2025

Two of the most popular message brokers are RabbitMQ and Apache Kafka. In this blog, we will explore RabbitMQ vs Kafka, their key differences, and when to use each. RabbitMQ runs on multiple nodes in a cluster, ensuring high availability and system reliability. Where is RabbitMQ Used?

Apache Kafka 52

Apache Kafka Big Data Big Data Data Pipeline 52

AWS Machine Learning Blog

FEBRUARY 7, 2025

For the time being, we use Amazon EKS to offload the management overhead to AWS, but we could easily deploy on a standard Kubernetes cluster if needed. The resources in the Kubernetes cluster are deployed in a private subnet. It is backed by Amazon Managed Streaming for Apache Kafka (Amazon MSK) (8).

Analytics 66

Analytics Analytics AWS Clustering 66