IBM Journey to AI blog

NOVEMBER 29, 2023

Aggregates as predictive insights : Aggregates, which consolidate data from various sources across your business environment, can serve as valuable predictors for machine learning (ML) algorithms. Event processing helps continuously update and refine our understanding of ongoing business scenarios.

Artificial Intelligence 105

Artificial Intelligence Artificial Intelligence Apache Kafka AI 105

Flipboard

NOVEMBER 21, 2023

For this particular use case, you can use streaming ingestion with Amazon SageMaker Feature Store and Amazon Managed Streaming for Apache Kafka, MSK, to make machine learning-backed decisions in near real-time. Shun Mao is a Senior AI/ML Partner Solutions Architect in the Emerging Technologies team at Amazon Web Services.

Machine Learning 166

Machine Learning Machine Learning AWS Decision Trees 166

AWS Machine Learning Blog

NOVEMBER 3, 2023

m How it’s implemented In our quest to accurately determine shot speed during live matches, we’ve implemented a cutting-edge solution using Amazon Managed Streaming for Apache Kafka (Amazon MSK). His skills and areas of expertise include application development, data science, and machine learning (ML).

AWS 131

AWS Apache Kafka Data Scientist Data Science 131

ODSC - Open Data Science

JULY 14, 2023

Probabilistic Machine Learning for Finance and Investing Deepak Kanungo | Founder and CEO, Advisory Board Member | Hedged Capital LLC, AIKON This session will introduce you to the reasons why probabilistic machine learning is the next generation of AI in finance and investing.

Machine Learning 52

Machine Learning Machine Learning Apache Kafka Data Science 52

ODSC - Open Data Science

JUNE 7, 2023

Wednesday, June 14th Me, my health, and AI: applications in medical diagnostics and prognostics: Sara Khalid | Associate Professor, Senior Research Fellow, Biomedical Data Science and Health Informatics | University of Oxford Iterated and Exponentially Weighted Moving Principal Component Analysis : Dr. Paul A.

Apache Kafka 52

Apache Kafka Machine Learning Machine Learning Data Science 52

ODSC - Open Data Science

JULY 22, 2023

Some of our most popular in-person sessions were: Data Communication in the Age of AI: Alan Rutter | Founder | Fire Plus Algebra Autoencoders — a Magical Approach to Unsupervised Machine Learning: Oliver Zeigermann | Blue Collar ML Architect | Freelancer Fast Option Pricing Using Deep Learning Methods: Chakri Cherukuri | Senior Quantitative Researcher (..)

Apache Kafka 52

Apache Kafka Machine Learning Machine Learning Data Science 52

Alation

AUGUST 4, 2022

Spark, Tensorflow, Apache Kafka, et cetera, are all out found in cloud databases,” points out Jones. We also need to “learn about both better AI/ML /analysis tools and understanding the implicit and explicit biases that exist within them.” To improve ML and Ethics, data literacy training is critical.

Big Data 95

Big Data Big Data Apache Kafka Data Lakes 95

DagsHub

APRIL 7, 2024

These pipelines cover the entire lifecycle of an ML project, from data ingestion and preprocessing, to model training, evaluation, and deployment. Adopted from [link] In this article, we will first briefly explain what ML workflows and pipelines are. around the world to streamline their data and ML pipelines.

Machine Learning 59

Machine Learning Machine Learning ML ML 59

AWS Machine Learning Blog

MARCH 30, 2023

To ensure real-time updates of ball recovery times, we have implemented Amazon Managed Streaming for Apache Kafka (Amazon MSK) as a central solution for data streaming and messaging. Fotinos Kyriakides is an ML Engineer with AWS Professional Services. He is also an enthusiastic cyclist, taking long bike-packing trips.

AWS 102

AWS Machine Learning Machine Learning Apache Kafka 102

Pickl AI

DECEMBER 4, 2024

The rise of advanced technologies such as Artificial Intelligence (AI), Machine Learning (ML) , and Big Data analytics is reshaping industries and creating new opportunities for Data Scientists. Apache Kafka), organisations can now analyse vast amounts of data as it is generated. Here are five key trends to watch.

Data Science 52

Data Science Data Scientist Machine Learning Machine Learning 52

DagsHub

OCTOBER 23, 2024

Managing unstructured data is essential for the success of machine learning (ML) projects. This article will discuss managing unstructured data for AI and ML projects. You will learn the following: Why unstructured data management is necessary for AI and ML projects. How to properly manage unstructured data.

Machine Learning 52

Machine Learning Machine Learning Data Lakes AI 52

The MLOps Blog

FEBRUARY 5, 2023

There are a number of tools that can help with streaming data collection and processing, some popular ones include: Apache Kafka : An open-source, distributed event streaming platform that can handle millions of events per second. It can be used to collect, store, and process streaming data in real-time. Happy Learning!

Machine Learning 72

Machine Learning Machine Learning Data Pipeline Apache Kafka 72

ODSC - Open Data Science

OCTOBER 9, 2024

So what are you waiting for? Get your pass today !

Apache Kafka 40

Apache Kafka AI AI Machine Learning 40

Mlearning.ai

AUGUST 4, 2023

Apache Kafka and R abbitMQ are particularly popular in LEs. Graph 7: Percentage of Programming Languages MiscTech Tools In Both LEs and SMEs: ‘. NET (5+) ’, ‘ pandas ’, ‘ numpy ’, and ‘. NET Framework (1.0–4.8)’ 4.8)’ are widely used.

Database 52

Database Apache Kafka SQL AI 52

The MLOps Blog

MARCH 15, 2023

A typical data pipeline involves the following steps or processes through which the data passes before being consumed by a downstream process, such as an ML model training process. If a typical ML project involves standard pre-processing steps – why not make it reusable?

Data Pipeline 59

Data Pipeline ETL SQL Data Quality 59

Pickl AI

JULY 8, 2024

Must Read Blogs: Elevate Your Data Quality: Unleashing the Power of AI and ML for Scaling Operations. Utilise in-memory data processing tools like Apache Kafka and Apache Flink, which provide low-latency data ingestion and processing capabilities. The Difference Between Data Observability And Data Quality.

Data Pipeline 52

Data Pipeline Data Quality Database Apache Kafka 52

DagsHub

JANUARY 14, 2025

A massive amount of diverse data powers today's ML models. Each of the above-mentioned techniques has its strengths and weaknesses, and the choice of method often depends on the specific requirements of the dataset, ML model, and the available computational resources. Duplicate images are typically found  in the same cluster.

Machine Learning 52

Machine Learning Machine Learning Clustering Algorithm 52

Mlearning.ai

MAY 16, 2023

The events can be published to a message broker such as Apache Kafka or Google Cloud Pub/Sub. The company can use the Pub/Sub pattern to process customer events such as product views, add to cart, and checkout. The events can be published by various sources such as mobile apps, web applications, and IoT devices.

Data Engineering 52

Data Engineering Data Engineering Data Engineer Data Engineering 52

The MLOps Blog

AUGUST 11, 2023

There comes a time when every ML practitioner realizes that training a model in Jupyter Notebook is just one small part of the entire project. At that point, the Data Scientists or ML Engineers become curious and start looking for such implementations. What are ML pipeline architecture design patterns?

ML 52

ML ML Machine Learning Machine Learning 52

ODSC - Open Data Science

MAY 24, 2023

Building a Business with a Real-Time Analytics Stack, Streaming ML Without a Data Lake, and Google’s PaLM 2 Building a Pizza Delivery Service with a Real-Time Analytics Stack The best businesses react quickly and with informed decisions. Here’s a use case of how you can use a real-time analytics stack to build a pizza delivery service.

Data Lakes 52

Data Lakes ML ML Analytics 52

AWS Machine Learning Blog

MARCH 30, 2023

The result is a machine learning (ML)-powered insight that allows fans to easily evaluate and compare the goalkeepers’ proficiencies. An ML model is trained through Amazon SageMaker , using data from four seasons of the first and second Bundesliga, encompassing all shots that landed on target (either resulting in a goal or being saved).

Machine Learning 105

Machine Learning Machine Learning AWS ML 105

phData

SEPTEMBER 27, 2024

Technologies like Apache Kafka, often used in modern CDPs, use log-based approaches to stream customer events between systems in real-time. Activity Schema Processing : To capture and process customer activities, you might use a stream processing technology like Apache Kafka or Apache Flink.

Data Models 52

Data Models Data Modeling Apache Kafka Data Lakes 52

AWS Machine Learning Blog

APRIL 18, 2025

Solution overview: Build a generative AI stock price analyzer with RAG For this post, we implement a RAG architecture with Amazon Bedrock Knowledge Bases using a custom connector and topics built with Amazon Managed Streaming for Apache Kafka (Amazon MSK) for a user who may be interested to understand stock price trends.

Apache Kafka 100

Apache Kafka AWS Clustering Database 100

Pickl AI

FEBRUARY 23, 2025

Best Big Data Tools Popular tools such as Apache Hadoop, Apache Spark, Apache Kafka, and Apache Storm enable businesses to store, process, and analyse data efficiently. Machine Learning Integration : Built-in ML capabilities streamline model development and deployment.

Big Data 52

Big Data Big Data Apache Hadoop Apache Kafka 52

AWS Machine Learning Blog

FEBRUARY 7, 2025

However, it lacked essential services required for machine learning (ML) applications, such as frontend and backend infrastructure, DNS, load balancers, scaling, blob storage, and managed databases. At that time, the application was deployed as a single monolithic container, which included Kafka and a database.

Analytics 71

Analytics Analytics AWS Clustering 71