AWS Machine Learning Blog

APRIL 19, 2023

Streaming ingestion – An Amazon Kinesis Data Analytics for Apache Flink application backed by Apache Kafka topics in Amazon Managed Streaming for Apache Kafka (MSK) (Amazon MSK) calculates aggregated features from a transaction stream, and an AWS Lambda function updates the online feature store.

ML 87

ML ML Apache Kafka SQL 87

AWS Machine Learning Blog

JANUARY 6, 2023

TR wanted to take advantage of AWS managed services where possible to simplify operations and reduce undifferentiated heavy lifting. TR used AWS Glue DataBrew and AWS Batch jobs to perform the extract, transform, and load (ETL) jobs in the ML pipelines, and SageMaker along with Amazon Personalize to tailor the recommendations.

AWS 76

AWS Data Warehouse ML ML 76

DagsHub

OCTOBER 23, 2024

Apache Kafka Apache Kafka is a distributed event streaming platform for real-time data pipelines and stream processing. Tabular Data Extraction Deep learning models can extract structured information from unstructured sources, such as PDFs and images, into tabular formats.

Machine Learning 52

Machine Learning Machine Learning Data Lakes AI 52

Pickl AI

JULY 20, 2023

Real-time Data Stream Analysis: Use Python with libraries like Apache Kafka and Apache Spark to process and analyze real-time data streams from sources like Twitter, sensors, or website logs. Image Recognition with Deep Learning: Use Python with TensorFlow or PyTorch to build an image recognition model (e.g.,

Analytics 40

Analytics Analytics Big Data Big Data 40

The MLOps Blog

AUGUST 11, 2023

Apache Kafka, Amazon Kinesis) 2 Data Preprocessing (e.g., Scikit-learn, Feature Tools) 4 Model Training (e.g., Scikit-learn, MLflow) 6 Model Deployment (e.g., As usage increased, the system had to be scaled vertically, approaching AWS instance-type limits. Federated learning What is federated learning architecture?

ML 52

ML ML Machine Learning Machine Learning 52