Remove 2011 Remove AWS Remove Python
article thumbnail

Reinventing a cloud-native federated learning architecture on AWS

AWS Machine Learning Blog

Customers often need to train a model with data from different regions, organizations, or AWS accounts. Existing partner open-source FL solutions on AWS include FedML and NVIDIA FLARE. These open-source packages are deployed in the cloud by running in virtual machines, without using the cloud-native services available on AWS.

AWS 107
article thumbnail

Announcing new Jupyter contributions by AWS to democratize generative AI and scale ML workloads

AWS Machine Learning Blog

The Jupyter Notebook, first released in 2011, has become a de facto standard tool used by millions of users worldwide across every possible academic, research, and industry sector. Given the importance of Jupyter to data scientists and ML developers, AWS is an active sponsor and contributor to Project Jupyter.

AWS 96
professionals

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Improving air quality with generative AI

AWS Machine Learning Blog

On December 6 th -8 th 2023, the non-profit organization, Tech to the Rescue , in collaboration with AWS, organized the world’s largest Air Quality Hackathon – aimed at tackling one of the world’s most pressing health and environmental challenges, air pollution. This is done to optimize performance and minimize cost of LLM invocation.

AWS 115
article thumbnail

Streamlining ETL data processing at Talent.com with Amazon SageMaker

AWS Machine Learning Blog

Established in 2011, Talent.com aggregates paid job listings from their clients and public job listings, and has created a unified, easily searchable platform. The system includes feature engineering, deep learning model architecture design, hyperparameter optimization, and model evaluation, where all modules are run using Python.

ETL 95
article thumbnail

From text to dream job: Building an NLP-based job recommender at Talent.com with Amazon SageMaker

AWS Machine Learning Blog

Founded in 2011, Talent.com is one of the world’s largest sources of employment. The system is developed by a team of dedicated applied machine learning (ML) scientists, ML engineers, and subject matter experts in collaboration between AWS and Talent.com. The recommendation system has driven an 8.6%

AWS 103
article thumbnail

Use streaming ingestion with Amazon SageMaker Feature Store and Amazon MSK to make ML-backed decisions in near-real time

AWS Machine Learning Blog

Most publicly available fraud detection datasets don’t provide this information, so we use the Python Faker library to generate a set of transactions covering a 5-month period. Prerequisites We provide an AWS CloudFormation template to create the prerequisite resources for this solution. This dataset contains 5.4

ML 84
article thumbnail

Top 10 Deep Learning Platforms in 2024

DagsHub

A good understanding of Python and machine learning concepts is recommended to fully leverage TensorFlow's capabilities. Integration: Strong integration with Python, supporting popular libraries such as NumPy and SciPy. However, for effective use of PyTorch, familiarity with Python and machine learning principles is a must.