Hacker News

OCTOBER 15, 2024

At the Open Compute Project (OCP) Global Summit 2024, we’re showcasing our latest open AI hardware designs with the OCP community. These innovations include a new AI platform, cutting-edge open rack designs, and advanced network fabrics and components. Prior to Llama, our largest AI jobs ran on 128 NVIDIA A100 GPUs.

AI 180

AI AI Clustering Deep Learning 180

AWS Machine Learning Blog

JUNE 25, 2024

This solution simplifies the integration of advanced monitoring tools such as Prometheus and Grafana, enabling you to set up and manage your machine learning (ML) workflows with AWS AI Chips. By deploying the Neuron Monitor DaemonSet across EKS nodes, developers can collect and analyze performance metrics from ML workload pods.

AWS 88

AWS ML ML Clustering 88

AWS Machine Learning Blog

APRIL 4, 2023

AWS provides various services catered to time series data that are low code/no code, which both machine learning (ML) and non-ML practitioners can use for building ML solutions. We use the Time Series Clustering using TSFresh + KMeans notebook, which is available on our GitHub repo.

Clustering 93

Clustering ML ML AWS 93

AWS Machine Learning Blog

NOVEMBER 7, 2024

Operating such large-scale forecasting requires resilient, reusable, reproducible, and automated machine learning (ML) workflows with fast experimentation and continuous improvements. To improve forecasting accuracy, all involved ML models need to be retrained, and predictions need to be produced weekly, and in some cases daily.

ML 104

ML ML AWS Machine Learning 104

Smart Data Collective

AUGUST 29, 2022

This is why businesses are looking to leverage machine learning (ML). In this article, we will share some best practices for improving your analytics with ML. Top ML approaches to improve your analytics. Clustering. ?lustering They need a more comprehensive analytics strategy to achieve these business goals.

ML 118

ML ML Analytics Analytics 118

DataRobot Blog

DECEMBER 6, 2022

Other organizations are just discovering how to apply AI to accelerate experimentation time frames and find the best models to produce results. With a goal to help data science teams learn about the application of AI and ML, DataRobot shares helpful, educational blogs based on work with the world’s most strategic companies.

Data Scientist 145

Data Scientist ML ML AI 145

AWS Machine Learning Blog

APRIL 22, 2024

Amazon SageMaker HyperPod is purpose-built to accelerate foundation model (FM) training, removing the undifferentiated heavy lifting involved in managing and optimizing a large training compute cluster. In this solution, HyperPod cluster instances use the LDAPS protocol to connect to the AWS Managed Microsoft AD via an NLB.

Clustering 108

Clustering AWS Machine Learning Machine Learning 108

Google Research AI blog

MAY 25, 2023

Posted by Vincent Cohen-Addad and Alessandro Epasto, Research Scientists, Google Research, Graph Mining team Clustering is a central problem in unsupervised machine learning (ML) with many applications across domains in both industry and academic research more broadly. When clustering is applied to personal data (e.g.,

Clustering 89

Clustering Algorithm Machine Learning Machine Learning 89

Pickl AI

MAY 10, 2023

ML algorithms fall into various categories which can be generally characterised as Regression, Clustering, and Classification. While Classification is an example of directed Machine Learning technique, Clustering is an unsupervised Machine Learning algorithm. It can also be used for determining the optimal number of clusters.

Clustering 52

Clustering Decision Trees Machine Learning Machine Learning 52

Towards AI

FEBRUARY 21, 2024

Author(s): Alessandro Amenta Originally published on Towards AI. Image generated with DALL-E 3 In the fast-paced world of Machine Learning (ML) research, keeping up with the latest findings is crucial and exciting, but let’s be honest — it’s also a challenge. What’s the next big thing in ML?

ML 99

ML ML Machine Learning Machine Learning 99

Hacker News

OCTOBER 15, 2024

At Open Compute Project Summit (OCP) 2024, we’re sharing details about our next-generation network fabric for our AI training clusters. Now, through OCP, we’re bringing new open advanced network technologies to our data centers, and the wider industry, for advanced AI applications.

Clustering 172

Clustering AI AI ML 172

ML @ CMU

NOVEMBER 7, 2024

In close collaboration with the UN and local NGOs, we co-develop an interpretable predictive tool for landmine contamination to identify hazardous clusters under geographic and budget constraints, experimentally reducing false alarms and clearance time by half. RELand consistently outperforms the benchmark models on all relevant metrics.

Clustering 154

Clustering Cross Validation Machine Learning Machine Learning 154

ODSC - Open Data Science

FEBRUARY 23, 2023

5 Must-Know Pillars of a Data Science and AI Foundation A data science and AI foundation needs to be built up properly before diving in head-first. By knowing these core skills, like math and AI literacy, you’ll start off your career on a high note. How can AI be used to help with therapy on-demand for those who need help?

Clustering 98

Clustering Data Science Machine Learning Machine Learning 98

AWS Machine Learning Blog

APRIL 19, 2024

Iambic Therapeutics is a drug discovery startup with a mission to create innovative AI-driven technologies to bring better medicines to cancer patients, faster. Our advanced generative and predictive artificial intelligence (AI) tools enable us to search the vast space of possible drug molecules faster and more effectively.

Clustering 121

Clustering AI AI AWS 121

Hacker News

JUNE 12, 2024

Meta is currently operating many data centers with GPU training clusters across the world. A year ago, however, as the industry reached a critical inflection point due to the rise of artificial intelligence (AI), we recognized that to lead in the generative AI space we’d need to transform our fleet.

Clustering 179

Clustering AI AI Artificial Intelligence 179

Flipboard

AUGUST 17, 2023

Many practitioners are extending these Redshift datasets at scale for machine learning (ML) using Amazon SageMaker , a fully managed ML service, with requirements to develop features offline in a code way or low-code/no-code way, store featured data from Amazon Redshift, and make this happen at scale in a production environment.

ML 123

ML ML AWS Data Warehouse 123

AWS Machine Learning Blog

FEBRUARY 12, 2024

Sharing in-house resources with other internal teams, the Ranking team machine learning (ML) scientists often encountered long wait times to access resources for model training and experimentation – challenging their ability to rapidly experiment and innovate. If it shows online improvement, it can be deployed to all the users.

ML 129

ML ML AWS Machine Learning 129

Towards AI

JULY 17, 2023

Last Updated on July 18, 2023 by Editorial Team Author(s): Muttineni Sai Rohith Originally published on Towards AI. Pyspark MLlib | Classification using Pyspark ML In the previous sections, we discussed about RDD, Dataframes, and Pyspark concepts. In this article, we will discuss about Pyspark MLlib and Spark ML.

ML 81

ML ML Decision Trees Machine Learning 81

Hacker News

JANUARY 25, 2024

He writes about ML/AI/crypto/data, leadership, and building tech teams. Adam Drake is an advisor to scale-up tech companies.

Hadoop 121

Hadoop Clustering ML ML 121

Hacker News

AUGUST 5, 2024

AI networks play an important role in interconnecting tens of thousands of GPUs together, forming the foundational infrastructure for training, enabling large models with hundreds of billions of parameters such as LLAMA 3.1 The growing prevalence of AI has introduced a new era of communication demands.

AI 175

AI AI Clustering Natural Language Processing 175

Towards AI

SEPTEMBER 5, 2024

Author(s): Towards AI Editorial Team Originally published on Towards AI. Good morning, AI enthusiasts! Learn AI Together Community section! Featured Community post from the Discord Aman_kumawat_41063 has created a GitHub repository for applying some basic ML algorithms. AI poll of the week! Enjoy the read!

Algorithm 97

Algorithm ML ML Machine Learning 97

AWS Machine Learning Blog

OCTOBER 24, 2024

Machine learning (ML) helps organizations to increase revenue, drive business growth, and reduce costs by optimizing core business functions such as supply and demand forecasting, customer churn prediction, credit risk scoring, pricing, predicting late shipments, and many others. For this post we’ll use a provisioned Amazon Redshift cluster.

Data Warehouse 107

Data Warehouse Machine Learning Machine Learning Cloud Data 107

Mlearning.ai

FEBRUARY 8, 2023

Extract ‘superpixels’ of an Image using the clustering approach Before we get into the Image Segmentation using K-Means clustering, let’s quickly brush upon the basics. K-Means Clustering The basic underlying idea behind any clustering algorithm is to partition a set of values into a specific number of cluster.

Clustering 52

Clustering Python Algorithm ML 52

AWS Machine Learning Blog

OCTOBER 16, 2024

Amazon SageMaker supports geospatial machine learning (ML) capabilities, allowing data scientists and ML engineers to build, train, and deploy ML models using geospatial data. We use the purpose-built geospatial container with SageMaker Processing jobs for a simplified, managed experience to create and run a cluster.

ML 105

ML ML Clustering Machine Learning 105

Mlearning.ai

APRIL 10, 2023

How this machine learning model has become a sustainable and reliable solution for edge devices in an industrial network An Introduction Clustering (cluster analysis - CA) and classification are two important tasks that occur in our daily lives. Industrial Internet of Things (IIoT) The Constraints Within the area of Industry 4.0,

Clustering 52

Clustering Internet of Things Algorithm Machine Learning 52

Snorkel AI

APRIL 27, 2023

Here at Snorkel AI, we devote our time to building and maintaining our machine-learning development platform, Snorkel Flow. Spark, Dask, and any other workflow executors used for experimentation can grow along with the size of the cluster. Reproducibility is important in ML. Reproducibility is important in ML.

Machine Learning 97

Machine Learning Machine Learning Clustering ML 97

Snorkel AI

APRIL 27, 2023

Here at Snorkel AI, we devote our time to building and maintaining our machine-learning development platform, Snorkel Flow. Spark, Dask, and any other workflow executors used for experimentation can grow along with the size of the cluster. Reproducibility is important in ML. Reproducibility is important in ML.

Machine Learning 96

Machine Learning Machine Learning Clustering ML 96

Hacker News

MARCH 12, 2024

Marking a major investment in Meta’s AI future, we are announcing two 24k GPU clusters. We are sharing details on the hardware, network, storage, design, performance, and software that help us extract high throughput and reliability for various AI workloads. We use this cluster design for Llama 3 training.

Clustering 182

Clustering AI AI ML 182

Dataconomy

SEPTEMBER 1, 2024

Intersection of machine learning and artificial intelligence play in cloud security Both Machine Learning (ML) and Artificial Intelligence (AI) can analyze and process massive datasets at supersonic speeds; this is why both are perfect for cloud security. These two intersect in many ways discussed below.

Machine Learning 103

Machine Learning Machine Learning Artificial Intelligence Artificial Intelligence 103

IBM Journey to AI blog

DECEMBER 20, 2023

Machine learning (ML) technologies can drive decision-making in virtually all industries, from healthcare to human resources to finance and in myriad use cases, like computer vision , large language models (LLMs), speech recognition, self-driving cars and more. However, the growing influence of ML isn’t without complications.

Machine Learning 97

Machine Learning Machine Learning Supervised Learning Clustering 97

Snorkel AI

SEPTEMBER 5, 2023

As Snorkel Flow’s customer base and ML product capabilities have scaled, our cloud costs have unsurprisingly increased. In order to grow efficiently, we set out to understand how we can improve our margins while operating state-of-the-art ML software. the orchestrator for our Ray cluster). Let’s dive in!

ML 72

ML ML Clustering Machine Learning 72

AWS Machine Learning Blog

SEPTEMBER 4, 2024

Its scalability and load-balancing capabilities make it ideal for handling the variable workloads typical of machine learning (ML) applications. Amazon SageMaker provides capabilities to remove the undifferentiated heavy lifting of building and deploying ML models. kubectl for working with Kubernetes clusters.

AWS 98

AWS Clustering ML ML 98

Flipboard

JULY 10, 2023

Over time, many enterprises have built an on-premises cluster of servers, accumulating data, and then procuring more servers and storage. They often …

ML 94

ML ML Clustering AI 94

The MLOps Blog

JUNE 13, 2024

TL;DR Building a great AI system takes more than creating one good model. As a result, poor code quality and reliance on manual workflows are two of the main issues in ML development processes. When I first started working with AI, I was surprised at how complex and unstructured the development process was. And why is it hard?

ML 59

ML ML Data Scientist Azure 59

AWS Machine Learning Blog

SEPTEMBER 3, 2024

From deriving insights to powering generative artificial intelligence (AI) -driven applications, the ability to efficiently process and analyze large datasets is a vital capability. This same interface is also used for provisioning EMR clusters. The following diagram illustrates this solution.

AWS 111

AWS Clustering Big Data Big Data 111

Data Science Dojo

JULY 17, 2023

In recent years, there has been a growing interest in the use of artificial intelligence (AI) for data analysis. AI tools can automate many of the tasks involved in data analysis, and they can also help businesses to discover new insights from their data. Top 10 AI tools for data analysis AI Tools for Data Analysis 1.

Data Analysis 195

Data Analysis Data Analysis Tableau Machine Learning 195

AWS Machine Learning Blog

JULY 6, 2023

Many organizations choose SageMaker as their ML platform because it provides a common set of tools for developers and data scientists. There are a few different ways in which authentication across AWS accounts can be achieved when data in the SaaS platform is accessed from SageMaker and when the ML model is invoked from the SaaS platform.

ML 89

ML ML AWS Data Scientist 89