Analytics Vidhya

MARCH 8, 2023

The Biggest Data Science Blogathon is now live! Martin Uzochukwu Ugwu Analytics Vidhya is back with the largest data-sharing knowledge competition- The Data Science Blogathon. Knowledge is power. Sharing knowledge is the key to unlocking that power.”―

Data Science 345

Data Science Analytics Analytics Apache Hadoop 345

Analytics Vidhya

JUNE 14, 2022

This article was published as a part of the Data Science Blogathon. Introduction Hadoop is an open-source, Java-based framework used to store and process large amounts of data. Data is stored on inexpensive asset servers that operate as clusters. Developed by Doug Cutting and Michael […].

Hadoop 271

Hadoop Clustering Data Science Analytics 271

Analytics Vidhya

MAY 31, 2022

This article was published as a part of the Data Science Blogathon. Introduction YARN stands for Yet Another Resource Negotiator, a large-scale distributed data operating system used for Big Data Analytics. The post The Tale of Apache Hadoop YARN! appeared first on Analytics Vidhya.

Apache Hadoop 271

Apache Hadoop Hadoop Big Data Analytics Big Data Analytics 271

Analytics Vidhya

JUNE 14, 2022

This article was published as a part of the Data Science Blogathon. Earlier to it, Hadoop MapReduce was the main focus for processing large data with no competitors. The post Apache Spark Vs. Hadoop MapReduce – Top 7 Differences appeared first on Analytics Vidhya. Let’s take a […].

Hadoop 270

Hadoop Data Science Analytics Analytics 270

Analytics Vidhya

JUNE 27, 2020

Overview There are a plethora of data science tools out there – which one should you pick up? The post 22 Widely Used Data Science and Machine Learning Tools in 2020 appeared first on Analytics Vidhya. Here’s a list of over 20.

Machine Learning 400

Machine Learning Machine Learning Data Science Analytics 400

Analytics Vidhya

JULY 5, 2022

This article was published as a part of the Data Science Blogathon. Introduction MapReduce is part of the Apache Hadoop ecosystem, a framework that develops large-scale data processing. Other components of Apache Hadoop include Hadoop Distributed File System (HDFS), Yarn, and Apache Pig.

Apache Hadoop 397

Apache Hadoop Hadoop Data Science Algorithm 397

Analytics Vidhya

JANUARY 8, 2023

Hey, are you the data science geek who spends hours coding, learning a new language, or just exploring new avenues of data science? Analytics Vidhya is back with its 28th Edition of blogathon, a place where you can share your knowledge about […].

Data Science 328

Data Science Analytics Analytics Hadoop 328

Analytics Vidhya

NOVEMBER 7, 2022

Hello, fellow data science enthusiasts, did you miss imparting your knowledge in the previous blogathon due to a time crunch? Well, it’s okay because we are back with another blogathon where you can share your wisdom on numerous data science topics and connect with the community of fellow enthusiasts.

Data Science 306

Data Science Analytics Analytics Hadoop 306

Analytics Vidhya

MAY 5, 2022

This article was published as a part of the Data Science Blogathon. Introduction This article will discuss the Hadoop Distributed File System, its features, components, functions, and benefits. Hadoop is a powerful platform for supporting an enormous variety of data applications.

Hadoop 208

Hadoop Data Science Analytics Analytics 208

Analytics Vidhya

MAY 12, 2022

This article was published as a part of the Data Science Blogathon. Introduction Apache Flume, a part of the Hadoop ecosystem, was developed by Cloudera. Initially, it was designed to handle log data solely, but later, it was developed to process event data. appeared first on Analytics Vidhya.

Hadoop 392

Hadoop Data Science Analytics Analytics 392

Analytics Vidhya

JULY 25, 2022

This article was published as a part of the Data Science Blogathon. Introduction Apache Sqoop is a big data engine for transferring data between Hadoop and relational database servers. Big Data Sqoop can also be […]. Big Data Sqoop can also be […].

Hadoop 353

Hadoop Big Data Big Data Data Engineering 353

Analytics Vidhya

OCTOBER 21, 2021

This article was published as a part of the Data Science Blogathon Overview Hadoop is widely used in the industry to examine large data volumes. The post A Comprehensive Guide to Apache Spark RDD and PySpark appeared first on Analytics Vidhya. Table of […]. Table of […].

Hadoop 349

Hadoop Data Science Analytics Analytics 349

Analytics Vidhya

OCTOBER 12, 2022

This article was published as a part of the Data Science Blogathon. Introduction Since the 1970s, relational database management systems have solved the problems of storing and maintaining large volumes of structured data.

Hadoop 353

Hadoop Big Data Big Data Data Science 353

Analytics Vidhya

OCTOBER 10, 2022

This article was published as a part of the Data Science Blogathon. Introduction Most of you would know the different approaches for building a data and analytics platform. You would have already worked on systems that used traditional warehouses or Hadoop-based data lakes. Selecting one among […].

Data Lakes 350

Data Lakes Hadoop Data Science Analytics 350

Analytics Vidhya

AUGUST 1, 2022

This article was published as a part of the Data Science Blogathon. Introduction HBase is a column-oriented non-relational database management system that operates on Hadoop Distributed File System (HDFS). HBase provides a fault-tolerant manner of storing sparse data sets, which are prevalent in several big data use cases.

Hadoop 360

Hadoop Big Data Big Data Data Science 360

Analytics Vidhya

FEBRUARY 20, 2022

This article was published as a part of the Data Science Blogathon. Introduction Apache Hive is a data warehouse system built on top of Hadoop which gives the user the flexibility to write complex MapReduce programs in form of SQL- like queries.

Hadoop 333

Hadoop Data Warehouse SQL Data Science 333

Analytics Vidhya

OCTOBER 28, 2021

This article was published as a part of the Data Science Blogathon What is the need for Hive? The official description of Hive is- ‘Apache Hive data warehouse software project built on top of Apache Hadoop for providing data query and analysis.

Apache Hadoop 349

Apache Hadoop Data Warehouse Hadoop SQL 349

Analytics Vidhya

MAY 18, 2022

This article was published as a part of the Data Science Blogathon. Introduction Hadoop facilitates the processing of large datasets in a distributed manner and provides the foundation on which other services and applications can be built. MapReduce and HDFS are the two main components of Hadoop.

Hadoop 291

Hadoop Data Science Analytics Analytics 291

Analytics Vidhya

AUGUST 2, 2022

This article was published as a part of the Data Science Blogathon. Introduction Apache Oozie is a distributed workflow scheduler for performing and controlling Hadoop tasks. The post Top Interview Questions & Answers for Apache Oozie appeared first on Analytics Vidhya. It […]. It […].

Hadoop 335

Hadoop Data Science Analytics Analytics 335

Analytics Vidhya

JULY 11, 2022

This article was published as a part of the Data Science Blogathon. Previous versions of Hadoop only support […]. Previous versions of Hadoop only support […]. The post Architecture and Components of Apache YARN appeared first on Analytics Vidhya.

Hadoop 270

Hadoop Data Science Analytics Analytics 270

Analytics Vidhya

AUGUST 17, 2022

This article was published as a part of the Data Science Blogathon. Introduction Impala is an open-source and native analytics database for Hadoop. The post What is Apache Impala- Features and Architecture appeared first on Analytics Vidhya. source: -[link] It rapidly processes large […].

Hadoop 291

Hadoop Data Science Database Analytics 291

Analytics Vidhya

AUGUST 30, 2021

This article was published as a part of the Data Science Blogathon Introduction Spark is an analytics engine that is used by data scientists all over the world for Big Data Processing. It is built on top of Hadoop and can process batch as well as streaming data.

Data Analysis 280

Data Analysis Data Analysis SQL Hadoop 280

Analytics Vidhya

APRIL 29, 2022

This article was published as a part of the Data Science Blogathon. Introduction Apache Hadoop is the most used open-source framework in the industry to store and process large data efficiently. Hive is built on the top of Hadoop for providing data storage, query and processing capabilities.

Apache Hadoop 266

Apache Hadoop Hadoop SQL Data Science 266

Analytics Vidhya

MAY 21, 2023

This is precisely what happens in data analytics. People equipped with the […] The post 10 Best Data Analytics Projects appeared first on Analytics Vidhya. With something so profound in daily life, there should be an entire domain handling and utilizing it.

Analytics 357

Analytics Analytics Power BI Hadoop 357

Data Science Dojo

OCTOBER 31, 2024

Remote work quickly transitioned from a perk to a necessity, and data science—already digital at heart—was poised for this change. For data scientists, this shift has opened up a global market of remote data science jobs, with top employers now prioritizing skills that allow remote professionals to thrive.

Data Science 195

Data Science Data Scientist Machine Learning Machine Learning 195

Analytics Vidhya

SEPTEMBER 20, 2022

This article was published as a part of the Data Science Blogathon. Introduction Apache Oozie is a Hadoop workflow scheduler. Users can design Directed Acyclic Graphs of workflows that can be run in parallel and sequentially in Hadoop. The post Top 20 Apache Oozie Interview Questions appeared first on Analytics Vidhya.

Hadoop 268

Hadoop Data Science Analytics Analytics 268

Analytics Vidhya

JANUARY 7, 2022

In today’s world, data is being generated at an ever-growing pace, leading to a boom in demand for Big Data tools such as Hadoop, Pig, Spark, Hive, and many more. The tool that stands out the most is Apache Hadoop, and one of its core components is YARN. Apache Hadoop YARN, or as it is […].

Apache Hadoop 317

Apache Hadoop Hadoop Big Data Big Data 317

Analytics Vidhya

AUGUST 3, 2022

This article was published as a part of the Data Science Blogathon. Introduction Zookeeper in Hadoop can be considered a centralized repository where distributed applications can put data into and retrieve data from. The post Apache Zookeeper Architecture and Installation appeared first on Analytics Vidhya.

Hadoop 270

Hadoop Data Science Analytics Analytics 270

Analytics Vidhya

JUNE 29, 2022

This article was published as a part of the Data Science Blogathon. Hive, founded by Facebook and later Apache, is a data storage system created for the purpose of analyzing structured data. Operating under an open-source data platform called Hadoop, Apache Hive is a software application released in 2010 (October).

Hadoop 271

Hadoop Data Science Analytics Analytics 271

Analytics Vidhya

MAY 17, 2022

This article was published as a part of the Data Science Blogathon. It is developed as a part of the Hadoop ecosystem and runs on top of HDFS. It provides random real-time read and write access to the given data. The post Getting Started with NoSQL Database Called HBase appeared first on Analytics Vidhya.

Database 287

Database Hadoop Data Science Analytics 287

Analytics Vidhya

AUGUST 26, 2022

This article was published as a part of the Data Science Blogathon. Introduction Apache Spark is an open-source unified analytics engine for large-scale data processing. Spark’s in-memory data processing capabilities make it 100 times faster than Hadoop. The most […]. The most […].

Hadoop 271

Hadoop Data Science Analytics Analytics 271

Dataconomy

APRIL 21, 2016

Recent technology advances within the Apache Hadoop ecosystem have provided a big boost to Hadoop’s viability as an analytics environment—above and beyond just being a good place to store data. Leveraging these advances, new technologies now support SQL on Hadoop, making in-cluster analytics of data in Hadoop a reality.

Hadoop Analytics 132

Hadoop Analytics Hadoop Apache Hadoop Analytics 132

Analytics Vidhya

JUNE 30, 2022

This article was published as a part of the Data Science Blogathon. Introduction Hive is a popular data warehouse built on top of Hadoop that is used by companies like Walmart, Tiktok, and AT&T. It is an important technology for data engineers to learn and master.

Data Warehouse 271

Data Warehouse Hadoop Data Engineering Data Engineering 271

Analytics Vidhya

JULY 10, 2022

This article was published as a part of the Data Science Blogathon. The Apache Pig is built on top of Hadoop. Provides a stream of data processing for large data sets. The post Apache Pig Architecture and Execution Modes appeared first on Analytics Vidhya. Apache Pork offers a high-quality language.

Hadoop 271

Hadoop Data Science Analytics Analytics 271

Analytics Vidhya

JULY 29, 2022

This article was published as a part of the Data Science Blogathon. Introduction One of the sources of Big Data is the traditional application management system or the interaction of applications with relational databases using RDBMS. Big Data storage and analysis […]. Big Data storage and analysis […].

Big Data 399

Big Data Big Data Database Data Science 399

Data Science Dojo

JULY 7, 2023

In the technology-driven world we inhabit, two skill sets have risen to prominence and are a hot topic: coding vs data science. Coding vs Data Science Coding goes beyond just software creation, impacting fields as diverse as healthcare, finance, and entertainment. What is Data Science?

Data Science 195

Data Science Data Scientist Python Decision Trees 195

Analytics Vidhya

SEPTEMBER 4, 2022

This article was published as a part of the Data Science Blogathon. The post Basic Concept Behind Apache Hive and Elasticsearch appeared first on Analytics Vidhya. Introduction I’ve always wondered how big companies like Google process their information or how companies like Netflix can perform searches in concise times.

Data Science 398

Data Science Analytics Analytics Hadoop 398