Analytics Vidhya

OCTOBER 28, 2021

This article was published as a part of the Data Science Blogathon What is the need for Hive? The official description of Hive is- ‘Apache Hive data warehouse software project built on top of Apache Hadoop for providing data query and analysis.

Apache Hadoop 349

Apache Hadoop Data Warehouse Hadoop SQL 349

Analytics Vidhya

APRIL 29, 2022

This article was published as a part of the Data Science Blogathon. Introduction Apache Hadoop is the most used open-source framework in the industry to store and process large data efficiently. Hive is built on the top of Hadoop for providing data storage, query and processing capabilities.

Apache Hadoop 266

Apache Hadoop Hadoop SQL Data Science 266

Towards AI

SEPTEMBER 28, 2023

This article explains what PySpark is, some common PySpark functions, and data analysis of the New York City Taxi & Limousine Commission Dataset using PySpark. PySpark is an interface for Apache Spark in Python. It leverages Apache Hadoop for both storage and processing. This member-only story is on us.

Apache Hadoop 75

Apache Hadoop Hadoop Python SQL 75

Pickl AI

DECEMBER 25, 2024

This article helps you choose the right path by exploring their differences, roles, and future opportunities. Descriptive analytics is a fundamental method that summarizes past data using tools like Excel or SQL to generate reports. Big data platforms such as Apache Hadoop and Spark help handle massive datasets efficiently.

Data Science 52

Data Science Analytics Analytics Data Scientist 52

Pickl AI

JULY 18, 2023

There are different programming languages and in this article, we will explore 8 programming languages that play a crucial role in the realm of Data Science. SQL: Mastering Data Manipulation Structured Query Language (SQL) is a language designed specifically for managing and manipulating databases.

Data Science 52

Data Science SQL Data Scientist Python 52

Mlearning.ai

JULY 10, 2023

In my 7 years of Data Science journey, I’ve been exposed to a number of different databases including but not limited to Oracle Database, MS SQL, MySQL, EDW, and Apache Hadoop. Now let’s get into the main topic of the article. I’ll leave these methods on you to embark on your own research and familiarize yourself.

SQL 52

SQL Database Apache Hadoop Data Science 52

Pickl AI

JULY 25, 2023

With expertise in programming languages like Python , Java , SQL, and knowledge of big data technologies like Hadoop and Spark, data engineers optimize pipelines for data scientists and analysts to access valuable insights efficiently. ETL Tools: Apache NiFi, Talend, etc. Big Data Processing: Apache Hadoop, Apache Spark, etc.

Data Engineering 52

Data Engineering Data Engineering Data Engineer Data Engineering 52