ODSC - Open Data Science

FEBRUARY 24, 2023

While machine learning frameworks and platforms like PyTorch, TensorFlow, and scikit-learn can perform data exploration well, it’s not their primary intent. There are also plenty of data visualization libraries available that can handle exploration like Plotly, matplotlib, D3, Apache ECharts, Bokeh, etc.

Exploratory Data Analysis 126

Exploratory Data Analysis Data Visualization Data Analysis Data Analysis 126

Dataversity

DECEMBER 16, 2020

According to IDC, the size of the global datasphere is projected to reach 163 ZB by 2025, leading to the disparate data sources in legacy systems, new system deployments, and the creation of data lakes and data warehouses. Most organizations do not utilize the entirety of the data […].

Data Warehouse 69

Data Warehouse Data Lakes Data Profiling Data Quality 69

The MLOps Blog

JUNE 27, 2023

To provide you with a comprehensive overview, this article explores the key players in the MLOps and FMOps (or LLMOps) ecosystems, encompassing both open-source and closed-source tools, with a focus on highlighting their key features and contributions.

Machine Learning 134

Machine Learning Machine Learning ML ML 134

Dataconomy

FEBRUARY 23, 2023

Data engineers are responsible for designing and building the systems that make it possible to store, process, and analyze large amounts of data. These systems include data pipelines, data warehouses, and data lakes, among others. However, building and maintaining these systems is not an easy task.

Big Data 91

Big Data Big Data Data Engineering Data Engineering 91

The MLOps Blog

MAY 17, 2023

Often the Data Team, comprising Data and ML Engineers , needs to build this infrastructure, and this experience can be painful. ETL data pipeline architecture | Source: Author Data Discovery: Data can be sourced from various types of systems, such as databases, file systems, APIs, or streaming sources.

ETL 59

ETL Data Pipeline ML ML 59

The MLOps Blog

MARCH 15, 2023

Data Processing : You need to save the processed data through computations such as aggregation, filtering and sorting. Data Storage : To store this processed data to retrieve it over time – be it a data warehouse or a data lake.

Data Pipeline 59

Data Pipeline ETL SQL Data Quality 59