AWS Machine Learning Blog

NOVEMBER 1, 2023

Organizations can search for PII using methods such as keyword searches, pattern matching, data loss prevention tools, machine learning (ML), metadata analysis, data classification software, optical character recognition (OCR), document fingerprinting, and encryption.

AWS 105

AWS Machine Learning Machine Learning ML 105

phData

JULY 1, 2024

It allows data engineers familiar with Python and Pandas to run their Pandas code in a scalable and distributed manner. Many more exciting features and updates include AI-powered Object Descriptions, Universal Search, and Sensitive Data Classification with Snowflake Horizon. schemas["my_schema"].tables.create(my_table)

Python 52

Python Database Data Pipeline SQL 52

Alation

MAY 16, 2023

How much data processing that occurs will depend on the data’s state when ingested and how different the format is from the desired end state. Most data processing tasks are completed using ETL (Extract, Transform, Load) or ELT (Extract, Load Transform) processes.

Data Pipeline 69

Data Pipeline Data Governance Data Lakes Data Warehouse 69

phData

FEBRUARY 14, 2023

Masked data provides a cost-effective way to help test if a system or design will perform as expected in real-life scenarios. As the insurance industry continues to generate a wider range and volume of data, it becomes more challenging to manage data classification.

Data Governance 52

Data Governance Data Silos Predictive Analytics Data Wrangling 52

Alation

MARCH 1, 2022

Through Impact Analysis, users can determine if a problem occurred with data upstream, and locate the impacted data downstream. With robust data lineage, data engineers can find and fix issues fast and prevent them from recurring. Similarly, analysts gain a clear view of how data is created.

Data Warehouse 52

Data Warehouse Data Lakes Cloud Data Database 52

phData

FEBRUARY 16, 2023

These projects should include all functional areas within the data platform including analytics engineering, machine learning , and data science. Data governance and data classification are potential reasons to separate projects in dbt Cloud.

Database 52

Database Azure Data Classification Data Governance 52

Alation

MAY 16, 2023

How much data processing that occurs will depend on the data’s state when ingested and how different the format is from the desired end state. Most data processing tasks are completed using ETL (Extract, Transform, Load) or ELT (Extract, Load Transform) processes.

Data Pipeline 40

Data Pipeline Data Governance Data Lakes Data Warehouse 40