Data Cleaning

All discussions tagged with this topic

Found 2 discussions

Data Engineers Reveal Their Biggest Pain Points: Silos, Cleaning, and Context Switching

June 27, 2025

Data engineers share their biggest on-the-job frustrations, from battling organizational silos and cleaning messy human-entered data to the soul-crushing 'work about the work' caused by tool sprawl. Discover the real challenges that go beyond the code.

Data Engineering Data Quality Data Cleaning Organizational Silos Workflows Context Switching Data Access Tooling Etl Data Governance

Developer Strategies for Pre-Import Data Cleaning and Transformation

May 22, 2025

Developers share their go-to tools and techniques for cleaning and transforming data before imports, highlighting the power of scripting, challenges with common tools, and best practices for a robust data pipeline. Discover insights on managing everything from date formatting to complex code mapping.

Data Cleaning Data Transformation Etl Python Pandas Polars Pydantic Excel Llms Data Import Data Migration Scripts Automation Data Quality Salesforce Workday Netsuite Data Preparation Sql Aws Lambda Visidata Datasette