Frocode

Senior Data Engineer (Product Owner)

RedBull Futur/IO • Autônomo

Jun 2026 - Present • 4 mos

Managed the end-to-end data platform roadmap and product backlog while collaborating with global stakeholders to translate complex requirements into actionable engineering epics. Engineered a full-scale Medallion architecture on Snowflake using dbt Core and custom macros to manage incremental materializations and maintain strict SCD Type 2 historical logs. Built scalable data ingestion pipelines using PySpark and dlt to extract datasets from high-frequency REST APIs, complex JSON payloads, and enterprise systems like SAP BW via SAP SNP Glue. Optimized Snowflake virtual warehouses and PySpark job configurations by managing partitions, reducing shuffles, and adjusting clustering keys to dramatically slash execution times and compute costs. Developed complex analytical data models, including accumulating snapshot fact tables, to track real-time container routing, capacity planning, and lifecycles across the LATAM region. Enriched internal supply chain tables with external datasets like live weather patterns and port congestion APIs to surface gold-layer data for global interactive visualization dashboards. Orchestrated multi-stage pipelines using Dagster and Apache Airflow while implementing automated data-quality checks and threshold-deviation alerts to notify teams of shipment delays. Established strict data contracts and SLAs between upstream producers and downstream consumers to enforce schema stability and guarantee long-term pipeline reliability. Implemented Liquibase for database schema versioning, allowing the team to automate stateful migrations and execute safe, version-controlled changes directly inside Snowflake. Automated continuous integration and deployment workflows using GitHub Actions to run unit tests, execute SQLFluff linting, and deploy dbt models and pipeline infrastructure safely.