Senior / Staff Data Engineer · Data Platform Architect
venugkurella@gmail.com · venukurella@gmail.com · vnugny@gmail.com | (732) 610-4341 · (223) 237-7457 | LinkedIn | GitHub | Portfolio
Data platform architect with 21 years designing, building, and governing enterprise-scale data platforms for global financial institutions. Hands-on in the codebase every day, with the range to set data-engineering standards, own architecture across teams, and mentor engineers when the role calls for it. Deep expertise in real-time and batch data platforms — Kafka/streaming ingestion, Spark, Snowflake, Airflow, and Great Expectations — applied to regulated financial data domains (trades, sensitivities, positions, collateral, counterparty, regulatory reporting). Track record of measurable platform outcomes and organizational influence: 60% reduction in data incidents and >95% validation pass rates on critical datasets at Bloomberg, technical leadership of teams up to 13 engineers, and delivery of multi-year data-modernization programs across tier-1 banks and Fortune 500 firms.
| Data Platforms & Processing | Streaming & Cloud | Quality, Governance & Leadership |
|---|---|---|
| Snowflake, Redshift, Delta Lake / lakehouse | Kafka, Spark Structured Streaming | Great Expectations, OpenLineage, data profiling |
| Apache Spark / PySpark, Airflow, dbt | AWS (S3, MSK, Glue, EMR, Redshift) | MDM, lineage, data contracts, reconciliation |
| PostgreSQL, Oracle, Teradata, ClickHouse, Trino | REST APIs, CDC, event-driven design | Regulatory controls, auditability, SLA monitoring |
| ETL/ELT architecture, dimensional modeling | Terraform, Docker, GitHub Actions / CI-CD | Architecture reviews, standards-setting, mentoring |
| Python, SQL, PL/SQL, Shell | Informatica PowerCenter / IDQ / MDM | Stakeholder alignment, cross-team technical strategy |
Senior Engineer | Nov 2023 – Present · Consultant | Nov 2022 – Nov 2023
Global financial technology leader — Bloomberg Terminal, real-time market data, analytics, and trading platforms.
Data Quality Framework (DQF) — platform architecture & standards - Architected an enterprise data-validation platform on Great Expectations spanning PostgreSQL, Snowflake, Kafka, and S3 — reducing data-related incidents by 60% and achieving >95% validation pass rate on critical financial datasets. - Designed a metadata-driven expectation engine with dynamic rule generation from PostgreSQL rule tables (row-level filters, group-by aggregations, parameterized date logic) — establishing a reusable validation standard other engineers extend rather than reinvent. - Built custom expectations for financial reconciliation and compliance; integrated checkpoints into Airflow DAGs and Spark jobs with automated Data Docs and real-time Slack/email alerting. - Consumed real-time financial data from Kafka and REST APIs, unifying event-driven and request-response patterns into a single validation and ingestion architecture.
Bloomberg Contracts Database (BCDB) & workflow automation - Consolidated legacy contracts data into a unified Snowflake warehouse; cut ETL processing time 15% via parallelization and query optimization, with error handling, validation, and lineage baked into the pipeline design. - Delivered ETL for business-workflow automation and M&A data integration across 20+ stakeholders.
Snowflake Architect Consultant — Cox Automotive | Dec 2021 – Oct 2022 40,000+ dealer marketplace; 34,000 employees globally. - Architected a multi-zone Snowflake data lake (Landing / Sandbox / Reporting) supporting raw ingestion, data quality, and BI consumption at petabyte scale. - Led solution design and architecture sessions across 4 global business teams; drove end-to-end SDLC from requirements through implementation.
Snowflake Architect Consultant — Hewlett Packard Enterprise | Dec 2020 – Dec 2021 Unified HPE’s global learning and channel-partner systems into a single Snowflake platform. - Defined data architecture and governance (ODS, data masking, record retention, security) and delivered 16 IT projects improving partner experience while avoiding larger vendor-led engagements. - Implemented SnowSQL, SnowPipe, SnowAlert; led SQL performance profiling and tuning across transactional and warehouse layers.
Senior Data Engineer Consultant — Wells Fargo Bank | Sep 2018 – Dec 2020 Data Quality Management for Qualified Financial Contracts (QFC) — FDIC / Dodd-Frank compliance. - Owned ETL architecture across 9 financial data domains (Trades, Sensitivities, Positions, Collateral, Securities, Issuers, Ratings, Counterparty, Reference) on Informatica PowerCenter 10.2. - Defined Star/Snowflake schemas and SCD Type 1/2/3 strategies in Erwin; implemented profiling and validation in Informatica IDQ; built AWS S3→Redshift ingestion and Spark Streaming loads to Snowflake. - Led JAD sessions and owned data-quality sign-off for a high-visibility regulatory program.
Big Data Consultant — PVH Corp (Calvin Klein, Tommy Hilfiger) | May 2018 – Sep 2018 - Built Hadoop/Hive systems for core KPIs (Demand Waterfall, Forecast Accuracy, Days of Supply) at petabyte scale; engineered real-time multi-source ingestion into Snowflake.
INSIGHT: Credit Suisse’s global Credit Risk Monitoring system — 3M+ trades/day from 300+ feeds. - Led MDM and Data Quality Management as Team Lead of a 13-person team, governing Trades, Sensitivities, Positions, Collateral, Securities, and Reference data domains. - Delivered SRP (Strategic Risk Platform), RDR (Risk Data Rationalization), and DQM programs — multi-year initiatives improving regulatory-reporting accuracy and data latency across global risk systems. - Set the reject-reprocessing, SCD, and exception-handling patterns for all risk domains (Informatica PowerCenter/IDQ); owned Data Dictionary and Data Lineage for 10+ domains.
Environment: Informatica PowerCenter 9.6, IDQ, MDM · Oracle 11G / Exadata · Teradata 15.1 · SQL Server · Tableau · UNIX/Shell · CTRL-M
Software Analyst — Enterprise Data Warehouse | Nov 2006 – Jun 2010 - Designed star schemas and Informatica mappings (SCD Type 1/2) for a global mutual-fund EDW; tuned high-volume ETL and reconciled fact tables for accurate hourly global reporting.
Senior Software Engineer — Customer Master Migration | May 2005 – Oct 2006 - Built Informatica ETL for a centralized customer master (Aladdin, Solar, OMC, CSIR); automated 12 regulatory licensing processes supporting global pharmaceutical compliance.
Public, CI-verified — github.com/vnugny — 7 end-to-end projects (~190 tests, green CI on every push). Evidence of current, hands-on engineering.