Data Engineer · Python Developer

Building scalabledata ecosystems andbackend services.

I build metadata-driven ELT architectures, modernize cloud data integrations, and develop robust backend services.

Portrait of Gnana Sarathy Alagesan
Snowflake
Python
Airflow
Google Cloud
Databricks
AWS
FastAPI
Data Pipeline
  • 4+

    Years Experience

  • Snowflake · Airflow · GCP · AWS

    Core Technologies

  • Databricks Professional

    Certified Engineer

  • Snowflake SnowPro

    Core Certified

Career progression

Experience

  1. 04/2024 - Present

    Chennai, India

    Consultant - Data

    CDW

    • Designed and built scalable metadata-driven ETL/ELT pipelines and data integration workflows across APIs, SQL Server, Snowflake, and Google Cloud environments.
    • Developed backend services focused on Python, FastAPI, event-driven processing (AWS Lambda), and serverless workflows.
    • Built solutions to extract structured data from unstructured PDF documents using Snowflake Cortex AI and initiated PoC for self-healing pipelines.
    • Implemented robust data governance controls including PII anonymization, data masking policies, role-based grants, and data quality validation mechanisms.
    • Snowflake
    • Airflow
    • Python
    • FastAPI
    • AWS Lambda
    • GCP
  2. 04/2023 - 03/2024

    Chennai, India

    Associate Consultant - Data

    CDW

    • Built metadata-driven ELT pipelines and export workflows from Snowflake to AWS S3, SFTP, SQL Server, and Salesforce APIs.
    • Orchestrated complex data pipelines utilizing Apache Airflow, effectively improving pipeline throughput by approximately 30%.
    • Developed Snowflake stored-procedure-based data quality checks to ensure accuracy prior to downstream integration.
    • Automated JSON generation workflows from Excel using Python, reducing manual reporting effort by ~70%.
    • Snowflake
    • Airflow
    • Python
    • AWS S3
  3. 06/2022 - 03/2023

    Chennai, India

    Consultant Trainee - Data

    CDW

    • Automated the ingestion of streaming/event data from Google Analytics and Azure App Insights into Snowflake utilizing Snowpipe.
    • Designed logical data models and ER mappings for an internal hiring application using PostgreSQL.
    • Contributed to backend application development using Flask, reducing manual HR effort by approximately 40%.
    • Snowpipe
    • PostgreSQL
    • Flask
  4. 02/2022 - 05/2022

    Chennai, India

    Intern

    CDW

    • Completed comprehensive full-stack development and cloud technology training program.
    • Contributed to the development of an internal social media platform using web frameworks and relational databases.

Selected enterprise work

Projects

High-impact cloud architectures, data migration workflows, and backend microservices delivered for global clients.

Enterprise

Migration & Automation

Global Fitness Franchise & Wellness Brand

Designed scalable, metadata-driven ELT pipelines using Snowflake and Airflow, supporting enterprise data migration, unstructured data extraction, entity resolution, secure data integration, governance, and data quality.

  • Snowflake
  • Airflow
  • AWS S3
  • Snowflake Cortex AI
  • Salesforce API

Global Fitness Franchise & Wellness Brand

Data Engineering & Modernization

Key Contributions

  • Designed and developed metadata-driven ELT pipelines integrating Snowflake and Apache Airflow to automate end-to-end data processing workflows.
  • Played a key role in migrating enterprise data from Netezza to Snowflake, developing Airflow-orchestrated pipelines and scalable Snowflake transformations.
  • Worked across structured, semi-structured, and unstructured data processing requirements.
  • Designed an architecture for extracting information from unstructured PDF documents and loading the extracted data into structured tables using Snowflake Cortex AI.
  • Designed and implemented data migration workflows involving multiple enterprise source systems.
  • Built pipelines to export data to an AWS Entity Resolution solution to identify and stitch member records across different systems and establish a unified member identity.
  • Designed data export frameworks to deliver Snowflake data to external agency systems through Amazon S3, SFTP, and Salesforce APIs.
  • Implemented data governance and security controls, including PII anonymization, data masking policies, data-level access controls, and role-based grants.
  • Ensured data governance compliance across enterprise data pipelines.
  • Initiated a proof of concept for a self-healing data pipeline framework using Snowflake Cortex AI to automate failure detection and remediation.
  • Designed and implemented data quality validation mechanisms to improve reliability of downstream data consumption.

Enterprise

GCP Cloud Architecture

Energy & Infrastructure Solutions Company

Designed and implemented historical and incremental data migration workflows from APIs and SQL Server into Google Cloud, using Python, batch processing, partitioning, GCS, Delta format, Cloud Functions, and Workflows.

  • Google Cloud
  • GCS
  • Cloud Functions
  • Delta Lake
  • Python

Energy & Infrastructure Solutions Company

Data Migration & Google Cloud Engineering

Key Contributions

  • Designed an approach for migrating historical and incremental data from APIs and SQL Server into a Google Cloud environment.
  • Developed Python-based data extraction and migration workflows using Google Cloud notebooks.
  • Implemented batching and partitioning strategies to efficiently process large volumes of source data.
  • Loaded processed datasets into Google Cloud Storage (GCS) using Delta format.
  • Converted the initial notebook-based data processing logic into Google Cloud Functions for scalable and automated execution.
  • Designed scheduled execution workflows using Google Workflows to orchestrate the data ingestion process.
  • Built an architecture supporting both historical backfill and incremental data ingestion.

Enterprise

Backend Microservices

Banking Institution

Designed and delivered scalable backend APIs and serverless workflows using Python, FastAPI, and AWS Lambda, while providing technical leadership for a six-member backend development team.

  • FastAPI
  • AWS Lambda
  • Python
  • Microservices
  • REST APIs

Banking Institution

Senior Python Developer / Backend Engineering Lead

Key Contributions

  • Worked as a Senior Python Developer and offshore backend engineering lead for a banking client.
  • Led a six-member backend development team responsible for designing and delivering scalable backend services.
  • Designed and developed backend APIs using FastAPI.
  • Developed RESTful endpoints supporting business workflows and application integrations.
  • Worked with AWS Lambda for event-driven processing and backend workflows.
  • Designed and implemented event-based triggers and serverless workflows.
  • Provided technical leadership through code reviews, technical mentoring, architecture discussions, development guidance, and performance optimization.
  • Coordinated delivery across the offshore development team.

Capabilities

Skills

The platforms, languages, and practices I use to design reliable enterprise data systems.

Data Engineering

  • ETL/ELT
  • Data Warehousing
  • Data Modeling
  • Data Integration
  • CDC
  • Data Governance
  • PII Masking

Data & Compute Platforms

  • Snowflake
  • Databricks
  • Spark
  • Airflow
  • DBT
  • Fivetran
  • ADF

Cloud Providers & DevOps

  • AWS (Lambda, S3)
  • Google Cloud (GCS, Functions)
  • Git
  • CI/CD

Programming & Backend

  • Python
  • SQL
  • FastAPI
  • Flask
  • Java
  • JavaScript
  • GraphQL

Databases & Streaming

  • PostgreSQL
  • MySQL
  • SQL Server
  • Kafka
  • Snowpipe

AI / ML

  • Snowflake Cortex AI
  • Gemini LLM
  • WatsonX
  • NLP
  • Machine Learning

Recognition

Hackathons & Recognition

2025

Top 50 / 300+ Teams

IBM TechXchange

Placed in the top 50 among 300+ teams.

Above and Beyond Award

CDW

Feather in the Cap Award

CDW

Databricks Data Engineer

Professional Certification

Snowflake SnowPro

Core Certification

Fivetran Certified

Data Integration

About

About Me

Education

  • B.Tech - Information Technology

    Sri Ramakrishna Engineering College

    Anna University, Coimbatore

    2018 - 2022

Hobbies

  • Riding bikes
  • Cinema
  • Anime

Contact

Get in Touch

Have a question or want to connect? Reach out by email, LinkedIn, or GitHub.