Professional Summary
Data Engineer with 7+ years of dedicated data engineering experience (since 2019) and 12+ years total career in tech, including IT consulting (XQ Informatics), agri-tech, fintech, telco, oil & gas, mining, and healthcare. Specialised in building scalable data platforms, ETL/ELT pipelines, and analytics infrastructure. Deep expertise in Python, SQL, BigQuery, Hadoop ecosystem, Airflow, dbt, and Kafka-based streaming. Proven ability to design cost-efficient pipelines, migrate legacy data warehouses, and build self-service BI foundations.
Key Highlights
60%
BigQuery cost reduction via pipeline + query optimization (EdenFarm)
50+
Production pipelines managed with 90%+ SLA (Koltiva)
7 Industries
IT Consulting, Fintech, Telco, Oil & Gas, Mining, Healthcare, Agri-tech
Hadoop → BigQuery
Multi-cloud data platform experience
Work Experience
Technical Lead
Jul 2026 – PresentStealth Startup · Contract (Oil & Gas Data Platform · NDA)
- Leading use-case-based data platform initiatives for an oil & gas client — architecting OT device streaming pipelines (Azure IoT Hub, Event Hubs, Fabric Eventstream) into a governed Microsoft Fabric Lakehouse with standardized ETL
- Delivering operational reporting and AI-related use cases (Azure AI Foundry, Document Intelligence) on top of the streaming data platform
- Working closely with the PM and joining solution brainstorming to close solution gaps; mentoring the junior data team
Koltiva
↔ Lateral moveHead of Product & Data Operations
Jun 2025 – Jun 2026- Led a cross-functional team of 13+ members across Global Helpdesk, Customer Support, Product Operations, and Data Operations, enhancing overall service delivery and operational efficiency
- Acted as Tier 1 and Tier 2 guardian, ensuring effective issue resolution, maintaining clear internal communication, and driving cross-department collaboration
- Conducted AI clustering analysis to generate data-driven insights, supporting continuous improvement initiatives across Product, Development, and Operations teams
↑ PromotedHead of IT Governance & Quality Assurance
Aug 2024 – May 2025- Led a team of 20–30 QA engineers, enhancing quality assurance across B2B and B2C product lines
- Standardized QA workflows with an execution-time-based testing framework, integrating automation for faster regression testing
- Supervised master data integrity initiatives and developed SOPs for database user access, improving compliance
Data Integrity & System Audit Manager (Project Lead)
Mar 2024 – Jul 2024- Led ERP alignment and data integrity GAP analysis in collaboration with CEO and cross-division teams
- Partnered with Product and Technology Divisions to assess system integrity and refine software development processes
Head of Technology / Data Engineer Manager
Jan 2023 – Feb 2024EdenFarm
- Architected cost-efficient data platform on BigQuery — reduced cloud spend by ~60% via query optimization, partition/cluster strategy, and pipeline audit
- Built and maintained ETL/ELT frameworks using Airflow, Fivetran, dbt, and Python-based pipelines
- Established Medallion Architecture (Bronze/Silver/Gold layers) for scalable data modeling
- Designed Python + Selenium multi-device crawling system for HORECA data collection (multi-device partitioning → PostgreSQL + CSV export)
- Led and mentored a data engineering team of 5 — from pipeline design to production deployment
Freelance Project Collaboration – Lead DE & Senior DE
Aug 2023 – Early 2024Healthcare Industry • Mining Industry
- Contributed as Lead Data Engineer on a healthcare project and Senior Data Engineer on a mining project — project-based collaborations done after office hours and on weekends
XQ Informatics (IT Consulting)
↑ PromotedTeam Lead & Tech Lead – Data Engineering & Data Science
Late 2019 – Jan 2023- Led data engineering projects across telco, oil & gas, mining, and fintech — from data lake design to near-real-time streaming
- Built end-to-end Hadoop ecosystem data platform for mining industry: SCADA/Kafka ingestion → NiFi → Spark → HDFS → Superset
- Migrated Oracle Data Warehouse to Hadoop Ecosystem at Indonesia's largest lab company without disrupting analytics workflows
- Built Telco analytics suite in Power BI connected to on-premise Cloudera via Enterprise Gateway; developed Python custom visuals
- Coordinated cross-functional teams of 10+ engineers; acted as embedded tech lead in client environments
Data Engineer & Data Visualization Specialist
Jul 2019 – Late 2019- Built initial data pipelines and BI dashboards across multiple client projects as individual contributor before promotion to Team Lead
Head of System Development
Sep 2018 – Jun 2019PT. Transportasi Jakarta (Transjakarta)
- Led software development teams and managed technical specifications for third-party platform integrations
Frontend Developer → Full Stack Developer
Aug 2016 – Aug 2018Dattabot (Digital Tech & Data Consulting)
- Built data-driven web applications and frontend interfaces for digital product platforms
Web Developer
Apr 2015 – Jun 2016PT EDI Indonesia (Government Payment Systems · Banking IT)
- Developed web-based systems for government tax payment modules (eTax, MPN G-2) in the bank team
IT Support, Lab Assistant & Freelance Web Developer
2013 – 2014Bank (IT Support) · Universitas Gunadarma · Freelance
- Served as IT Lead Support at a bank for 3 months, supporting banking system operations
- Lab assistant at Universitas Gunadarma and built freelance web projects while completing undergraduate studies
Skills & Competencies
Data EngineeringApache Kafka · NiFi · Hadoop (HDFS, Hive, Spark) · Airflow · dbt · Pentaho · Python (pandas, PySpark) · SQL · Fivetran · PostgreSQL · Parquet · Medallion Architecture · Selenium
Microsoft Fabric & AzureMicrosoft Fabric · Fabric Eventstream · Lakehouse · Azure Event Hubs · Azure IoT Hub · Azure AI Foundry · Document Intelligence · OT/IoT Device Streaming · ETL/ELT Standards
Cloud & PlatformGoogle BigQuery (partition/cluster/cost optimization) · Microsoft Azure · Hadoop Ecosystem · Kafka Streaming · VM Infrastructure · GCP Dataflow
Data Governance & OpsAccess Control Matrix · Change Management SOP · RBAC · Data Quality Monitoring · Pipeline SLA Management · Incident Response · Audit Trail · Great Expectations
Analytics & BIApache Superset · Power BI · Tableau · Looker Studio · SQL Analytics · Python (matplotlib, seaborn)
Web DevelopmentPython · REST API · PostgreSQL · MySQL · CodeIgniter 4 · React · Next.js · TypeScript
Education
Universitas Gunadarma
Bachelor of Industrial Technology, Information & Technology
2010 – 2014
Certifications
✓ Microsoft Certified: Azure Fundamentals (AZ-900)
✓ Microsoft Certified: Azure Data Fundamentals (DP-900)
✓ Microsoft Certified: Azure AI Fundamentals (AI-900)
✓ Microsoft Certified: Power BI Data Analyst Associate (PL-300) · 2021–2025
Portfolio
Full data engineering case studies with architecture, approach, and impact: debycandrakirana.com