Data Engineer

Hakkoda

---

2023 - 2024

Develop and maintain SQL procedures, views, and functions to streamline data processing for data-driven analytics needs. Use of DBT to automate data transformations, modeling tasks, snapshots (SCD Type II) and testing. Implement quality checks to ensure data precision, completeness, and consistency for reliable data analysis. Designed, build, and manage data pipelines for seamless data extraction, transformation, and loading from various sources to Snowflake. Collaborated effectively with direct client teams to understand data requirements using agile scrum methodology. Migrated on-premises data to Snowflake ensuring smooth integration and optimized performance. Continuous monitor of data models for performance, scalability, and reliability. Data Migration from on premise EDW to Snowflake. Analysis of concepts and requirements definitions. Determine current state and client expectations. Arrange tools needed to optimize execution (Fivetran, Coalesce, Shipyard, Snowflake). Design of architecture (layers, environments, workspaces) in snowflake and different tools environments. Design of security, personas, roles, object access.

Data Engineer

Deloitte

---

2021 - 2023

Develop new data transformation jobs, data import/export to other data source and targets. Work directly with reporting team to ensure ongoing ETL processes and new work complies with ETL best practices. Improve existing ETL designs. Identify process simplification opportunities for overall Data Warehouse environment. Provide ad-hoc support for advanced strategic data analysis initiatives. Review and verify of all underlying transformation logic against data in the data warehouse. Support business user questions about the data and provide documentation and training. Support developers with data inquiries, business logic and transformation rules for new data requests. Drive and participate in all new data aggregation / snapshot processes. Review of contingency backup restoration plan for all areas of the bank. Identification of organization’s critical functions and infrastructure. Develop emergency response policies and procedures to review all applications. Document current backup and restoration processes. Creation of routine tests and exercises. Attend meetings to review contingency plans.

Data Engineer

HCL

---

2020 - 2021

Design and implement ETL processes from multiple sources and targets. Created pipeline process to upload files to Amazon S3 and store the data to DynamoDB with a lambda function. Develop, test, and maintain ETL jobs using DataStage, control-m, and Unix. Document ETL source-to-target mappings considering company best practices. Deploy and test code from lower environments to production. Interact with business users and business analysts for gathering new business requirements. Created data extraction jobs from different sources, DB2, Oracle, Salesforce, etc. for data integration and for deeper understanding of the business landscape. Use of SQL to extract and validate data is loaded to target tables. Work with scrum methodology, attending and participating in daily standups, review, and retrospective. Develop process to backup files in Hadoop and store data in Hive tables using Control M and Unix scripting files. Use of Gitlab for continuous integration and deployment pipeline features, migrating ETL processes and Data from Netezza to Snowflake.

Senior ETL Developer / ETL Software Developer and Support

Softtek

---

2012 - 2018

Responsible for analyzing, designing, developing and implementing business requirements using ETL tool Informatica Power Center. Design and implement data masking solutions with Informatica Power Center to protect sensitive data. Understand business specifications and develop functional and technical designs. Document the software development life cycle of ETL processes (SDLC), design, testing, implementation, and maintenance. Provide technical support, resolve issues, and optimized current ETL process applications. Monitor performance of ETL processes. Integrate, automate, and orchestrate new and current application workflows process using Control M. Investigate, analyze, and provide support for technical issues for ETL process using IBM Infosphere DataStage. Track and update internal problems and customer-reported issues using remedy. Provided technical assistance for internal business applications and follow up issues using email, phone, and video conference. Involved in bug fixing and optimization of the current ETL process. Respond, resolve, and deliver timely, validated, well-tested work products. Design and develop new ETL jobs. Creation and modifications of Unix shell scripts for the pre/post execution of jobs. Schedule and monitor jobs through the Tivoli Workload Scheduler tool. Implementation of processes in production environments.

Junior ETL Developer

SIS

---

2009 - 2012

Designed and developed ETL processes using IBM Infosphere DataStage. Understand requirement specifications, data sources, data types and volumes. Document technical design with transformations, business logic, destination and data lineage. Test and monitor ETL process. Fix and optimize existing ETL process by changing the transformation logic to reduce running time. Monitoring the production ETL processes and provide support in the production environment. Worked with business analysts and data stewards to comprehend data in source systems. Developed source ETL jobs in ODI (Oracle Data Integrator) to extract data from different relational databases such as Oracle, MySQL and SQL Server. Identify and address data quality issues such as inconsistencies, missing values, data format. Developed transformation ETL jobs applying business rules. Load transformed data into the target system and validate using SQL query. Created test processes to verify accuracy and completeness of loaded data. Document ETL processes, test cases and data lineage. Worked with senior developers, analysts, and business users to present and communicate progress.