Andre S.
Data Engineer at Ancient
Available now
About
Results-driven Data Engineer with fluent English and over two decades of hands-on experience in Software Development, specializing in complex Data and Analytics projects, with pronounced expertise in Spark/Databricks. Open to full-time, C2C, and nearshore opportunities in the US, Canada, or Europe. Read more
TALENT DETAILS
Professional experience
Prime - Big Data and Analytics
Migration to Spark/Databricks
Senior Data Engineer
Orchestrated the migration of a critical system from Hadoop/EMR to Spark/Databricks, resulting in an 80% reduction in costs and execution time. Conducted interviews and mentoring with Junior developers. Conducted proof of concepts with Large Language Models (LLMs). Read more
Website
Prime - Big Data and Analytics
Reporting Platform (Braintree)
Senior Data Engineer
Responsible for the maintenance and on-call support of the Reporting Platform (Braintree) project. Designed and implemented new reports. Read more
Website
Prime - Big Data and Analytics
Data Lake/Datalakehouse Implementation
Senior Data Engineer
Introduced Data Lake/Datalakehouse concepts with Spark/Databricks. Led product provisioning, data mapping on upstream systems, and initiated the coding of the first ETLs. Provided support for Junior developers. Read more
Website
Prime - Big Data and Analytics
(Legal Frauds, Cloud Cost Management, Log Analytics)
Senior Data Engineer
Conducted Proof of Concepts and performance tests with services on Azure platform. Provided cloud support as a level 3 team member. Offered architecture advisory for other teams. Read more
Website
Prime - Big Data and Analytics
Warranty Fraud Detection and Parts Failure Forecasts
Senior Data Engineer
Led the pilots for Warranty Fraud Detection and Parts Failure Forecasts. Read more
Website
Prime - Big Data and Analytics
Sales and Campaign Analytics
Senior Data Engineer
Integrated data from 5 countries (US, China, Brazil, Argentina, and Mexico) for Sales and Campaign Analytics. Developed initial designs and ETLs. Read more
Website
Top Skills and Experience
Verified by Pangea.ai due diligence
5
Skills
Top Skills | Current Usage | Seniority |
---|---|---|
AWS | 50% | 7 years |
Python | 20% | 4 years |
Google Cloud Platform | 20% | 3 years |
AWS Chatbot | 5% | 2 years |
Terraform | 5% | 4 years |
Apps & Tools Preferences
Employment
Senior Data Engineer
Prime
2015 - pressent
Senior Data Engineer
Product Manager / Software Architect / Full Stack Developer
Governo do estado de sao paulo
2011 - 2014
Product Manager / Software Architect / Full Stack Developer
Testimonials
“he is an excellent teammate and his commitment is total“ Read more
Rodrigo F.
VERIFIED
“he is an excellent teammate and his commitment is total“ Read more
Rodrigo F.
VERIFIED
“he is an excellent teammate and his commitment is total“ Read more
Rodrigo F.
VERIFIED
“he is an excellent teammate and his commitment is total“ Read more
Rodrigo F.
VERIFIED
“he is an excellent teammate and his commitment is total“ Read more
Rodrigo F.
VERIFIED
“he is an excellent teammate and his commitment is total“ Read more
Rodrigo F.
VERIFIED