Job description_

About the Role_

We are seeking a highly experienced Software Development Engineer to lead and support the migration of ETL jobs and databases from on-premises environments to the AWS Cloud. This hands-on role requires someone who can thoroughly understand existing on-premises ETL jobs, build new ETL solutions when needed, and serve as the expert guiding the team.
The role covers job execution, data validation, data quality and adherence to data compliance and business rules, as well as AWS infrastructure-as-code, developing ETL solutions that replicate on-premises processes in the cloud, orchestrating and validating jobs, and providing production support. Strong development expertise and a solid background in data analytics are required.

A day in this role_

- Develop with DataStage or Informatica, Korn Shell, Python and Perl scripting on Unix/Linux platforms.
- Design, develop and implement AWS Glue PySpark ETL processes to load data from various sources into Redshift and Aurora PostgreSQL data warehouses and data lakes.
- Develop scalable full-stack applications, including front-end and back-end components or APIs, as required.
- Conduct business and data analysis/validation to minimize errors and inconsistencies and support business decisions.
- Collaborate with data analysts, data architects and team members to analyze source data, improve data accuracy and integrity, and implement data reporting.
- Automate and orchestrate ETL processes, applications and APIs across on-premises and cloud environments.
- Provide production support: monitor, troubleshoot and resolve issues with ETL processes, configurations and data integrity.
- Document processes, data mappings, data flows, APIs, application code and support procedures.
- Perform impact analysis and communicate technical concepts to larger audiences.
- Ensure data and application security and compliance with data protection regulations.
- Participate in code reviews, follow best practices and give constructive feedback to peers.

The expertise requested_

- Bachelor's degree in Computer Science, Information Technology or a related field.
- 8+ years of experience in ETL development, data warehousing, AWS cloud services and API development.
- Strong understanding of data integration, transformation and loading processes on AWS.
- Expertise with DataStage or Informatica, Shell scripting, Perl and Python.
- Experience with API development using REST and SOAP.
- Advanced skills with AWS Glue, Step Functions, Airflow DAGs, Lambda, S3, EC2 and other AWS services.
- Proficiency in SQL with on-premises relational databases (e.g. DB2 on AIX) and AWS databases (Amazon RDS, Aurora PostgreSQL, Redshift).
- Experience with version control tools such as Git or Bitbucket.
- Familiarity with Jenkins pipelines and CI/CD processes.
- Demonstrated data analysis/validation experience using tools such as Excel, Python and Tableau.
- Experience working with Agile development methodologies.

Desired or nice to have expertise_

- AWS certifications.
- Expertise in AI/ML.
- Automotive industry knowledge.
- Keeping up to date with industry trends in ETL, full-stack development, data analysis and cloud technologies.
- Backend

Our Core values are focus to inclusion and diversity, all qualified applicants will be considered for employment and will go thru a fair recruitment process regardless of their race, religion, gender identity, sexual orientation, national origin or disability status.