Junior / Mid Big Data Engineer
Junior / Mid Big Data Engineer
Poznań, WP, PL, 61-569 Łódź, PL, 90-118 Warszawa, PL, 00-839 Kraków, PL, 30-302
Your tasks
- Design, implement, and optimize data pipelines and workflows leveraging tools and technologies within the Hadoop ecosystem, including: HDFS, YARN, Spark, HBase, Impala, HIVE
- Java Expertise for APIs and Batch Processes
- Build and deploy RESTful APIs using Java Spring Boot to facilitate seamless data integration and interoperability across systems
- Design and maintain batch processes using Java, ensuring the efficient execution of data workflows and business logic
- Implement robust error handling, logging, and monitoring solutions
- Database Management
- Maintain, and optimize relational database solutions using Oracle DB
- Write complex and efficient SQL & Spark SQL queries to ensure optimal database
Your skills
- At least 2 years of commercial experience as a Data Engineer
- Strong SQL knowledge
- Experience with Hadoop ecosystem including: HDFS, YARN, Spark, HBase, Impala, HIVE
- Proficiency in distributed computing frameworks and data processing at scale
- Experience with ETL pipelines and data modelling
- Solid understanding of cluster management, big data troubleshooting, and API development using Java Spring
- Strong analytical and problem-solving skills with attention to detail
We offer you
- Working in a highly experienced and dedicated team
- The first contract is for 6 months, with the possibility of extension
- Competitive salary and extra benefit package that can be tailored to your personal needs (private medical coverage, sport & recreation package, lunch subsidy, life insurance, etc.)
- On-line training and certifications fit for career path
- On-line foreign language lessons
- Social events
- Access to e-learning platform
- Ergonomic and functional working space