Our client needs the suport of Data Operations Engineers (1 Senior,1-2 Junior-level). The positions are based in Poland, with the option for remote work.
Data Operations Engineer
Key responsibilities
Collaborate with the DROC team to understand their data requirements and project goals
Act as the first point of contact for queries related to data operations
Triage and classify issues, ensuring they are directed to the appropriate team (development or platform) if further support is needed
Track and report progress to the team and Product Owner
Run ETL processes for DROC validation on Hadoop infrastructure
Refresh UIs using Elasticsearch for validation purposes
Assist the team in writing Spark/Hive queries for data analysis
Work with the development and teams to apply configuration changes as needed
Ideal candidate profile
Strong understanding of end-to-end ETL pipelines
Proficiency in data engineering principles, with expertise in writing Hive SQL (Spark) queries and Scala (crucial)
Experience with shell scripting (important)
Familiarity with Cloudera distribution (Oozie) (important)
Basic knowledge of Elasticsearch
Experience with Quantexa (important)
Familiarity with IntelliJ, Zeppelin, Bamboo, Jenkins, Nexus, Artifactory, and Kafka (nice to have)
Conditions
Location: Łódź / Warsaw / Gdańsk / Gdynia
Hybrid work – at least 1x/week on-site
Employment type: B2B contract
Recruitment steps
Phone call with our Recruiter
Meeting with the Client's Manager
Decision and feedback