Data Operations Engineer

Our client needs the suport of Data Operations Engineers (1 Senior,1-2 Junior-level). The positions are based in Poland, with the option for remote work.

Key responsibilities

Collaborate with the DROC team to understand their data requirements and project goals

Act as the first point of contact for queries related to data operations

Triage and classify issues, ensuring they are directed to the appropriate team (development or platform) if further support is needed

Track and report progress to the team and Product Owner

Run ETL processes for DROC validation on Hadoop infrastructure

Refresh UIs using Elasticsearch for validation purposes

Assist the team in writing Spark/Hive queries for data analysis

Work with the development and teams to apply configuration changes as needed

Ideal candidate profile

Strong understanding of end-to-end ETL pipelines

Proficiency in data engineering principles, with expertise in writing Hive SQL (Spark) queries and Scala (crucial)

Experience with shell scripting (important)

Familiarity with Cloudera distribution (Oozie) (important)

Basic knowledge of Elasticsearch

Experience with Quantexa (important)

Familiarity with IntelliJ, Zeppelin, Bamboo, Jenkins, Nexus, Artifactory, and Kafka (nice to have)

Conditions

Location: Łódź / Warsaw / Gdańsk / Gdynia

Hybrid work – at least 1x/week on-site

Employment type: B2B contract 

Recruitment steps

 Phone call with our Recruiter

 Meeting with the Client's Manager

 Decision and feedback

ID: 831 job_post.published_on: 12/09/2024
announcement.apply