Skip navigation EPAM

Senior Data Engineer with Databricks Kazakhstan or Remote

  • hot

Senior Data Engineer with Databricks Description

Job #: 89948

Description


Are you looking for an opportunity to get into a diverse team and work with a leading retail client in Europe with ongoing businesses in numerous countries?

Join our community of Data professionals and become a part of Data Products pipelines migration from Oracle workloads to Databricks.

In this role, you will assess and implement new database technologies: from hybrid cloud and local infrastructures to replication, scalability, resiliency & redundancy.
#Senior-data-scala-developer4

What You’ll Do

  • Develop, monitor, and operate data pipeline - Sales Order Data (with Post-order information: shipment, return, payment)
  • Work with engineering teams to build and improve the "Single Source of Truth" KPI for business steering (central Profit Contribution measurement)
  • Redevelop old legacy pipelines to new, advanced and standard versions
  • Leverage and improve a cloud-based tech stack (AWS, Databricks, Kubernetes, Spark, Airflow, Python, and Scala)

What You Have

  • Background in Apache Spark and Spark streaming
  • Hands-on experience with Databricks
  • Solid knowledge of Scala programming language
  • Expertise in GitHub + CI/CD
  • Fluency in English, both written and verbal

Nice to have

  • Proficiency in Delta-Lake and SQL
  • Familiarity with AWS landscape
  • Ability to build Apache Airflow pipelines
  • Experience in Presto, Superset, Starburst, Oracle & Exasol

We Offer

  • Outstanding career development opportunities with a transparent roadmap to accelerate your journey
  • Knowledge sharing within the community of the industry’s top professionals worldwide
  • Various opportunities for self-development: hard & soft skills internal training courses, mentoring programs, and unlimited access to 8,000+ LinkedIn Learning courses
  • Free English classes with certified teachers
  • Competitive compensation in USD, regular assessments, and salary reviews
  • Bonuses for participating in the referral program
  • Flexible schedule and opportunity to work remotely from any place in Kazakhstan
  • Friendly team and enjoyable working environment
  • Relocation opportunities within our offices in 50+ countries with throughout support for you and your family
  • 28 vacation days and six trust days per year (sick leave without a medical certificate)
  • Medical & family care programs, corporate and social events

About EPAM

  • EPAM Kazakhstan is a team of technologists and innovators united by a passion for technology. Today we operate across all cities with offices in Astana, Almaty, and Karaganda and work with the world's leading companies from different industries. EPAM builds a continuously learning organization and helps its employees reach their full potential and achieve their professional goals through learning. Our agile methodologies, customer collaboration frameworks, engineering excellence programs, and hybrid teams offer many career paths and development opportunities

Witaj. W czym możemy pomóc?

NASZE LOKALIZACJE