Senior Data Engineer (Scala, Databricks) Remote
Senior Data Engineer (Scala, Databricks) Description
Job #: 92310
Our client is one of the biggest fashion e-commerce platforms. We are looking for a Senior Data Engineer to join our Data Practice.
You will be a part of a Team of 3 Engineers, 2 Analysts and a Product Manager.
You will be participating in migrating Data products pipelines from Oracle workloads to Databricks.
SEE YOURSELF IN THIS ROLE
You will be a part of a Team of 3 Engineers, 2 Analysts and a Product Manager.
You will be participating in migrating Data products pipelines from Oracle workloads to Databricks.
What You’ll Do
- Develop, monitor, and operate the most used and critical curated data pipeline - Sales Order Data (incl. Post-order information, e.g., shipment, return, payment). This pipeline processes hundreds of millions of records to provide high-quality datasets for analytical and machine-learning use cases
- Consulting with analysts, data scientists, and product managers to build and continuously improve the "Single Source of Truth" KPI for business steering, such as the central Profit Contribution measurement (PC II)
- Leverage and improve a cloud-based tech stack that includes AWS, Databricks, Kubernetes, Spark, Airflow, Python, and Scala
What You Have
- Expertise in Apache Spark along with Spark Streaming and Spark SQL
- Good hands-on experience with Databricks and delta-lake
- Fluency in Scala programming language
- Good understanding and hands-on experience with CI/CD
- Rich working experience with GitHub
- Fluency working with AWS landscape
- Ability to build Apache Airflow pipelines
Nice to have
- Presto
- Superset
- Starburst
- Exasol
We Offer
- We gather like-minded people:
- Friendly team and enjoyable working environment
- Engineering community of industry’s professionals
- Flexible schedule and opportunity to work remotely within Poland
- Chance to work abroad for up to 60 days annually
- Relocation within our 50+ offices
- We provide growth opportunities:
- Outstanding career roadmap
- Leadership development, career advising, soft skills and well-being programs
- Certification (GCP, Azure, AWS)
- Unlimited access to LinkedIn Learning, Get Abstract, O’Reilly, Cloud Guru
- Language classes on English and Polish for foreigners
- We cover it all:
- Stable income (Employment Contract or B2B)
- Participation in the Employee Stock Purchase Plan
- Referral bonuses
- Benefits package (health insurance, multisport, shopping vouchers)
- Corporate and social events
- We may contact chosen candidates only
About EPAM
- EPAM is a leading global provider of digital platform engineering and development services. We embrace a dynamic and inclusive culture, where you will collaborate with multi-national teams, contribute to a myriad of innovative projects, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential
