Skip navigation EPAM

Senior/Lead Data Engineer (Python, AWS) Poland

  • hot

Senior/Lead Data Engineer (Python, AWS) Description

Job #: 92312
Our client is the world's 2nd largest asset management company, whose modernization projects are driven by digital transformation focused on Agility, innovation, and automation.


We are looking for a Senior/Lead Data Engineer, who will have exposure to Enterprise-scale, high-volume, distributed architecture. Entirely Cloud Native architecture is based on AWS – Serverless is the focus point.

We are looking for a candidate who will join our team in Gdansk or Krakow.

What You’ll Do

  • Analyzing data to resolve any production issues
  • Creating STTM, data models and DDL
  • Utilize data engineering skills to bring data from various data sources into the data warehouse
  • Design and implement data models, data transformations, manipulation and enhancements
  • Create and modify/maintain data pipelines to ingest data into the data lakes
  • Produce data insights as per business requirements
  • Migrate legacy Spark jobs
  • Designing event-based data pipelines
  • Investigating and resolving the production data quality issues
  • Implementing automated test cases for pipelines
  • Implementing Glue ETL jobs
  • Setting up the infrastructure for the data pipelines
  • Deploying and managing pipelines in production
  • Investigating and fixing any prod job failures
  • Production support

What You Have

  • Strong coding skills in Python
  • Solid coding skills in advanced SQL
  • In-depth understanding of relational databases and data warehouses
  • Experience in Python-based ETL (pySpark)
  • Excellent communication skills
  • Experience in the knowledge of AWS cloud-based stack, especially AWS Glue
  • Experience with Git / BitBucket
  • Experience with cron jobs and AWS workflows or any other enterprise scheduling solution
  • Production support expertise
  • Design skills and solution expertise

Nice to have

  • Knowledge of tools like Talend
  • Experience with Redshift
  • Experience in CloudFormation
  • Experience with Maven / Scala

We Offer

  • We gather like-minded people:
    • Friendly team and enjoyable working environment
    • Engineering community of industry’s professionals
    • Flexible schedule and opportunity to work remotely within Poland
    • Chance to work abroad for up to 60 days annually
    • Relocation within our 50+ offices
  • We provide growth opportunities:
    • Outstanding career roadmap
    • Leadership development, career advising, soft skills and well-being programs
    • Certification (GCP, Azure, AWS)
    • Unlimited access to LinkedIn Learning, Get Abstract, O’Reilly, Cloud Guru
    • Language classes on English and Polish for foreigners
  • We cover it all:
    • Stable income (Employment Contract or B2B)
    • Participation in the Employee Stock Purchase Plan
    • Referral bonuses
    • Benefits package (health insurance, multisport, shopping vouchers)
    • Corporate and social events
  • We may contact chosen candidates only

About EPAM

  • EPAM is a leading global provider of digital platform engineering and development services. We embrace a dynamic and inclusive culture, where you will collaborate with multi-national teams, contribute to a myriad of innovative projects, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential


Witaj. W czym możemy pomóc?