Senior/Lead Data Engineer (Python, AWS) Poland
Senior/Lead Data Engineer (Python, AWS) Description
Job #: 92312
Our client is the world's 2nd largest asset management company, whose modernization projects are driven by digital transformation focused on Agility, innovation, and automation.
We are looking for a Senior/Lead Data Engineer, who will have exposure to Enterprise-scale, high-volume, distributed architecture. Entirely Cloud Native architecture is based on AWS – Serverless is the focus point.
We are looking for a candidate who will join our team in Gdansk or Krakow.
SEE YOURSELF IN THIS ROLE
We are looking for a Senior/Lead Data Engineer, who will have exposure to Enterprise-scale, high-volume, distributed architecture. Entirely Cloud Native architecture is based on AWS – Serverless is the focus point.
We are looking for a candidate who will join our team in Gdansk or Krakow.
What You’ll Do
- Analyzing data to resolve any production issues
- Creating STTM, data models and DDL
- Utilize data engineering skills to bring data from various data sources into the data warehouse
- Design and implement data models, data transformations, manipulation and enhancements
- Create and modify/maintain data pipelines to ingest data into the data lakes
- Produce data insights as per business requirements
- Migrate legacy Spark jobs
- Designing event-based data pipelines
- Investigating and resolving the production data quality issues
- Implementing automated test cases for pipelines
- Implementing Glue ETL jobs
- Setting up the infrastructure for the data pipelines
- Deploying and managing pipelines in production
- Investigating and fixing any prod job failures
- Production support
What You Have
- Strong coding skills in Python
- Solid coding skills in advanced SQL
- In-depth understanding of relational databases and data warehouses
- Experience in Python-based ETL (pySpark)
- Excellent communication skills
- Experience in the knowledge of AWS cloud-based stack, especially AWS Glue
- Experience with Git / BitBucket
- Experience with cron jobs and AWS workflows or any other enterprise scheduling solution
- Production support expertise
- Design skills and solution expertise
Nice to have
- Knowledge of tools like Talend
- Experience with Redshift
- Experience in CloudFormation
- Experience with Maven / Scala
We Offer
- We gather like-minded people:
- Friendly team and enjoyable working environment
- Engineering community of industry’s professionals
- Flexible schedule and opportunity to work remotely within Poland
- Chance to work abroad for up to 60 days annually
- Relocation within our 50+ offices
- We provide growth opportunities:
- Outstanding career roadmap
- Leadership development, career advising, soft skills and well-being programs
- Certification (GCP, Azure, AWS)
- Unlimited access to LinkedIn Learning, Get Abstract, O’Reilly, Cloud Guru
- Language classes on English and Polish for foreigners
- We cover it all:
- Stable income (Employment Contract or B2B)
- Participation in the Employee Stock Purchase Plan
- Referral bonuses
- Benefits package (health insurance, multisport, shopping vouchers)
- Corporate and social events
- We may contact chosen candidates only
About EPAM
- EPAM is a leading global provider of digital platform engineering and development services. We embrace a dynamic and inclusive culture, where you will collaborate with multi-national teams, contribute to a myriad of innovative projects, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential
