Senior Data DevOps Engineer (Databricks, AWS) Remote
Senior Data DevOps Engineer (Databricks, AWS) Description
We are seeking a Senior Data DevOps Engineer with a passion for making a significant impact in the dynamic world of fashion e-commerce to join the Data team at our client, renowned as a top-tier fashion e-commerce platform.
As a Senior Data DevOps Engineer in Data Platform, you will focus on maintaining and implementing new features in the data transformation architecture, which is the backbone of the analytical data platform at the Client. By constantly challenging the status quo, you will deliver high-performance data processing solutions that are efficient and reliable at scale.
This is a fully remote position, offering you the flexibility to work from any location in Poland, whether it's your home or one of our well-equipped offices in Gdansk, Katowice, Krakow, Lodz, Warsaw, or Wroclaw.
If you are passionate about helping clients grow great brands and would like to start a new career journey soon, apply now!
#Data-Fashion-Tech
#Data
#DJ
SEE YOURSELF IN THIS ROLE
As a Senior Data DevOps Engineer in Data Platform, you will focus on maintaining and implementing new features in the data transformation architecture, which is the backbone of the analytical data platform at the Client. By constantly challenging the status quo, you will deliver high-performance data processing solutions that are efficient and reliable at scale.
This is a fully remote position, offering you the flexibility to work from any location in Poland, whether it's your home or one of our well-equipped offices in Gdansk, Katowice, Krakow, Lodz, Warsaw, or Wroclaw.
If you are passionate about helping clients grow great brands and would like to start a new career journey soon, apply now!
#Data-Fashion-Tech
#Data
#DJ
What You’ll Do
- Operational Excellence:
- Troubleshoot user issues related to Databricks (Spark) and suggest optimizations for long-running or resource-intensive jobs
- Guide users on best practices for Databricks cluster management
- Consult and help our diverse teams to develop, implement, and maintain sustainable, high-performance, growth-ready data-processing, and data integration systems
- Delivering New Features:
- Implement services that improve the CI/CD experience of users by emphasizing self-service
- Work together with other teams in the client’s Data Infrastructure to deliver services that serve as a backbone for their central datalake
- Compliance & Security:
- Improve data access methods to provide a bulletproof, secure, and by default compliant self-service platform
- Cost Savings:
- Guide users and support them to find a cost-effective setup while keeping efficiency high
- Implement observability solutions in Databricks to reduce slack cost
- Drive users to adopt edge Databricks features like Photon and Graviton instances
- Review current infrastructure to find cost-saving opportunities
What You Have
- Proficient knowledge in working with distributed data processing frameworks like Apache
- Spark and a good understanding of relational database management systems
- Heavy hands-on experience with Databricks
- Hands-on experience with Python and Scala combined with SQL knowledge
- Hands-on experience in cloud technologies (AWS services like IAM, S3, Lambda, EC2)
- Engineering craftsmanship with an experience in software development processes focusing on testing, continuous integration/continuous delivery (CI/CD), monitoring and writing documentation
Nice to have
- AWS Networking or Basics of Networking on AWS cloud
- Hands-on experience with Terraform
We Offer
- We gather like-minded people:
- Friendly team and enjoyable working environment
- Engineering community of industry’s professionals
- Flexible schedule and opportunity to work remotely within Poland
- Chance to work abroad for up to 60 days annually
- Relocation within our 50+ offices
- We provide growth opportunities:
- Outstanding career roadmap
- Leadership development, career advising, soft skills and well-being programs
- Certification (GCP, Azure, AWS)
- Unlimited access to LinkedIn Learning
- Language classes on English and Polish for foreigners
- We cover it all:
- Stable income
- Participation in the Employee Stock Purchase Plan
- Referral bonuses
- Benefits package (health insurance, multisport, shopping vouchers)
- Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and many more
- Corporate and social events
- We may contact chosen candidates only
About EPAM
- EPAM is a leading global provider of digital platform engineering and development services. We embrace a dynamic and inclusive culture, where you will collaborate with multi-national teams, contribute to a myriad of innovative projects, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential
