Senior Data Platform Support Engineer Portugal
Senior Data Platform Support Engineer Description
Job #: 91750DESCRIPTION
Our client is a publicly traded German online fashion and beauty retailer active across Europe.
As a Data Engineer in a Data Platform, you will be supporting 1000+ stakeholders focusing on data transformation and pipeline orchestration technologies. By constantly challenging the status quo, you will ensure stakeholder teams deliver high-performance data processing solutions that are efficient and remain reliable at scale
Responsibilities
- Automation of support activities (e.g cluster creations, configuration changes)
- Improving documentation to address user inquiries
- Prioritizing customer queries and escalating serious technical issues to 2nd level
- Stakeholder support through chat and support tickets
- Troubleshooting user issues related to Databricks (Spark) / Airflow and suggesting optimizations for long running or resource intensive jobs
- Guiding users on best practices of Databricks and Airflow cluster management
- Consult and help our diverse teams to develop, implement and maintain sustainable, high-performance, growth-ready data-processing and data integration systems
- Having documentation focus to improve user journey
Requirements
- Basic understanding of distributed data processing frameworks like Apache Spark
- Understanding of relational database management systems
- Experience with:
- Databricks
- Apache Airflow/Amazon Managed Workflows for Apache Airflow
- Python combined with SQL knowledge
- Cloud technologies (AWS services like S3, EC2, IAM, Cloudformation)
- Container/orchestration tools (Kubernetes, Docker, Podman)
- Engineering craftsmanship with an experience in software development processes focusing on testing, continuous integration/continuous delivery (CI/CD), monitoring and writing documentation
- Upper-Intermediate level of English, both spoken and written (B2+)
Nice to have
- Knowledge on AWS Step Functions, Cloudwatch, Lambda
We Offer
- Competitive compensation depending on experience and skills
- Variety of projects within one company
- Being a part of a project following engineering excellence standards
- Individual career path and professional growth opportunities
- Internal events and communities
- Flexible work hours
