Skip navigation EPAM

Key Data Engineer (Python / Scala / Azure) Armenia or Remote

  • hot

Key Data Engineer (Python / Scala / Azure) Description

Job #: 88103

Description


We are looking for a Key Data Engineer to join the project in the financial services industry. This role combines technical and people management skills for the data platform that require knowledge of financial data, big data processing and management, as well as cloud-based data warehouse solutions.

What You’ll Do

  • Build and maintain secure and compliant production data processing pipelines by using different tools and techniques (cloud services, Python/Scala)
  • Ensure that data pipelines and stores are high-performing, efficient, organized, and reliable, given business requirements and constraints
  • Design, implement, monitor and optimize data platforms to meet the data pipeline needs
  • Responsible for data-related implementation tasks: provisioning data storage services, ingesting streaming and batch data, transforming data, implementing security requirements, implementing data retention policies, identifying performance bottlenecks and accessing external data sources
  • Design and operationalize large-scale enterprise data solutions and applications using one or more Azure data and analytics services
  • Implement data solutions that use the following Azure services: Azure Cosmos DB, Azure Synapse Analytics, Azure Data Factory, Azure Stream Analytics, Azure Databricks, Azure Blob storage, Microsoft Purview, etc
  • Integrate, transform and consolidate data from various structured and unstructured data systems into a structure suitable for building analytics solutions
  • Design and implement data engineering, ingestion and curation functions on Azure cloud using Azure native or custom programming
  • Create data transformation and loading workflows

What You Have

  • Experience in Data Platforms and Azure’s PaaS offerings (Synapse, Purview, ADF, Databricks, Azure Data Lake Storage)
  • Competency in Azure: Synapse Analytics, Data Factory, Data Lake, Databricks, Microsoft Purview, Monitor, SQL Database, SQL Managed Instance, Stream Analytics, Cosmos DB, Storage Services, ADLS, Azure Functions, Log Analytics, Serverless Architecture, ARM Templates
  • Proficiency in data processing languages such as SQL, Java, Python or Scala
  • Strong notions of security best practices (e.g., using Azure Key Vault, IAM, RBAC, Monitor, etc.)
  • Understanding the data through exploration and experience with data retention, validation, visualization, preparation, matching, fragmentation, segmentation and enhancement processes
  • Familiarity with Azure Networking concepts
  • Certifications Preferred: “DP-203: Data Engineering on Microsoft Azure” and “DP-900: Microsoft Azure Data Fundamentals”

We Offer

  • Outstanding career development opportunities with a transparent roadmap to accelerate your journey
  • Knowledge sharing within the community of the industry’s top professionals worldwide
  • Various opportunities for self-development: hard & soft skills internal training courses, mentoring programs, and unlimited access to 8,000+ LinkedIn Learning courses
  • Free English classes with certified teachers
  • Competitive compensation, regular assessments, and salary reviews
  • Participation in the Employee Stock Purchase Plan
  • Flexible working schedule
  • Friendly team and enjoyable working environment
  • Relocation opportunities within our offices in 50+ countries with throughout support for you and your family
  • Bonuses for participating in the referral program
  • Medical & family care programs, corporate and social events

About EPAM

  • EPAM Armenia is a team of 900+ talented innovators united by a passion for technology. In 2014, we opened our first office in Yerevan, and now we have a second engineering hub in Gyumri. We've built a continuously learning organization that helps its employees rapidly advance their careers. Here you will work with the world's industry leaders, support impactful projects using the latest technologies, collaborate with multi-national teams, and have access to a wide variety of development opportunities

Witaj. W czym możemy pomóc?

NASZE LOKALIZACJE