Skip navigation EPAM

Senior Big Data Engineer - Scala San Francisco, CA, USA

  • hot

Senior Big Data Engineer - Scala Description

Job #: 92012

We are hiring a Senior Big Data Engineer who will support a critical digital transformation project for one of EPAM’s top clients. This is a high-impact role, with the opportunity to advance your skills and grow within a global organization. If you'd like to learn more about this position and project, apply now! Connect with a recruiter today!



  • Evaluate different technologies and suggest which technology suits the client's needs
  • Complete POC and evolve it into production-ready solutions
  • Select and integrate any Big Data tools and frameworks required to provide requested capabilities
  • Implement ETL process
  • Monitor performance and advise any necessary infrastructure changes
  • Define data retention policies
  • Elaborate on the technical design of new features


  • At least 2 years of experience with Scala
  • At least 2 years of experience with Java or Python
  • Proficient understanding of distributed computing principles
  • Proficiency with HDFS
  • Good knowledge of Big Data querying tools, such as Hive and Impala
  • Proven history of building stream-processing systems, using solutions such as Spark-Streaming
  • Experience with Spark RDD/DataFrame API using Java/Scala
  • Experience with integration of data from multiple data sources
  • Knowledge of various ETL techniques and frameworks
  • Comfortable with various messaging systems, such as Kafka
  • Experience with Cloudera platform

Nice to have

  • Experience with Apache Kafka
  • Experience with Apache Oozie


  • Medical, Dental and Vision Insurance (Subsidized)
  • Health Savings Account
  • Flexible Spending Accounts (Healthcare, Dependent Care, Commuter)
  • Short-Term and Long-Term Disability (Company Provided)
  • Life and AD&D Insurance (Company Provided)
  • Employee Assistance Program
  • Unlimited access to LinkedIn learning solutions
  • Matched 401(k) Retirement Savings Plan
  • Paid Time Off
  • Legal Plan and Identity Theft Protection
  • Accident Insurance
  • Employee Discounts
  • Pet Insurance
  • Employee Stock Purchase Program

About EPAM

  • EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential


  • This posting includes a good faith range of the salary EPAM would reasonably expect to pay the selected candidate. The range provided reflects base salary only. Individual compensation offers within the range are based on a variety of factors, including, but not limited to: geographic location, experience, credentials, education, training; the demand for the role; and overall business and labor market considerations. Most candidates are hired at a salary within the range disclosed. Salary range: $90k – $150k. In addition, the details highlighted in this job posting above are a general description of all other expected benefits and compensation for the position
  • EPAM welcomes all applicants and will consider qualified candidates with criminal history such as arrest and conviction records in a manner consistent applicable law, including the San Francisco Fair Chance Ordinance and Los Angeles Fair Chance Initiative for Hiring

Witaj. W czym możemy pomóc?