Software Engineer (Big Data) Kuala Lumpur, Malaysia
Software Engineer (Big Data) Description
Job #: 74607DESCRIPTION
We are looking for an experienced Software Engineer (Big Data) to be placed in our Office in Bangsar South MY. As a Junior Engineer will be roll-up the functional and technical aspect of Software Development with a big data technology in Project space to cloud services.
EPAM Systems, Inc. (EPAM) is a global product development, digital platform engineering, and digital and product design agency headquartered in the US. EPAM has been named 5 times in Forbes’ 25 Fastest Growing Public Tech Companies. Kuala Lumpur is the most recent location in which EPAM has acquired a new business. This is your opportunity to join an organization in start-up mode that plans to (at least) double in size every 2-3 years and the team that you are joining will be responsible for that.
Responsibilities
- Implement innovative analytical solution using Hadoop, NoSQL and other Big Data related technologies, applying new features in Cloud/ on premise/ Hybrid solutions
- Work with product and engineering teams to understand requirement and help drive decisions
- Maintain collaboration with architects, technical leads and key individuals within other functional groups
- Perform analysis of business problems and technical environments and use this in implementation of quality technical solutions
- Participate in code review and test solutions to ensure it meets best practice specifications
- Maintain high performance engineering culture
- Write project documentation
Requirements
- Candidate must possess at least Bachelor’s Degree in preferably Computer Science/ Information Technology or equivalent
- Candidates with a minimum of 2 year’s solid experience in Big Data technologies and Enterprise Software Development
- Familiar with concepts of data ingestion pipelines, Data Warehousing, Data Lakes
- Experience with data modelling; development experience with modern Big Data components
- Understanding of CI/CD principles and best practices
- Knowledge and practical experience in development of scalable, available and fault tolerant systems
- Familiar in Engineering experience and practice such as Data Management, Data Storage, Data Visualization, Operation, Security
- Knowledge of Containers and Resource Management systems: Docker, Kubernetes, Yarn
- English proficiency
Technologies
- Relevant:
- Programming Languages: Java; Python; SQL
- Big Data stack: Hadoop, HDFS, Spark, Kafka
- Queues and Stream processing: Kafka Streams; Spark Streaming; Event Hub
- Version Control Systems (Git, SVN)
- Testing: Component/ Integration Testing, Unit testing (JUnit)
- Familiar with Cloud Experience Azure / GCP
- Experience in various messaging systems, such as Kafka, RabbitMQ
- Rest, Thrift, GRPC, SOAP
- Build Systems: Maven, SBT, Ant, Gradle
- Add-up as advantages:
- NoSQL as a user: Cassandra/ Hbase/ MongoDB
- Search: Solr, Elasticsearch / ELK
- InMemory: Ignite, Redis
We offer
- Friendly team and enjoyable working environment
- Work-life balance and flexible schedule
- Online training library, mentoring, career development and potential partial grant of certification
- Unlimited access to LinkedIn learning solutions
- Referral bonuses
- Compensation for sick leave and paid time off
- Opportunities for self-realization