Big Data Engineer

Singapore, Singapore

Striving for excellence is in our DNA. Since 1993, we have been helping the world’s leading companies imagine, design, engineer, and deliver software and digital experiences that change the world. We are more than just specialists, we are experts.

DESCRIPTION


Currently we are looking for a Big Data Engineer for our Singapore office to make the team even stronger.

As a Big Data Developer, you will be working on the “MSD India Sales Prediction” project.

Responsibilities

  • Primary focus: project delivery work (90%):
    • Be part of an agile planning and delivery team, where you apply lifecycle methodology to agile project delivery;
    • Work with the Data Science project team, liaising with infrastructure teams and customers, either face-to-face or over teleconferencing tools, to clarify requirements, implement features, run tests, write documentation and resolve technical issues.
  • Secondary focus: evangelism, consulting and adoption support (10%):
    • Engage stakeholders to understand business problems and translate them into optimal use of the Big Data platform for the project;
    • Your knowledge of best practices for data management and processing, integration and delivery helps the project to succeed and meet its deadlines.

Requirements

  • Familiar with software lifecycle (SDLC) and agile methods (e.g. Scrum);
  • Good knowledge of the Hadoop and Hadoop ecosystem tools, Spark, SQL, ingestion tools, etc;
  • Knowledge of UNIX tools, Jenkins, Docker, Ansible, automated testing, and infrastructure-as-code tools;
  • Development and prototyping of data driven software products in a DevOps environment, using an agile lifecycle methodology;
  • Main tools and languages for our project are Linux shell, Java, Scala, Spark;
  • Working knowledge of version control systems such as Git, SVN, Mercurial etc;
  • Real-world problem solver: strong analytical and problem solving skills, an ethic of quality and enterprise scale service;
  • User advocate: a mindset of collaboration;
  • Passion for Big Data technologies, ability to make them work in a corporate environment for a regulated industry.

Nice to have

  • Experience in software hosting solutions such as GitHub, Bitbucket;
  • Experience in popular development tools and tools platforms;
  • Experience in Atlassian products is a plus (Confluence, Jira, Bitbucket);
  • Experience in end-to-end software product ownership is a plus;
  • Domain knowledge of and experience in business disciplines such as Market Research, Financial Forecasting, Sales and Marketing not mandatory, but appreciated.