Senior Big Data Engineer

Lviv, Ukraine

Striving for excellence is in our DNA. Since 1993, we have been helping the world’s leading companies imagine, design, engineer, and deliver software and digital experiences that change the world. We are more than just specialists, we are experts.

DESCRIPTION


Currently we are looking for a Senior Big Data Engineer for our Lviv office to make the team even stronger.

As a Senior Big Data Engineer, you will help in building modern connected platform that bridges multiple departments (Data Science, Development, DevOps, Marketing) together for one of the world leaders in travel and hospitality industry. Platform is designed in respect to the best practices of highly responsive and heavy-loaded systems.

The platform consists of all components that you could imagine in the modern Data Science world:
- Central feature repository that will provide additional datasets for hundreds of running models in real-time;
- Modern deployment pipelines for data-science models (including Spark ML and Tensorflow at very least). Deployment pipelines on top of regular push of model into live must support model versioning;
- Scalable ML platform by its nature. All models should support scaling;
- Modern recommendation models using multi-arms bandit and Thomson sampling;
- Scalable ETL components responsible for clickstream processing;
- Integration with Web UI for continuous experiment management / tracking.

Requirements

  • Good understanding of SDLC and its stages;
  • Ability to supervise team from technical perspective (architectural supervision, code reviews, help with tasks breakdown and estimates);
  • Quick learner (platform consists of multiple cutting-edge technologies with tightly time-boxed learning curve);
  • Understanding the basic principles of CI/CD. Experience in Jenkins, Ansible, Terraform;
  • 3+ years of Java (JDK 8) experience;
  • Java Collections, Stream API, Restful Services;
  • 1+ years experience in Scala;
  • 0.5 years of experience in AWS (EC2, Lambda, Kinesis, EMR);
  • Excellent English (B2+ is minimum (speaking / writing);
  • Able to learn, to do quick spike on some new technology.

Nice to have

  • Experience in NoSQL databases like Cassandra or similar;
  • Experience in Spark / Spark ML;
  • Experience in MLeap / TensorFlow / Databricks.

We offer

  • Experience exchange with colleagues all around the world;
  • Competitive compensation depending on experience and skills;
  • Regular assessments and salary reviews;
  • Social package - medical care, sports;
  • Free English classes with native speakers (certified English teachers);
  • Opportunities for self-realization;
  • Friendly team and enjoyable working environment;
  • Flexible working schedule;
  • Corporate and social events.