Skip navigation EPAM

Big Data Engineer (Scala)

  • Kharkiv, Ukraine
  • hot
Job #: 42952
Today we are a global team of technologists and thinkers, who help transform the world with the power of software, enabling our customers to be competitive and disruptive in the marketplace through innovative technology solutions.

DESCRIPTION


As a Big Data Engineer (Scala), you will live on the front lines of the products we create, and build features used by millions of people every day.

Our customer is one of the biggest multi-brand online retailers in the UK. It's our long-playing customer and now they aim to enhance the use of its existing data by improving its storage capabilities and accessibility. The goal of the project is to build a system from the scratch based on Data Lake architecture with Query Layer which provides the ability for multiple data consumer systems to query data from the lake. Additional challenge in Query Layer design is to make it auto-scalable to handle peaks in demand with high uptime percentage as for HA characteristic.

Project technologies and tools

  • AWS Services - EMR, S3, Lambda, EC2, RDS, CloudFormation, etc
  • Hortonworks Data Platform (HDP)
  • Hive
  • Spark, Spark Streaming
  • Yarn
  • Apache Knox
  • Kafka
  • Scala as programming language

Requirements

  • 2+ years of experience with Big Data stack: Spark, Hive, HDFS
  • Basic Scala knowledge
  • Experience with AWS Cloud services
  • Knowledge of Linux will be a plus
  • Knowledge of scripting will be a plus
  • Excellent communication skills, team player
  • Good spoken and written English

We offer

  • Competitive compensation depending on experience and skills
  • Individual career path in engineering
  • Social package - medical insurance, sports
  • Compensation for sick lists and regular vacations
  • English classes with certified English teachers
  • Flexible work hours
Узнать больше о EPAM Украина

Здравствуйте, чем мы можем вам помочь?


Наши офисы

  • Канада

    • Оттава

      343 Preston Street,
      ON K1S 1N4, Ottawa
      Canada

      Карта
    • Торонто

      5 Park Home Avenue,
      Suite 400,
      ON M2N 6L4, North York,
      Toronto
      Canada

      Карта
      Тел: +1-416-591-4004
      Факс: +1-416-595-1551
  • Мексика

  • США

    • Ньютаун

      41 University Drive,
      Suite 202,
      Newtown, PA 18940
      USA

      Карта
      Тел: +1-267-759-9000
      Факс: +1-267-759-8989
    • Белвью

      110 110th Ave. NE,
      Suite 310
      Bellevue, WA 98004
      USA

      Карта
    • Бостон

      21 Drydock Avenue,
      Suite 410 W,
      Boston, MA 02210
      USA

      Карта
    • Вашингтон

      7901 Jones Branch Drive,
      Suite 400,
      McLean, VA 22102
      USA

      Карта
    • Коншохокен

      101 East 8th Ave,
      Suite 201,
      Conshohocken, PA 19428
      USA

      Карта
      Тел: +1-484-382-1300
    • Лос-Анджелес

      11601 Wilshire Blvd,
      Suite 350,
      Los Angeles, CA 90025
      USA

      Карта
    • Нью-Йорк

      24 West 25th Street,
      5th Floor,
      New York, NY 10010
      USA

      Карта
      Тел: +1-267-759-9000
      Факс: +1-267-759-8989
    • Сан-Франциско

      222 Kearny Street,
      Suite 308,
      San Francisco, CA 94108
      USA

      Карта
    • Сан-Хосе

      2055 Gateway Place,
      Suite 510,
      San Jose, CA 95110
      USA

      Карта
    • Филадельфия

      30 South 15th Street,
      9th Floor,
      Philadelphia, PA 19102
      USA

      Карта
  • Австралия

  • Гонконг

  • Индия

    • Бангалор

      Smartworks,  
      Global Technology Park,
      Block C, Outer Ring Rd,
      Adarsh Palm Retreat, Bellandur,
      Bengaluru, Karnataka 560103
      India

      Карта
    • Пуна

      SmartWork Business Center Pvt Ltd,
      Suite 8, Level 1,
      West Wing, Nyati Unitree,
      Samrat Ashok Road,
      Yerwada, Pune - 411006,
      Maharashtra
      India

      Карта
    • Хайдарабад

      10, 11 & 12th Floors,
      Salarpuria Sattva Knowledge City,
      Plot No. 2, Phase - 1,
      Survey No. 83/1,
      Raidurgam Village,
      Serilingampally Mandal,
      Hyderabad, Telangana - 500081
      India

      Карта
      Тел: +91-40-47979900
  • Китай

    • Гуанчжоу

      Unit B01, 23/F,
      Yuexiuxinduhui Building,
      No. 236, 6th Zhongshan Road,
      Yuexiu District, Guangzhou,
      China 510180

      Карта
    • Сучжоу

      Building 12, Creative Industrial Park,
      328 Xinghu Street,
      Suzhou Industrial Park,
      Suzhou, China 215123

      Карта
    • Шанхай

      Room B509, 5th Floor,
      48 Weihai Road,
      Huangpu District, Shanghai,
      China 200000

      Карта
      Тел: +86-21-53080606
    • Шэньчжэнь

      3/F, Block 5, Vision Shenzhen Business Park,
      9th Gaoxin South Road, 
      Shenzhen Hi-tech Industrial Park,
      Nanshan District, Shenzhen,
      Guangdong, China 518057

      Карта
  • ОАЭ

    • Дубай

      EPAM Systems FZ-LLC
      Dubai Branch,
      Building 16, Office 241,
      Dubai Internet City,
      PO Box 501929, Dubai
      United Arab Emirates

      Карта
      Тел: +971-4-568-3569
  • Сингапур

  • Япония

    • Tokyo

      Floor 1-10-11
      Shibadaimon Centre Building 10th
      Shibadaimon Minato-ku
      Tokyo 105-0012
      Japan

      Карта
      Факс: +81-03-6880-9201