Apache Spark/Hadoop Software Engineer

Prague, Czech Republic

(25125)

Striving for excellence is in our DNA. Since 1993, we have been helping the world’s leading companies imagine, design, engineer, and deliver software and digital experiences that change the world. We are more than just specialists, we are experts.

DESCRIPTION


Currently we are looking for a strong Apache Spark/Hadoop Software Engineer for our Prague office to make the team even stronger.

Our client is an investment bank which provides large corporate, government and institutional clients with a full spectrum of solutions to their strategic advisory, financing and risk management needs.

The role is for the department responsible for calculating, managing and reporting the exposure and risk the firm has to its counterparties.

As an Apache Spark/Hadoop Software Engineer, you will be a Development Team member for the migration of an existing Microsoft SQL 2012 / C# reporting system onto the department’s strategic Hadoop cluster. The cluster is built on combination of standard Apache and Cloudera components, together with proprietary IP for ingestion, orchestration and consumer access.

The existing system comprises c.40 sources of Credit Risk which are enriched, classified and aggregated according to business rules. Output is in the form of fixed-form reports, QlikView visualizations, and Business Objects analytics.

The replacement Hadoop system should provide equivalent business functionality. This includes comprehensive quality controls, alerting and monitoring, and the ability to show data lineage end-to-end from source feed to report. Output is used for regulatory reporting in the UK and US, and to manage the Bank’s credit exposure.

Requirements

  • 3+ years of production experience with Java;
  • Hands-on experience with Hadoop technologies;
  • Highly analytical with a strong attention to detail;
  • Clear and effective verbal and written communication skills;
  • Fluent English.

Nice to have

  • Strong experience with the following is preferred:
    • HDFS/Avro/HBase;
    • Spark;
    • Hive/Hue;
    • Kafka;
    • Scala;
    • Parquet.

We offer

  • Opportunity to work in a successful international company with a stable background;
  • Perspective and diverse work in an attractive and constantly evolving fields;
  • Opportunity to participate in the development of the company and shape its professional image;
  • Large space for self-fulfillment, pursue their own creative ideas, participation in the new projects of the company;
  • Possibility to work in a friendly multicultural environment and to grow professionally within worldwide EPAM;
  • Regular trainings and good opportunities for professional growing and development;
  • Partial grant of the cost of certification;
  • Motivating financial evaluation (negotiable, based on an expertise and achieved results).