Data Ingestion Engineer

Mountain View, CA, USA

Striving for excellence is in our DNA. Since 1993, we have been helping the world’s leading companies imagine, design, engineer, and deliver software and digital experiences that change the world. We are more than just specialists, we are experts.

DESCRIPTION


Currently we are looking for a Data Ingestion Engineer for our Mountain View, CA office to make the team even stronger.

EPAM is seeking a cloud-based platform for petabyte-scale scientific analysis and visualization of geospatial datasets, for public benefit as well as for business and government users. We're expanding our work on understanding the changes in the Earth's climate and their impact on people all over the world, and we need your help!

Responsibilities

  • Learning about the satellites, sensors, and the various data products that data providers release;
  • Writing data processing pipelines to ingesting the data into Earth Engine;
  • Visualizing the results and in some cases collaborating with partner scientists to beta-test the dataset in Earth Engine before launch;
  • Configuring and running data download / ingestion pipelines via a scripting language;
  • Visually QA the resulting ingested data, reconfiguring and rerunning the result if issues;
  • Working with the Earth Engine Engineering team to initially understand ingestion parameters and later to verify if the ingestion is acceptable.

Requirements

  • BS in CS, Engineering, Math or Science (Physics, Math);
  • 1+ year of experience with one programming language, preferably Python;
  • Basic familiarity with the command mode in Linux/Unix environments;
  • Extreme attention to detail. If you are the kind of person who can’t forgive a single typo in a 600-page book, we would like to work with you.

Nice to have

  • Basic familiarity with JavaScript;
  • Knowledge of the FTP and HTTP protocols;
  • Experience with the App Engine Datastore;
  • Some experience with parallel data processing (e.g. MapReduce, Hadoop, Spark, etc.);
  • Basic data visualization (e.g. Google Charts).