Big Data Engineer

з/п не указана

Требуемый опыт работы: 3–6 лет

Полная занятость, полный день

BelPrime is a product company that builds tools for Digital Marketers.
Our team is looking for a Big Data Engineer to work on an Internet scale data analysis platform.

Requirements:

  • 5+ years of experience as Java/Scala developer.
  • 1+ years of experience as Big Data Engineer (Java/Scala/Python/R).

  • Experience using Hadoop and Spark. Solid understanding of their major design decisions and tradeoffs.

  • Experience using at least one key-value DB (HBase, Cassandra etc).

  • Solid understanding of the MR computing paradigm. Practical experience writing MR jobs and workflows.

  • Ability to troubleshoot performance troubles in MR and Spark jobs.

  • Solid understanding of well-known algorithms and data structures is a must.

Bonus points for:

  • Experience in Spark Streaming or Spark Structured Streaming.

  • Experience using HBase.

  • Experience using Kafka.

  • Experience using large scale distributed OLAP storage and query engines (Clickhouse, Druid, Pinot, Drill, etc).

Responsibilities:

  • Write complex MR and Spark workflows that process hundreds of terabytes of data.
  • Tune and improve existing MR and Spark workflows.

  • Write ETL workflows for OLAP databases. Write and tune queries for OLAP schemas.

  • Improve and extend Java-based user-facing frontend services that connect to large scale OLAP deployments.

What we offer:

  • An opportunity to work on a technologically complex product and impact its development directly.

  • An office in the city centre with all the corporate niceness.

  • An extended benefits package.

Ключевые навыки

Python
Java
SCALA
Big Data

Вакансия опубликована 18 ноября 2019 в Минске

Смотреть отклик
Написать сопроводительное письмоПисьмо отправлено

Сопроводительное письмо к отклику

Похожие вакансии