Senior Big Data Developer

Natural Intelligence is a global leader in the online comparison market. Our goal is to simplify decision-making and connect customers with valuable brands.

Our technology helps millions of consumers around the world make smarter, more confident buying decisions. We do so by creating trusted comparison websites that enable consumers to easily compare products and services online and form high-value relationships with the brands they choose. Our partner brands, some of which are among the most prominent websites worldwide, utilize our platform to maximize their online presence. 

We are searching for a strong and passionate big data developer that will help us build the data platform and data frameworks for the company

Responsibilities

  • Use your skills and experience to design and develop our innovative big data and BI solutions
  • Develop the data platform of the company in AWS environment
  • Use big data and development technologies such as Spark, Scala, Kafka, Redshift, Airflow, Cloudwatch, Flink and so on
  • Lead, deliver and own high scale projects from end to end
  • Maintain high quality code by writing unit, integration tests and automation
  • Design system deployment and configuration for continuous integration
  • Work in agile methodology (Scrum)
  • Lead technological initiatives and improvements while instilling development “best practices”

Requirements


  • Experience developing large scale distributed systems 
  • At least 5 years programming experience in Scala/ Java or equivalent Object-Oriented language
  • At least 2 years experience in Spark - must
  • Hands-on experience with data and open source technologies such as Kafka, Hive, parquet, etc.
  • Experience in stream processing frameworks such as Flink
  • Strong SQL queries abilities and hands on experience with SQL and NoSql DBs
  • Hands-on experience developing over AWS - advantage
Submit Application

Apply for this position

Senior Big Data Developer