Big Data Developer

Natural Intelligence is a global leader in the online comparison market. Our goal is to simplify decision-making and connect customers with valuable brands.

Our technology helps millions of consumers around the world make smarter, more confident buying decisions. We do so by creating trusted comparison websites that enable consumers to easily compare products and services online and form high-value relationships with the brands they choose. Our partner brands, some of which are among the most prominent websites worldwide, utilize our platform to maximize their online presence. 

We are looking for a strong and passionate big data developer that will help us build the data platform and data frameworks for the company

Responsibilities

  • Use your skills and experience to design and develop our innovative big data and BI solutions
  • Develop the data platform of the company in AWS environment
  • Use big data and development technologies such as Spark, Scala, Kafka, Redshift, Airflow, Cloudwatch, Flink and so on
  • Lead, deliver and own high scale projects from end to end
  • Maintain high quality code by writing unit, integration tests and automation
  • Design system deployment and configuration for continuous integration
  • Work in agile methodology (Scrum)
  • Lead technological initiatives and improvements while instilling development “best practices”
  • Work closely with the data scientists team

Requirements

  • Experience developing large scale distributed systems 
  • At least 2 years of experience in Python 
  • At least 4 years programming experience in Scala/ Java or equivalent Object-Oriented language
  • Experience with scientific computing packages (numpy, scipy, pandas etc.) - advantage
  • Hands-on experience with data and open source technologies such as Spark, Kafka, Hive, parquet, etc.
  • Experience in stream processing frameworks such as Flink
  • Strong SQL queries abilities and hands on experience with SQL and NoSql DBs
  • Working experience with cloud infrastructure ecosystems such as AWS EMR, Redshift, S3, Athena, Glue - advantage
Submit Application

Apply for this position

Big Data Developer