Senior Data Engineer- Design & Build Architecture- Big Data Platforms
-
At least five years of hands-on experience with various Big Data technologies in one or more ecosystems:
-
Designing, Architecting, and Developing solutions leveraging big data technology to ingest, process and analyse large, disparate data sets to exceed business requirements
-
Unifying, enriching, and analysing customer data to derive insights and opportunities
-
A bachelor’s degree and approximately six years of related work experience; or a master’s degree and approximately five years of related work experience
-
Hadoop, Spark, NoSQL, Streaming, Atlas, Sqoop, HIVE
-
AWS, EMR, Hortonworks, Cassandra, Mongo, Redshift, Kafka, Spark, S3
-
Proficiency coding in Python, Java, C#, C++, or Scala
-
Experience with ETL/Batch and Near Real-Time Processing
-
Experience with Streaming Platforms (Kafka, spark, stream sets etc) and Complex Event Processing
-
Experienced organising, aggregating, querying and analysing large data sets
-
Communication is essential, must be able to listen and understand the question and develop and deliver clear insights.