Senior Data Engineer (Backend, Relocation to Dubai)

What you'll do

• Define the architecture, scope and deliver various Big Data solutions.
• Build and maintain large scale deployment of Cassandra cluster.
• Support other teams by providing guidance on data modeling, data usage, processing and how they can best leverage the platform
• Build scalable data pipelines to ingest data from a variety of data sources, identify critical data elements and define data quality rules.
• Leverage Spark/Hadoop ecosystem knowledge to design and develop capabilities to deliver innovative and improved data solutions.
• Provide insights on area of improvements including Data Governance, best practices, large scale processing
• Support the bug fixing and performance analysis along the data pipeline
• Collaborate, coach, and mentor colleagues in an energetic, growing team

What you'll need

• 7+ years of experience as software engineer, with strong skills in at least one programming language is mandatory, preferably Scala or Java or Python
• 4+ years of experience with Cassandra Deployment/Maintenance and Cassandra Data Modelling
• Expertise with distributed systems and design/implementation for reliability, availability, scalability and performance
• Proven experience with AWS technologies like S3, EMR, Cloudformation.
• Creative and innovative approach to problem-solving
• 5+ years of experience as a Big Data Engineer or similar role
• 3+ year of experience with Hadoop and/or Spark
• Experience with CICD using Jenkins, Terraform or other related technologies
• Familiarity with containerized platform like Docker and Kubernetes
• Experience working with real time data processing using Kafka, Spark Streaming or similar technology
• Experience working with Hive, Presto or other querying frameworks.

Where you'll be

• This role is part of a remote distributed team! This means you can be based in any of the countries where we currently have an engineering site. If you would like to join us in Dubai, Berlin, UK, Spain, Poland, Pakistan, Egypt, Lebanon or Jordan, that's fine with us (Visa permitting)!
• Even though we are working remotely, we are strong believers in collaboration and the power of building social connections with our teams. For that reason, our offices are still open and provide plenty of collaboration-friendly spaces at times when teams need it or if you need a quiet space to work outside of home.
• You’ll be working in the location you’re hired from. Due to legal and compensation considerations, you will need to be based out of the country you’re hired from as your primary work location.

What we'll provide you

• Be part of a Remote-First organisation
• Work from any country in the world for 60 days a year
• Use Unlimited Vacation days throughout the year
• Access fitness reimbursements for health activities including: gym, health club and training classes.
• Work and learn from great minds
• Create impact in a region with untapped potential
• Explore new opportunities to learn and grow every day
• VPN is required to respond to a vacancy