Top.Mail.Ru
inDrive

Data Engineer (middle)

Алматы
153 000 - 192 000 ₽

Our tech stack:

  • Languages: Python, SQL, Scala, Go
  • Frameworks: Spark, Apache Beam Storage and
  • Analytics: BigQuery, GCS, S3, Trino, other GCP and
  • AWS stack components Integration: Apache Kafka,
  • Google Pub/Sub, Debezium, Zero ETL, Firehose ETL: Airflow2
  • Infrastructure: Kubernetes, Terraform Development: GitHub, GitHub Actions, Jira

What tasks remain to be solved:

  • Develop the data driven culture within the company
  • Develop processes for data processing, storage, cleaning, and enrichment
  • Design and maintain data pipelines from collection to consumption
  • Develop APIs (REST, gRPC) for high load services
  • Create infrastructure for storing and processing large datasets on K8S, Terraform
  • Automate testing, validation, and monitoring of data
  • Participate in system design and architectural decision making

We expect from the candidate:

  • Who we are looking for Expert in Python 3.7+, experience with PySpark Deep knowledge of SQL
  • Extensive experience building ETLs with Airflow2 Industrial experience with Kubernetes
  • Understanding of data processing principles and algorithms
  • Excellent knowledge of OOP, design patterns, clean architecture
  • Proactivity, responsibility, and the ability to take ownership
  • Would be a plus: Experience with high load services DevOps skills and CI/CD automation experience

We offer:

  • Stable salary, official employment
  • Health insurance
  • Hybrid work mode and flexible schedule
  • Relocation package offered for candidates from other regions (only for Kazakhstan and Cyprus)
  • Access to professional counseling services including psychological, financial, and legal support
  • Discount club membership
  • Diverse internal training programs
  • Partially or fully paid additional training courses
  • All necessary work equipment
Настя из careerspace
Настя из careerspace
Поможем устроиться на эту работу или лучше!

Отклик