Senior Data Engineer

Mid / Senior

|

In Office

Meytier Premier Employer

Working there

About This Workplace

Meytier Partner

As a Senior Data Engineer, you will build a variety of big data analytics solutions, including big data lakes. More specifically, you will:

  • Design and build scalable data ingestion pipelines to handle real time streams, CDC events, and batch data
  • Execute high-performance data processing for structured and unstructured data, and data harmonization
  • Schedule, orchestrate, and validate pipelines
  • Design exception handling and log monitoring for debugging
  • Make tech stack and tools related decisions
  • Collaborate with business consultants, data scientists, and application developers to develop analytics solutions

Required Experience, Skills & Competencies: 

  • Hands-on experience with:
    •      Hadoop ecosystem - HDFS, Hive, Sqoop, Kafka, ELK Stack etc
    •      Spark, Scala, Python and core/advance Java
    •      NOSQL databases e.g. Hbase, Cassandra, MongoDB
    •      Relevant AWS or Azure components required to build big data solutions
    •      Good to know: Databricks, Snowflake
  • Ability to develop and manage scalable Hadoop cluster environments
  • Good understanding of data warehousing concepts, distributed systems, data pipelines, ETL
  • 5-10 years of tech experience with at least 3 years in big data engineering


© 2024 Meytier - All Rights Reserved.
   Privacy Policy    Terms Of Use