Lead Data Engineer - Azure
Full Time 6 - 10 yrs BengaluruPosted 20 days ago
Meytier works directly with Scienaptic to help them hire more great candidates like you.
Scienaptic is a new age AI powered credit underwriting company that offers end-to-end credit decisioning platform. Scienaptic’s Ether platform is fundamentally disrupting the way consumer credit is administered.
Job Description

Scienaptic is looking for a Lead Data Engineer to join their growing team of analytics experts.

Responsibilities :

  • Responsible to Ingest data from files, streams and databases. Process the data with Python and Pyspark and its storage into time series database.
  • Develop programs in Python as part of data extraction, data cleaning, transformation and processing.
  • Develop and maintain scalable data pipelines.
  • Rest API's development.
Mandatory Skills : 
  • Overall 6 -10 years of experience as Data Engineer.
  • Advanced working SQL knowledge to create complex queries.
  • Experience in working with Time-series Database, relational databases as well as working familiarity with a variety of databases (structured & Unstructured).
  • Experience in designing and implementing scalable architecture.
  • Good experience in doing object-oriented programming in python.
  • Very strong in Object Oriented Analysis and Design (OOAD).
  • Strong knowledge on REST APIs.
  • Experience working on Azure Cloud services IaaS, PaaS.
  • Hands on Experience in working on Microsoft Azure Services like ADLS/Blob Storage solutions, Event Hubs, Service Bus, scale sets, Load Balancers, Azure Functions, Databricks.
  • Hands on Experience in working on Kafka.
  • Knowledge on continuous integration/continuous deployment.
  • Experience of data migration and deployment from On-Prem to Cloud environment and vice-versa.
  • Individual Contributor

Good-to-Have Skills : 

  • Hands on experience on visualization tools like Grafana & Power BI.
  • Certification on any cloud platform.
  • Hands on experience on Docker Containers and micro services architecture using Kubernetes.
  • Hand on experience in Golang programming

© 2020 Meytier - All Rights Reserved