Data Engineer

Associate / Junior

|

Remote

Meytier Premier Employer

Apply NowAppliedThis job might no longer be active.

Working there

{"group":"Organization","title":"Data Engineer","zohoId":"557706000004632213","endDate":"2020-09-18T00:00:00.000Z","jobType":"Full Time","job_url":"134-scienaptic-data-engineer","agencyId":1,"location":[{"lat":12.9833,"lon":77.5833,"city":"Bengaluru","text":"Bengaluru, Karnataka 560002, India","state":"Karnataka","country":"","zipCode":"560002","is_state":false,"is_country":false,"state_code":"KA","countryCode":"","isLocationSet":true,"loc_h3_hex_res4":"8461893ffffffff","isLocationResolved":false,"is_address_available_from_parser":true}],"maxSalary":null,"minSalary":null,"startDate":"2020-09-01T00:00:00.000Z","onBehalfOf":"57","description":"<span id=\"spandesc\"><h1 style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font: 16px questrial, sans-serif; color: rgb(255, 255, 255); letter-spacing: normal; orphans: 2; text-align: justify; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px\" class=\"font_0 align-justify\"><span class=\"highlight\" style=\"\"><span class=\"colour\" style=\"color: rgb(0, 0, 0)\"><span class=\"highlight\" style=\"\"><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\">Scienaptic is looking for a Data Engineer to join their growing team of analytics experts.</span></span></span></span></span><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\"><br /></span></span></h1><h1 class=\"font_0 align-justify\" style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font: 16px questrial, sans-serif; color: rgb(255, 255, 255); letter-spacing: normal; orphans: 2; text-align: justify; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px\"><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\"><br /></span></span></h1><h1 class=\"font_0 align-justify\" style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font: 16px questrial, sans-serif; color: rgb(255, 255, 255); letter-spacing: normal; orphans: 2; text-align: justify; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px\"><span class=\"highlight\" style=\"\"><span class=\"colour\" style=\"color: rgb(0, 0, 0)\"><span class=\"highlight\" style=\"\"><span class=\"highlight\" style=\"\"><b><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\">Key Responsibilities</span></span></b></span></span></span></span><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\"><br /></span></span></h1><ul class=\"font_0\" style=\"margin: 0px 0px 0px 0.5em; padding: 0px 0px 0px 1.3em; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; list-style: disc; font: 400 16px questrial, sans-serif; color: rgb(0, 0, 0); letter-spacing: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px\"><li style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font-style: inherit; font-weight: inherit; line-height: inherit; letter-spacing: normal\"><h1 class=\"font_0 align-justify\" style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font: 16px questrial, sans-serif; color: rgb(255, 255, 255); letter-spacing: normal; text-align: justify\"><span class=\"highlight\" style=\"\"><span class=\"colour\" style=\"color: rgb(0, 0, 0)\"><span class=\"highlight\" style=\"\"><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\">Leverage the batch computation frameworks and our workflow management platform (Airflow) to assist in building out different data pipelines</span></span></span></span></span><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\"><br /></span></span></h1></li><li style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font-style: inherit; font-weight: inherit; line-height: inherit; letter-spacing: normal\"><h1 class=\"font_0 align-justify\" style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font: 16px questrial, sans-serif; color: rgb(255, 255, 255); letter-spacing: normal; text-align: justify\"><span class=\"highlight\" style=\"\"><span class=\"colour\" style=\"color: rgb(0, 0, 0)\"><span class=\"highlight\" style=\"\"><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\">Lower the latency and bridge the gap between our production systems and our data warehouse by rethinking and optimizing our core data pipeline jobs</span></span></span></span></span><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\"><br /></span></span></h1></li><li style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font-style: inherit; font-weight: inherit; line-height: inherit; letter-spacing: normal\"><h1 class=\"font_0 align-justify\" style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font: 16px questrial, sans-serif; color: rgb(255, 255, 255); letter-spacing: normal; text-align: justify\"><span class=\"highlight\" style=\"\"><span class=\"colour\" style=\"color: rgb(0, 0, 0)\"><span class=\"highlight\" style=\"\"><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\">Work with client to create and optimize critical batch processing jobs in Spark</span></span></span></span></span><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\"><br /></span></span></h1></li><li style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font-style: inherit; font-weight: inherit; line-height: inherit; letter-spacing: normal\"><h1 class=\"font_0 align-justify\" style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font: 16px questrial, sans-serif; color: rgb(255, 255, 255); letter-spacing: normal; text-align: justify\"><span class=\"highlight\" style=\"\"><span class=\"colour\" style=\"color: rgb(0, 0, 0)\"><span class=\"highlight\" style=\"\"><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\">Develop production grade code using Scala/Spark and Python/Spark code on Azure data bricks</span></span></span></span></span><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\"><br /></span></span></h1></li></ul><h1 class=\"font_0 align-justify\" style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font: 16px questrial, sans-serif; color: rgb(255, 255, 255); letter-spacing: normal; orphans: 2; text-align: justify; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px\"><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\"><br /></span></span></h1><h1 class=\"font_0 align-justify\" style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font: 16px questrial, sans-serif; color: rgb(255, 255, 255); letter-spacing: normal; orphans: 2; text-align: justify; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px\"><span class=\"highlight\" style=\"\"><span class=\"colour\" style=\"color: rgb(0, 0, 0)\"><span class=\"highlight\" style=\"\"><span class=\"highlight\" style=\"\"><b><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\">Skills and Experience</span></span></b></span></span></span></span><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\"><br /></span></span></h1><ul class=\"font_0\" style=\"margin: 0px 0px 0px 0.5em; padding: 0px 0px 0px 1.3em; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; list-style: disc; font: 400 16px questrial, sans-serif; color: rgb(0, 0, 0); letter-spacing: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px\"><li style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font-style: inherit; font-weight: inherit; line-height: inherit; letter-spacing: normal\"><h1 class=\"font_0 align-justify\" style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font: 16px questrial, sans-serif; color: rgb(255, 255, 255); letter-spacing: normal; text-align: justify\"><span class=\"highlight\" style=\"\"><span class=\"colour\" style=\"color: rgb(0, 0, 0)\"><span class=\"highlight\" style=\"\"><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\">Strong engineering background and interested in data</span></span></span></span></span><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\"><br /></span></span></h1></li><li style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font-style: inherit; font-weight: inherit; line-height: inherit; letter-spacing: normal\"><h1 class=\"font_0 align-justify\" style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font: 16px questrial, sans-serif; color: rgb(255, 255, 255); letter-spacing: normal; text-align: justify\"><span class=\"highlight\" style=\"\"><span class=\"colour\" style=\"color: rgb(0, 0, 0)\"><span class=\"highlight\" style=\"\"><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\">Good understanding of data analysis using SQL queries</span></span></span></span></span><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\"><br /></span></span></h1></li><li style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font-style: inherit; font-weight: inherit; line-height: inherit; letter-spacing: normal\"><h1 class=\"font_0 align-justify\" style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font: 16px questrial, sans-serif; color: rgb(255, 255, 255); letter-spacing: normal; text-align: justify\"><span class=\"highlight\" style=\"\"><span class=\"colour\" style=\"color: rgb(0, 0, 0)\"><span class=\"highlight\" style=\"\"><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\">Strong hold on Python or Scala as a programming language on Azure Databricks.&nbsp;</span></span></span></span></span><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\"><br /></span></span></h1></li><li style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font-style: inherit; font-weight: inherit; line-height: inherit; letter-spacing: normal\"><h1 class=\"font_0 align-justify\" style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font: 16px questrial, sans-serif; color: rgb(255, 255, 255); letter-spacing: normal; text-align: justify\"><span class=\"highlight\" style=\"\"><span class=\"colour\" style=\"color: rgb(0, 0, 0)\"><span class=\"highlight\" style=\"\"><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\">Experience of developing and maintaining distributed systems built with Azure Databricks or native Apache Spark</span></span></span></span></span><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\"><br /></span></span></h1></li><li style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font-style: inherit; font-weight: inherit; line-height: inherit; letter-spacing: normal\"><h1 class=\"font_0 align-justify\" style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font: 16px questrial, sans-serif; color: rgb(255, 255, 255); letter-spacing: normal; text-align: justify\"><span class=\"highlight\" style=\"\"><span class=\"colour\" style=\"color: rgb(0, 0, 0)\"><span class=\"highlight\" style=\"\"><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\">Experience of building libraries and tooling that provide abstractions to users for accessing data&nbsp;</span></span></span></span></span><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\"><br /></span></span></h1></li><li style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font-style: inherit; font-weight: inherit; line-height: inherit; letter-spacing: normal\"><h1 class=\"font_0 align-justify\" style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font: 16px questrial, sans-serif; color: rgb(255, 255, 255); letter-spacing: normal; text-align: justify\"><span class=\"highlight\" style=\"\"><span class=\"colour\" style=\"color: rgb(0, 0, 0)\"><span class=\"highlight\" style=\"\"><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\">Experience in writing and debugging ETL jobs using a distributed data framework (Spark/Hadoop MapReduce etc.) on Azure Databricks</span></span></span></span></span><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\"><br /></span></span></h1></li><li style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font-style: inherit; font-weight: inherit; line-height: inherit; letter-spacing: normal\"><h1 class=\"font_0 align-justify\" style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font: 16px questrial, sans-serif; color: rgb(255, 255, 255); letter-spacing: normal; text-align: justify\"><span class=\"highlight\" style=\"\"><span class=\"colour\" style=\"color: rgb(0, 0, 0)\"><span class=\"highlight\" style=\"\"><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\">Experience optimizing the end-to-end performance of distributed systems</span></span></span></span></span><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\"><br /></span></span></h1></li><li style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font-style: inherit; font-weight: inherit; line-height: inherit; letter-spacing: normal\"><h1 class=\"font_0 align-justify\" style=\"margin: 0px; padding: 0px; border: 0px; outline: 0px; vertical-align: baseline; background: 0px 0px; font: 16px questrial, sans-serif; color: rgb(255, 255, 255); letter-spacing: normal; text-align: justify\"><span class=\"highlight\" style=\"\"><span class=\"colour\" style=\"color: rgb(0, 0, 0)\"><span class=\"highlight\" style=\"\"><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\">Ability to recommend and implement ways to improve data reliability, efficiency, and quality</span></span></span></span></span><span class=\"font\" style=\"font-family: verdana, sans-serif\"><span class=\"size\" style=\"font-size: 13px\"><br /></span></span><br /></h1></li></ul><div><br /></div></span><br />","isHybridJob":false,"isRemoteJob":true,"noOfOpenings":1,"maxExperience":"9","minExperience":"5","isOnPremiseJob":false,"onBehalfOfName":"Scienaptic","otherlocations":[],"zohoCurrencyIn":"USD","experienceLevel":"Associate / Junior","zohoNoOfOpenings":{"noOfOpenings":1,"fulfillmentIds":["557706000004632213-1"]},"otherJobReference":null,"sharpenedJobTitle":"Data Engineer","job_category_group":3,"portalLocationDisplay":"Bengaluru KA","expertise_coreskill_or_product":["Other"],"job_id":"2477"}