Premier Employers are industry leaders that have forged exclusive partnerships with Meytier to forward our shared mission to offset bias in hiring, and are only visible to members of the Meytier community.
EXCLUSIVELY ON MEYTIER
You're in luck. This opportunity exclusively available through Meytier.
Requirement analysis, requirement gathering, design, business impact analysis, gap analysis, estimation, development, testing, coding, code review, unit testing and deployment of the application.
Design, build, install, configure, and support Hadoop (Big Data).
Design and implement big data pipelines to ingest and process data in real-time and monitor for data miss or error in progress to ensure that data reaches the end system.
Measure the performance of various APIs and implement optimization on slow services to enhance the responsiveness of the system.
Deliver functional enhancements to the existing big data applications.
Provide inputs on solution architecture based on evaluation/understanding of solution alternatives, frameworks, and products.
Develop Hadoop batch jobs for data extraction from multiple unstructured and structured data sources for populating into various repositories (Hadoop, Neo4J, MongoDB, Apache SOLR).
Interact with clients to elicit architectural and non-functional requirements such as performance, scalability, reliability, availability, maintainability.
Participate in designing the data model structured data in RDBMS into a graph database solution and NoSQL database solution.
Develop near real-time data processing solutions using Kafka and Spark Streaming.
Participate in designing Spark architecture with Databricks and Structured Streaming.
Set up Microsoft Azure with Databricks, and Databricks Workspace for business analytics.
Contribute to the automate build process by using Jenkins and Ansible to achieve continuous integration and continuous deployment.
Desired Profile:
Masters in computer science/Applications, Information Technology/Systems or Electronics/Electrical Engineering.
Minimum 1 year experience as Big Data Engineer, Data Engineer, Data Engineering Specialist, Data Warehousing Analyst or related occupation.
Must be willing to travel/relocate to anywhere in the US.
Edison, NJ and unanticipated locations throughout US
{"group":"Organization","title":"Big Data Engineer","zohoId":"","endDate":"2023-10-23T11:36:04.342Z","isDraft":false,"jobType":"Full Time","job_url":"564-orion-innovation-big-data-engineer","agencyId":1,"clientId":"35","location":[{"lat":37.09024,"lon":-95.712891,"zip":"","city":"","text":"United States","state":"","country":"United States","is_city":false,"is_state":false,"is_country":true,"state_code":"","countryCode":"US","isLocationSet":true,"isLocationResolved":true}],"maxSalary":"","minSalary":"","questions":[],"startDate":"2023-10-23T11:36:04.342Z","hiringSPOC":"","onBehalfOf":"42","companyName":"Meytier","description":"<p><strong>Key Responsibilities:</strong></p><ul><li>Requirement analysis, requirement gathering, design, business impact analysis, gap analysis, estimation, development, testing, coding, code review, unit testing and deployment of the application.</li><li>Design, build, install, configure, and support Hadoop (Big Data). </li><li>Design and implement big data pipelines to ingest and process data in real-time and monitor for data miss or error in progress to ensure that data reaches the end system.</li><li> Measure the performance of various APIs and implement optimization on slow services to enhance the responsiveness of the system. </li><li>Deliver functional enhancements to the existing big data applications. </li><li>Provide inputs on solution architecture based on evaluation/understanding of solution alternatives, frameworks, and products. </li><li>Develop Hadoop batch jobs for data extraction from multiple unstructured and structured data sources for populating into various repositories (Hadoop, Neo4J, MongoDB, Apache SOLR). </li><li>Interact with clients to elicit architectural and non-functional requirements such as performance, scalability, reliability, availability, maintainability. </li><li>Participate in designing the data model structured data in RDBMS into a graph database solution and NoSQL database solution. </li><li>Develop near real-time data processing solutions using Kafka and Spark Streaming. </li><li>Participate in designing Spark architecture with Databricks and Structured Streaming.</li><li>Set up Microsoft Azure with Databricks, and Databricks Workspace for business analytics. </li><li>Contribute to the automate build process by using Jenkins and Ansible to achieve continuous integration and continuous deployment.</li></ul><p><br></p><p><strong>Desired Profile:</strong></p><ul><li>Masters in computer science/Applications, Information Technology/Systems or Electronics/Electrical Engineering.</li><li>Minimum 1 year experience as Big Data Engineer, Data Engineer, Data Engineering Specialist, Data Warehousing Analyst or related occupation.</li><li>Must be willing to travel/relocate to anywhere in the US.</li><li>Edison, NJ and unanticipated locations throughout US</li></ul>","isHybridJob":true,"isRemoteJob":true,"exclusiveJob":false,"hiringManager":"","jobCatagories":[],"maxExperience":"12","minExperience":"10","isOnPremiseJob":false,"onBehalfOfName":"Orion Innovation","otherlocations":[{"lat":40.5187154,"lon":-74.4120953,"zip":"","city":"Edison","text":"Edison, NJ, USA","state":"New Jersey","country":"United States","is_city":true,"is_state":false,"is_country":false,"state_code":"NJ","countryCode":"US","isLocationSet":true,"isLocationResolved":true}],"experienceLevel":"Mid / Senior","numberOfOpenings":"1","maxSeniorityLevel":6,"minSeniorityLevel":3,"otherJobReference":"","sharpenedJobTitle":"Big Data Engineer","job_category_group":3,"growthOppurtunities":[],"portalLocationDisplay":"United States / Remote","educationQualification":"","expertise_coreskill_or_product":["Big Data","Software Engineering"],"job_id":"2645"}
