The Azure Intelligence Platform team in Microsoft present exciting challenges in technologies such as big-data, cloud, distributed computing, artificial intelligence, and storage. We build reliable, huge scale and high-performance distributed systems for big-data analytics on Azure. Azure HDInsight is one of the widely adopted Big-data PaaS services on Azure that offers popular open-source technologies, such as Spark, Hadoop, Hive, Kafka, HBase with enterprise grade security and governance. We work closely with the Apache community by both contributing new features to Open Source and adopting the latest from the community.

As an engineer of Hive, you will be part of the engineering team that focuses on Apache Hive, Tez and LLAP. You will work closely with experts in other Open-source projects in Hadoop ecosystem and build containerized, highly scalable, faster performing enterprise ready big-data platforms on Microsoft Azure for supporting data warehousing, machine learning and IoT applications. You will also collaborate with customers to on-board them into HDInsight clusters, understand their use-cases to build features and debug issues on their live/production/test clusters.

Responsibilities

1. Building cloud scale big data analytics products using Azure tools and services with a focus on efficiency, reliability, and security.
2. Collaborate with customers and partners across geographies to understand business goals and technical requirements.
3. Driving the feature development in HDInsight Hive/LLAP services end to end, all the way from gathering requirements, development, testing, deployment to ensuring high availability post deployment.
4. Collaborate with Apache Hive open-source community to drive design discussion and review for new feature development and bug fixes.
5. Debugging customer issues in their live/production/dev clusters and providing solutions to restore service with minimal disruption to their business. Perform root cause analysis, trend analysis and post-mortems.

Qualifications

1. B.E./ B.Tech. or equivalent degrees in Computer Science (Masters is a plus).
2. Candidate having 4 - 8 years of experience in software development.
3. Good experience in Database system internals and preferably SQL engine (query planner, optimizer, executor) of any commercial database systems.
4. Good experience in building and maintaining any distributed computing data platforms.
5. Clean coding habits with proficiency in Java/C#/C++.

Big plus if have:

1. Good experience in Big-Data platforms with deep understanding of Apache Hive, Tez and/or ORC (Preferably Committer or PMC in any of these open-source technologies).
2. Good understanding of cloud technologies such as storage, compute, and network.
3. Good knowledge in Container Orchestration - automates the deployment, management, scaling, networking using Kubernetes.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.