The Azure Data team in Microsoft, builds and operates some of the world's largest Cloud computing services. The biggest of these clusters run on Apache YARN. The team has adopted and enhanced Apache YARN to run at Azure Scale with extremely high resource utilization and enterprise grade security. The team also focuses on enabling Open source software like Apache Spark, Hive, HBase, etc. on Microsoft Azure. We work very closely with the Apache community by both contributing new features to Open Source and at the same time adopting the latest from the community. Apart from the open-source components, the team also works on several proprietary massively distributed technologies at Exabyte scales.  We are highly collaborative, data-oriented, and greatly value diversity of thought and ideas. If you are interested in extending the cutting edge of cloud-scale distributed systems, and building the next generation technologies, we would love to hear from you.

This job will require you to build expertise on cluster anatomy, container lifecycle management, performance optimizations for clusters with hundreds of thousands of machines.

Responsibilities

• Building cloud scale products with focus on efficiency, reliability and security.
• Building relationships with customers and partners across geographies to understand business goals and technical requirements.
• Owning the products and driving them end to end, all the way from gathering requirements, development, testing, deployment to ensuring high availability post deployment.
• Contribute to the architecture & design of the products.
• Helping evolve engineering practices & principles that marry the flexibility of open source and fast pace of service world.
• Ensuring the consistency of designs of features and components for high availability, reliability, security and Scale.
• Triaging issues and implementing solutions to restore service with minimal disruption to the customer and business. Perform root cause analysis, trend analysis and post-mortems.

Qualifications

• B.E/ B.Tech or equivalent degrees in Computer Science (Masters is a plus).
• Candidate should have expreince  between 7 -10years.
• Computer Science fundamentals in algorithm design, problem solving, and complexity analysis
• Delivering Cloud services in an engineering role
• Committing or contributing to any Open Source big data technologies
• Enterprise products design and implementation (Java/C#/C++)
• Distributed systems design and implementation

Good to have experience on any of the below technologies will be an added advantage:

• Apache Hadoop (HDFS/MR)
• Apache YARN/Hive/HBase
• Apache SPARK/Jupyter/Zepppelin
• Apache Tez
• Docker or Kubernetes
• Microsoft Azure Services (any)

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.