Are you looking to make an impact at the intersection of leading technological trends of our time: big data, streaming computing, artificial intelligence, open source, cloud and serverless computing? If yes, Azure Big Data team are looking for you. 

Azure Big Data team (Azure Synapse Analytics, Azure HDInsight, Azure Stream Analytics, Azure Datalake Analytics, Azure Databricks and Cosmos) present exciting challenges in technologies such as big-data, cloud, distributed computing, artificial intelligence, storage and open-source. We build reliable, highly scalable and highly performing distributed systems for data analytics on Azure. Azure Stream Analytics is an event-processing engine that allows users to examine high volumes streaming data at scale. We are supporting massively parallel complex streaming processing in Azure. Azure HDInsight is one of the fastest growing Azure services that offers popular open-source technologies, such as Spark, Hadoop, Kafka, HBase and many others in a form that is easy for customers to use. We work with various open-source technologies including Spark, Hadoop, Yarn, etc. and make contributions to these technologies. We are running one of the world’s largest big data cluster which has more than 25,000 machines, stored more than 10,000PB data and run tens of thousands of jobs everyday across search, ads, Office, Xbox, etc.  

Responsibilities

For this role, you will be laser-focused on Spark: building on it, making contributions, and making our product the best the world has to offer. As an engineer, you have the opportunity to work on the latest technology in Azure Big Data and Analytics products: 

• Design and develop the world-leading Spark offering 
• Collaborate with key stakeholders and contribute to the full development life cycle, including requirements analysis, architecture design, testing, documentation, implementation, and customer support 
• Play an important role in creating the high-level design document, delivering high quality code, and leading validation for all types of testing and support activities 
• Analyze and translate business needs into effective technical solutions and documents 
• Perform and learn in a culture where teamwork and collaboration are encouraged, and diversity is respected and valued  

Qualifications

Basic Qualifications:  

• BS/MS/PHD degree in computer science or related field 
• 10+ years of experience in computer engineering 
• 8+ years of software design and development experience with at least one of C/C++/C#/Java/python/Scala 
• 5+ years of experience on Apache Spark 
• Effective verbal and written communication skills in English 

Preferred Qualifications: 

• Open-source committer in Apache Spark 
• Experience of working as technical leader will be a plus 
• Experience with Azure/AWS or other cloud computing platforms is a plus 
• Knowledge of optimizing distributed systems and database performance 
• Track record of having the internal drive and motivation to begin and continue tasks 
• Deep desire to work collaboratively, solve problems with groups, find win/win solutions and celebrate successes 
• Strong communication skills (verbal and written) with ability to communicate across teams, internal and external at all levels 
• Solve problems by always leading with deep passion and empathy for customers 

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. 

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.