Responsibilities

• Collaborate/Interface with leadership and diversified business users to gather requirements and delivering end to end reporting solutions including design and development of new Power BI reports and dashboards.
• Participate in tactical and strategic planning discussions for various projects and/or products to enable business with definition, tracking and reporting of key metrics.
• Synthesize and analyze complex, high-volume, high-dimensionality data from varying sources using a variety of tools and data analysis techniques. Understand and translate business needs into optimized data models supporting long-term solutions.
• Own, design, implement and maintain of robust data pipeline along with Power BI dashboards to support organization-wide strategic initiatives; work with development team to develop and implement effective ETL and monitoring in Data Platform to support end to end BI landscape.
• Develop best practices for standard naming conventions and coding practices to ensure consistency of data models with maintenance of metadata, data catalog and documentation for internal business users.
• Understand and implement best practices for partitioning, compression, parallelization to optimize user experience and usability of reports.
• Drive scale and service improvements of existing data processes and pipelines by implementing automation, data tuning and performance concepts creatively.
• Effectively set and manage stakeholder expectations, which result in high or improved customer satisfaction. Effectively drive alignment with stakeholders on key issues, identify and facilitate an effective decision-making process.
• Recommend improvements in methodologies or frameworks to achieve consistent, predictable, and repeatable processes and projects.
• Maintain conceptual, logical and physical data models along with corresponding metadata.
• Build a “data analysis practice” with both full- and self-service models for investigations, and a regular engagement rhythm to empower the entire organization with data-driven decisions.
• Provide quick turnaround data analysis along with relevant data visualizations on ad-hoc/recurring basis to generate insights to help guide decision-makers and executives.
• Identify process and system improvement opportunities by monitoring existing metrics, analyzing data, and partnering with internal teams.
• Help internal business customers troubleshoot and optimize SQL and ETL solutions to solve reporting problems.
• Participating in team’s live-site activities.

Qualifications

Required

• 10+ years of experience architecting, designing, and operating large scale big data services.
• 10+ year experience with Azure Big Data stack (Data Lake, Spark, Hadoop) and distributed processing like Apache Spark, Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Factory, Azure Data Lake Storage, Azure Machine Learning, Azure Cognitive Services, Azure Databricks, Azure Data Explorer, PowerBI.
• 10+ years development experience on large-scale big data solutions including databases (SQL/No-SQL) and ETL / Data pipelines using cloud services.
• Ability to write high quality, maintainable, and robust code, often in Azure SQL, Azure Data Factory or similar cloud/ETL technologies for big data.
• Self-starter with a strong passion for using data to influence business decisions and strategy investments.
• Have basic understanding of programming languages such as Python, Ruby , Java, .NET.
• Ability to intelligently integrate a wide range of data sources and analysis to answer core business questions and discover growth opportunities.
• Excellent oral and written communication skills and ability to present and discuss data models and analysis to a range of audiences across development, operations, and business teams in Microsoft.
• Ability to work cross-functionally, be detail oriented ,build and maintain trust with internal stakeholders in a fast and agile development environment.
• Exceptional ability to effectively negotiate and collaborate across teams and organizations.
• Preferred experience working with cloud services with a strong understanding of cloud databases, compute, data streaming and storage.

Preferred

• Hands-on expertise on Python, complex SQL development and Kusto query language
• Modern DevOps practices (including Git, CI/CD, Azure DevOps/VSTS)
• Deep technical knowledge/experience on architecting, developing, and deploying enterprise Big Data engineering solutions
• Deep practical experience troubleshooting performance problems, tuning and optimizing big data solutions
• Architecture – the ability to create and explain 3-tier architecture diagrams, system context diagrams, system interaction diagrams, etc.
• Experience in big data workloads like HDInsight, Hadoop, Spark
• Advanced Analytics including Azure Databricks, visualization tools as Power BI
• Azure Synapse Analytics
• High throughput logging systems/databases like Azure Log Analytics, ELK Stack or similar
• Experience with any analytical / visualization tool (Power BI, Cognos, OBIEE, etc.) is a plus
• Undergrad degree in Engineering
• Strong communication skills