Data Engineer - Data Catalog Engineering Services

Data Engineer - Data Catalog Engineering Services

Data Engineer - Data Catalog Engineering Services

Job Overview

Location
Newark, New Jersey
Job Type
Full Time Job
Job ID
117640
Date Posted
9 months ago
Recruiter
Charles Karen
Job Views
204

Job Description

The Data Platform Services Team is a part of the Analytics, Data Management, and Integration area of Mars Global Services (MGS). Our mission statement is to provide platforms and technologies to accelerate development of analytics products, to enable sustainable and scalable development, and to guide technology decisions made by analytics functions within MGS and beyond.

This role is for a Data Engineer to join the Data Platform Services team to drive technical aspects of new Platform Services implementation.

This role will specialize in Data Catalog and will initially be responsible for implementing and deploying the Data Catalog to Mars Segments and Business Functions,

The Data Platform with more than 2.5 PB of data supports numerous data and analytics programs. The engineering data catalogue comprises an inventory of all data assets in the Data Lake governing data access management and data asset ownership.

The Engineering Data Catalogue Capabilities enables:

  • Automated discovery, curation, and lineage at scale​
  • Delivery of data insight, context and unity​
  • Adding meaning and relevance to data assets with metadata-driven discovery, inventory, and preparation.​
  • Using AI-powered automation to discover, inventory and organize your data assets, quickly and accurately.​
  • Accessing an unified view to add rich context to data with a view of enterprise metadata - activated by machine learning and curation.​
  • Getting trusted insights fast by rapidly turning data into business insights by helping users find and prepare data for AI/ML applications.​

​​

What are we looking for?

  • Bachelor's degree, or equivalent
  • Microsoft Azure certification
  • Informatica certification (preferable)
  • Hands-on experience in the following (preferable)
    • Experience in Installation, configuration, and Maintenance of EDC (Enterprise Data Catalog)
    • Informatica EDC custom development
    • Informatica Advanced Scanning skills
    • Data Profiling, development of Data Domains to enable them in Informatica EDC
    • Experience of implementing EDC on a Microsoft Azure Platform
    • Knowledge of integration with Business Catalog / Business Glossary
  • Technical expertise in Big Data Tech Stack and experience in database and data engineering capabilities
  • Rich heritage in designing and building databases, analytics and BI platforms with Big Data
  • Including use of cloud platforms like Azure or AWS, technologies across traditional and contemporary software (e.g., SQL Server, Hadoop, NoSQL DB), programming languages such as SQL, Python, Scala, R and visualization tools
  • Good understanding of IT infrastructure components & challenges
  • Basic experience of Project or Scrum Management2+ years of experience in Informatica Data Catalog Implementations
  • Experience working in Agile/Scrum methodology using DevOps to create user stories

What will be your key responsibilities?

  • Lead technical & engineering projects in collaboration with other team members (including with offshore talent partners) to ensure rapid development of quality, scalable and sustainable data platform services, with global best practices and consistency
  • Coordinate technical activities of our Platform Services Implementation program under guidance of Service managers & overall program manager
  • Taking part in different POCs to deliver data platform services with up-to-date capabilities available in the industry, and potentially lead them
  • Develop & deploy Microsoft Azure-based services and tools, spanning multiple areas and use cases
  • Hands on development on python, PyCharm, spark to create new data platform components, data transformation pipelines and integration system

In addition, these are the responsibilities regarding the Data Catalog deployment:

  • Develop the MVP for Segments / Business Function per the Data Catalogue Roadmap
  • Support the business in Metadata initiatives using DevOps for creating User Stories
  • Implementation of Advanced Scanners of Informatica to get the data lineage for assets in the Azure Data Lake
  • Additional EDC technical tasks under guidance from Data Catalogue Technical Lead such as Upgrades, patches, SSL certificates etc.
  • Develop interfaces to integrate EDC metadata with Business Catalogue
  • Integrate Business Catalogue with EDC for the Scorecards and Business Glossary
  • Technical expertise in Big Data Tech Stack and experience in database and data engineering capabilities
  • Rich heritage in designing and building databases, analytics and BI platforms with Big Data
  • Including use of cloud platforms like Azure or AWS, technologies across traditional and contemporary software (e.g., SQL Server, Hadoop, NoSQL DB), programming languages such as SQL, Python, Scala, R and visualization tools
  • Good understanding of IT infrastructure components & challenges
  • Basic experience of Project or Scrum Management2+ years of experience in Informatica Data Catalog Implementations
  • Experience working in Agile/Scrum methodology using DevOps to create user stories

What can you expect from Mars?

  • Work with over 130,000 like-minded and talented Associates, all guided by The Five Principles.
  • Join a purpose driven company, where we’re striving to build the world we want tomorrow, today.
  • Best-in-class learning and development support from day one, including access to our in-house Mars University.
  • An industry competitive salary and benefits package, including company bonus.

Job ID: 117640

Similar Jobs

Meta

Full Time Job

Data engineer - data catalog engineering services Data engineer - data catalog engineering services

Meta is embarking on the most transformative change to its business and technolo...

Full Time Job

Deloitte

Full Time Job

Data engineer - data catalog engineering services Data engineer - data catalog engineering services

Deloitte’s Enterprise Performance professionals are leaders in optimizing...

Full Time Job

Labcorp

Full Time Job

Data engineer - data catalog engineering services Data engineer - data catalog engineering services

Job Duties/Responsibilities:Determine the acceptability of specimens for testing...

Full Time Job

Braintrust

Full Time Job

Data engineer - data catalog engineering services Data engineer - data catalog engineering services

• JOB TYPE: Direct Hire Position (no agencies/C2C - see notes below)â€Â...

Full Time Job

Cookies

This website uses cookies to ensure you get the best experience on our website.

Accept