Big Data Migration Engineer – Business Intelligence Engineer (Contract)
Position Can sit in either NY or Princeton.

Bloomberg runs on data. As the Data Warehouse / Business Intelligence team for the firm, our data captures the who, what, when, where and why of everything about Bloomberg - from everything about our clients to their use of Bloomberg products to our ticketing systems to information about the hardware in our data centers and client locations. We are responsible for ingesting and preparing massive amounts of data (4PB and growing) to empower the whole company (7000+ users and growing) to make a difference through reporting, dashboards, self-service and advanced analytics. The data is used to drive new businesses within Bloomberg by providing new insights. Our goal is to have a direct or indirect hand in every decision Bloomberg makes!

What's in it for you?

We are gearing up to migrate an existing 1.7PB set of Hadoop clusters to a new cluster. The main challenge is ensuring that data is migrated, replicated, and all systems updated successfully without significant downtime for all stakeholders. The secondary challenge is ensuring that all processes on the cluster, as well as access patterns to the data, are migrated successfully from the HDP2.7 cluster to CDP7.1.

You will need to have:

•  In depth knowledge of Hadoop and Hive
•  Significant familiarity with Kerberos, Yarn, Oozie, and Spark
•  Excellent communication skills to be able to interface with multiple business units, engineering application teams, and engineering infrastructure teams
•  Excellent project management skills to ensure continuity of business processes during the transition, and ensure no gaps in planning across the move
•  Expertise in shell scripting and python programming

Nice to Have:

•  An understanding of data warehousing methodologies, ETL processing and dimensional data modeling
•  Experience with ETL tools, such as Informatica, SSIS/SSRS, or Talend
•  Experience working in a UNIX or Linux development environment

Bloomberg is an equal opportunities employer, and we value diversity at our   company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.