Job Duties:

•Build infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources
•Design, develop, and maintain performant and scalable applications
•Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability
•Perform debugging, troubleshooting, modifications and unit testing of integration solutions
•Operationalize the developed jobs and processes and processes.
•Create databases and infrastructure to processing data at scale
•Create solutions and methods to monitor systems and solutions
•Automate code testing and pipelines
•Engage directly with business partners to participate in design and development of data integration/transformation solutions per functional requirements.
•Work in a scaled Agile environment accountable to deliver results in sprints.
•Engage and actively seek industry perspectives through external engagements such as hackathons, peer groups, etc.
•Generate, prepare, and catalog APIs
•Work with UI Designer to build user interfaces per design specifications
•Employee is also responsible for performing other job duties as assigned by Caterpillar management from time to time.

Required Skills:
•BS in Computer Science, Computer Engineering, or Engineering related fields with 4+ years relevant Industry experience.
•Experience of data structures, algorithms, profiling & optimization.
•2-3 years In-depth Experience of SQL, ETL design, and data modeling techniques
•Experience in approved enterprise data platform or qualified to be trained on the approved enterprise data platform (Change to specific platform when posted ex. C3)
•Knowledge of AWS cloud services: EC2, EMR, RDS, Redshift
• Software development experience with object-oriented/object function scripting languages: Python, Java, Javascript, C++, Scala, etc.

Desired Skills:
•Experience working with revision control systems (Git, etc.).
•Experience with automated build automation tools (Maven, etc.).
•Demonstrated experience object oriented programming, data structures and algorithms.
•Passion for acquiring, analyzing, and transforming data to generate insights.
•Thrive in a fast-paced environment that delivers results and has fun.
•Demonstrated analytical ability, judgment and problem analysis techniques.
•Knowledge of Agile Software development methodology.
•Familiarity with concepts of cloud computing.
•Great verbal and written communication skills to collaborate cross functionally and enhance scalability.
•Interpersonal skills with the ability to work effectively in a cross functional team.
•Knowledge of enterprise data sources and uses
•Previous experience working with data owners/stewards
•Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
•Previous experience manipulating, processing and extracting value from large disconnected datasets.
•Knowledge of big data tools: Hadoop, Spark, Kafka, etc.
•Knowledge of relational SQL and NoSQL databases, including Postgres and Cassandra.
•Knowledge of data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
•Knowledge of stream-processing systems: Storm, Spark-Streaming, etc.
•Knowledge of API managers: Apigee, Azure, Catana, etc