Cloud Data Engineer

Company: Union Pacific
Location: Omaha
Posted on: June 24, 2022

Job Description:

This is an onsite position located in Omaha, Nebraska where you can work up to 50% from home.
DescriptionAre you passionate about building data solutions? If so, now is the time to join our industry-leading Technology Department and help build critical data insights platforms for a global logistics company! As a Cloud Data Engineer, you will play a key role in building and expanding our cloud data analytics insights platform that support enterprise level insights across our enterprise.
Accountabilities

• Leverage your ability to design, build and deploy data solutions in cloud environments that capture, explore, transform, and utilize data to support business intelligence/insights, real-time analytics and Machine Learning/Artificial Intelligence.
• Develop different data processing pipelines to support data movement across multiple cloud integration boundaries such as Hybrid Cloud, Multi-Cloud and Intra-cloud
• Develop solutions to support analytics, visualization, ML, and integration use cases for both real-time and batch processing, including Building and operationalizing complex data solutions, correct problems, apply transformations, and recommending data cleansing/quality solutions
• Incorporate core data management competencies including data governance, data security and data quality and Develop CI/CD pipelines to deploy, maintain, and manage the lifecycle of data pipelines
• Collaborate within and across teams, analyze complex data sets and provide consulting, education and develop migration plans for legacy systems to leverage the new insights platform
  Required
  • A Bachelors degree in computer science, MIS, related field or commensurate experience in this field
  • Experience and skills in data pipeline and data in motion development using technologies like Confluent/Kafka connect, Azure Data Factory and/or Databricks/Spark.
  • Experience with Stored Procedures, UNIX Shell Script and/or UNIX/Linux OS
  • Experience with distributed cloud computing platforms, particularly containerized environments or the Hadoop/Spark ecosystem
  • Experience programming in Java, Python, Scala or C/C++ in a programming intensive role.
  • Experience working in a cloud environment AWS/GCP/Azure
  • Knowledge and understanding of cloud security postures and networking
  • Experience and skills in database design, data modelling, and complex SQL queries in RDBMS and NoSQL databases using technologies like Oracle, Hive, HBase, or Teradata
  • Knowledge and understanding of integration patterns such Data at Rest, Asynchronous and/or Synchronous integration.
  • 18 years of age or older
    Preferred
    • Experience with Data Platform in Azure Cloud
    • Experience with Snowflake, DataBricks, Azure Data Lake, Airflow or other Cloud data Warehouse

Keywords: Union Pacific, Omaha , Cloud Data Engineer, Engineering , Omaha, Nebraska