Cloud Data Engineer
Company: Union Pacific
Location: Omaha
Posted on: June 24, 2022
Job Description:
This is an onsite position located in Omaha, Nebraska where you
can work up to 50% from home.
DescriptionAre you passionate about building data solutions? If so,
now is the time to join our industry-leading Technology Department
and help build critical data insights platforms for a global
logistics company! As a Cloud Data Engineer, you will play a key
role in building and expanding our cloud data analytics insights
platform that support enterprise level insights across our
enterprise.
Accountabilities
- Leverage your ability to design, build and deploy data
solutions in cloud environments that capture, explore, transform,
and utilize data to support business intelligence/insights,
real-time analytics and Machine Learning/Artificial
Intelligence.
- Develop different data processing pipelines to support data
movement across multiple cloud integration boundaries such as
Hybrid Cloud, Multi-Cloud and Intra-cloud
- Develop solutions to support analytics, visualization, ML, and
integration use cases for both real-time and batch processing,
including Building and operationalizing complex data solutions,
correct problems, apply transformations, and recommending data
cleansing/quality solutions
- Incorporate core data management competencies including data
governance, data security and data quality and Develop CI/CD
pipelines to deploy, maintain, and manage the lifecycle of data
pipelines
- Collaborate within and across teams, analyze complex data sets
and provide consulting, education and develop migration plans for
legacy systems to leverage the new insights platform
Required
- A Bachelors degree in computer science, MIS, related field or
commensurate experience in this field
- Experience and skills in data pipeline and data in motion
development using technologies like Confluent/Kafka connect, Azure
Data Factory and/or Databricks/Spark.
- Experience with Stored Procedures, UNIX Shell Script and/or
UNIX/Linux OS
- Experience with distributed cloud computing platforms,
particularly containerized environments or the Hadoop/Spark
ecosystem
- Experience programming in Java, Python, Scala or C/C++ in a
programming intensive role.
- Experience working in a cloud environment AWS/GCP/Azure
- Knowledge and understanding of cloud security postures and
networking
- Experience and skills in database design, data modelling, and
complex SQL queries in RDBMS and NoSQL databases using technologies
like Oracle, Hive, HBase, or Teradata
- Knowledge and understanding of integration patterns such Data
at Rest, Asynchronous and/or Synchronous integration.
- 18 years of age or older
Preferred
- Experience with Data Platform in Azure Cloud
- Experience with Snowflake, DataBricks, Azure Data Lake, Airflow
or other Cloud data Warehouse
Keywords: Union Pacific, Omaha , Cloud Data Engineer, Engineering , Omaha, Nebraska
Didn't find what you're looking for? Search again!
Loading more jobs...