Principal Data Engineer

About Optum

Careers with Optum.
Here's the idea. We built an entire organization around one giant objective; make health care work better for everyone. So when it comes to how we use the world's large accumulation of health-related information, or guide health and lifestyle choices or manage pharmacy benefits for millions, our first goal is to leap beyond the status quo and uncover new ways to serve.
Optum, part of the UnitedHealth Group family of businesses, brings together some of the greatest minds and most advanced ideas on where health care has to go in order to reach its fullest potential. For you, that means working on high-performance teams against sophisticated challenges that matter. Optum, incredible ideas in one incredible company, and a singular opportunity to do your life's best work.

Position

As a Principal Data Engineer, you will be part of a team working at the intersection of financial services and health care to launch new cash flow solutions to drive broader, more equitable access to capital. You will be focused on developing cutting edge data-pipelines that are the foundation of our big-data analytic platform. You will be a technical leader, focused on innovation; developing proofs of concepts that leverage data in new and exciting ways. At Optum, you'll find an organization that will recognize your talents and provide growth opportunities. Join us!

Primary Responsibilities

• Develop data pipelines to ingest and transform data using clean coding principles
• Contribute to common frameworks and best practices in code development, deployment and automation/orchestration of data pipelines
• Partner with Data Science and Product leaders to design best practices and standards for developing and productionalizing analytic pipelines
• Partner with Infrastructure leaders on architecture approaches to advance the data and analytics platform, including exploring new tools and techniques that leverage the cloud environment (Azure, Snowflake, others)
• Design conceptional and logical data models, architecture diagrams and flowcharts
• Mentor and train junior members of the team

Your qualification

• Extensive hands-on experience utilizing best practices to develop and deploy data pipelines to a production environment
• Experience working with both real-time and batch data, knowing the strengths and weaknesses of both and when to apply one over another
• Ability to debug complex data issues while working on very large data sets with billions of records
• Fluent in SQL (any flavor), with experience using Window functions and more advanced features
• Understanding of DevOps tools, Git workflow and building CI/CD pipelines
• Ability to work with business and technical audiences on business requirement meetings, technical white boarding exercises, and SQL coding/debugging sessions
• Familiar with Airflow or similar orchestration tool

Will be a plus

• Experience working in projects with agile/scrum methodologies
• Experience with data de-identification and encryption
• Experience with shell scripting languages
• Familiar with Virtual Data Warehousing (e.g. Snowflake)
• Well versed in Python, in fulfilling multiple general-purpose use-cases, and not limited to developing data APIs and pipelines
• Experience with Apache Spark and related Big Data stack and technologies, preferably using Scala, else PySpark
• Experience working with Apache Kafka, building appropriate producer/consumer apps
• Familiarity with production quality ML and/or AI model development and deployment
• Experience working with Kubernetes and Docker, and knowledgeable about cloud infrastructure automation and management (e.g., Terraform)

Additional details

A relocation package is discussed individually.