Senior Data Engineer
![]() | |
![]() | |
![]() United States, Wisconsin, Franklin | |
![]() 1 Northwestern Mutual Way (Show on map) | |
![]() | |
At Northwestern Mutual, we are strong, innovative and growing. We invest in our people. We care and make a positive difference. Job Description: The Senior Data Engineer at Northwestern Mutual Life Insurance Company in Franklin, WI will apply engineering best practices in order to analyze, design, develop, deploy and support software solutions. Develop software using continuous deployment and integration practices. Participate in Agile implementation and maintenance of source control and release procedures. Identify data quality issues and their root causes. Propose fixes and design data audits. Understand business requirements and use best practice for creating end-to-end data flow representation such as architecture, data modeling diagrams for various storage, transmission, reporting and data validation. Design and build data validation automation framework which can validate data across different database systems and business intelligence reporting layer. Ensure data completeness, data integrity, data accuracy, data conformity, data duplication and data security. Design automated utilities based on PySpark/databricks for large volume data comparison. Design Integration and System Test Strategy for ETL based solution of Data Migration and Data Warehouse projects. Validate Kafka and PySpark based batch and real time large data flow across different layers. Design and validate automated data validation using Apache Spark/Python based programming across AWS Cloud S3 bucket to Raw and Refined vault. Gather and use data from different business sources, data of various source formats like XML, JSON, CSV, Mainframe files, Database tables for analysis done using Python/Scala/Java programming to recommend measures to increase performance, efficiency and stability. Create and design summarized and detailed Power BI Business Reporting. Telecommuting permitted 2 days per week. Salary $131,893- $208,520 per year. Minimum Requirements: Bachelor's degree in Information Technology, Computer Science, or a related field plus 5 years of experience as a Software Engineer, or a related occupation. Experience must include 4 years with each of the following: (1) debugging, analysis, and software documentation; (2) Python, JVM (Java, Scala), Apache Spark, and SQL; (3) Agile methodologies and DevOps environment; (4) DB2, Sybase, Netezza, PostgreSQL, MySQL, Redshift, Oracle, Teradata, SQL Server, and Presto; and (5) data integration patterns and tooling, including ELT/ETL, EII, Replication, Event Streaming, and Virtualization to support batch and real-time data needs. Interested candidates send resume to apply@northwesternmutual.com. Reference code 487 in the subject line. Any wage range listed here supersedes corresponding wage ranges listed within the Pay Transparency Guide. Grow your career with a best-in-class company that puts our client's interests at the center of all we do. Get started now! We are an equal opportunity/affirmative action employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, gender identity or expression, sexual orientation, national origin, disability, age or status as a protected veteran, or any other characteristic protected by law. If you work or would be working in California, Colorado, New York City, Washington or outside of a Corpo rate location, please click here for additional infor mation pertaining to compensation and benefits. FIND YOUR FUTURE We're excited about the potential people bring to Northwestern Mutual. You can grow your career here while enjoying first-class perks, benefits, and commitment to diversity and inclusion.
|