Lead Data Engineer

Job Responsibilities

Job Summary

This role is responsible for the design, development, and maintenance of data pipelines for the enterprise data warehouse to address the data and analytics needs of the business.

What Would You Do? The Specifics.

• Work with the data and analytics team of project managers, business analysts, data architects, and data modelers to understand requirements and data architecture for an ETL/ELT process.
• Design and develop robust ETL processes using ETL tools and technologies.
• Understand existing ETL processes and optimize for enhanced performance.
• Partner with vendors as well as the internal data analytics team to collaborate and deliver on projects; mentor and lead data engineers.
• Create technical design documents that capture source-to-target mapping, transformation algorithms, and business rules.
• Collaborate with the business, data and analytics, and cross-functional team to suggest efficient and innovative solutions.
• Support ongoing maintenance and optimizations of ETL jobs.

Preferred Qualifications

 

Work Experience

• 6+ years experience in ETL Development and Database Warehousing (Required)

Education

• Four-year college degree or equivalent experience. BA/BS in relevant discipline (Required)

 

Licenses, Certifications, Professional Affiliations

• Microsoft Azure or Databricks Certifications (Preferred)

Additional Skills

• Good understanding of Agile and SDLC methodologies. (Required)
• Knowledge of industry-wide technology trends and leading practices. (Required)
• Demonstrated knowledge of Databases (i.e., Microsoft SQL Server, Azure SQL) (Required)
• Proficiency in ETL tools (Databricks, Azure synapse pipelines) (Required)
• Proficiency in cloud data warehouses (e.g., Azure.) (Required)
• Proficiency in SQL; Ability to understand, modify and write complex SQL queries (Required)
• Proficiency in data lifecycle, data architecture and data modeling concepts (Preferred)
• Experience in big data technologies such as Spark, Kafka etc. (Required)
• Experience in any programming language such as Java, Python, Scala (Required)
• Strong verbal/written communication abilities, effective interpersonal skills, and strong attention to detail. (Required)
• Excellent organization, planning, judgment, and time management skills. (Required)
• Maximizes efforts towards productivity, identifies problem areas, and assists with implementing solutions. (Required)
• Excellent critical thinking skills; using logic and reasoning to identify strengths and weaknesses of alternative solutions, conclusions, or approaches to problems. (Required)

Additional Information

Taking Care of our People!

We understand the importance of financial health and security, and because of that, we provide competitive compensation to all Associates. We also offer a comprehensive benefits package including health and dental insurance, 401k retirement savings with company match, flex spending account, paid personal time off, paid company holidays, parental leave, employee eyewear discount and much, much more. At National Vision, we strive to deliver opportunities for professional growth and long-term career fulfillment. We provide training programs, access to educational courses and pride ourselves on the ever-increasing amount of promotions from within.
 

We are an equal opportunity employer.  We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, genetic information, disability, veteran status, and other legally protected characteristics.