Data Engineer

Position Description

The Data Engineer will play a crucial role in designing, implementing, and maintaining our organization's data infrastructure. This role will contribute to the efficient storage, retrieval, and analysis of data, enabling informed decision-making across our organization.

Responsibilities

• Collaborate with cross-functional teams to understand data requirements to design efficient data warehouse solutions
• Develop and maintain a robust data warehouse architecture that ensures scalability, performance, and data integrity
• Implement pipelines to move raw data in Azure Synapse using Azure Data Factory, SQL, Python, C# in line with well-established architectural standard related to Data Lakehouse and
• Data Warehouse modeling standards
• Data Quality Assurance - ensure data accuracy, consistency, and integrity throughout all processes, and implement data governance best practices.
• Monitor and tune the data warehouse performance to ensure optimal query execution and data retrieval times
• Identify and resolve bottlenecks in the ETL pipelines and data warehouse infrastructure
• Develop and maintain data models, including dimensional and star schemas, to support efficient querying and reporting
• Collaborate with reporting and analytics teams to understand requirements and translate them into effective data structures
• Implement security measures to protect sensitive data within the data warehouse
• Work closely with developers, analysts, and other stakeholders to understand their data needs and provide necessary support
• Document data warehouse processes, data dictionaries, and ETL workflows for knowledge sharing and future reference
• Design, implement, and document data architecture and data modeling solutions
• Participate with Data Analyst(s) as needed to define minimal viable data assets in support of the visual needs.
• Review and provide architectural guidance for analytic solutions
• Triage and troubleshoot data anomalies submitted by the user community

Knowledge, Skills, & Abilities

• Experience with ETL tools and techniques for data integration
• Strong understanding of data modeling concepts, including dimensional modeling and normalization
• Strong communication skills to collaborate with technical and non-technical stakeholders
• Experience with version control systems (e.g., Git) and agile development methodologies is a plus
• Experience in Python/PySpark notebooks
• Experience in Azure Data Factory or SSIS, Azure DW, Azure Data Lake, and Power BI
• Experience with Microsoft Fabric a plus

Requirements

• Proven experience as a Data Warehouse Engineer or in a similar role
• Practical experience in Python related to data engineering (spark, pandas, etc)
• Practical experience in SQL related to data engineering
• Proficiency in designing and implementing data warehouse solutions using technologies such as MS SQL databases and Azure Synapse or other cloud-based data warehousing services
• Ability and initiative to learn and research new concepts, ideas, and technologies quickly
• Ability to work independently as well as function as an integral part of a team, take initiative and contribute in a fast-paced environment

Why Work for Flynn?

Flynn Group offers a variety of benefits and perks to encourage and empower our employees. We are committed to helping each employee work and live to his or her fullest potential. We offer a variety of benefits and perks while working for us:

• Medical/Dental/Vision
• Retirement and Savings Plan
• Short- and Long-Term Disability
• Basic Life Insurance
• Voluntary Life Insurance
• Tuition Reimbursement
• Paid Time Off
• Flexible/Hybrid Work Schedules
• Company Outings
• Dining Discounts
• PC/Laptop Purchase Assistance
• On-Site Fitness Center
• On-Site Daycare
• On-Site Café
• FUN Work Environment!

The Flynn Group is an Equal Opportunity Employer