The Role:
This is a full-time hybrid role for a Senior Data Engineer in our Data & AI Practice at OpenSky Data Systems in Naas.
You will be working on the latest Microsoft Data & AI technologies at the forefront of technological development (Fabric, Azure OpenAI, AI Studio & Cognitive Services, etc). We are working closely with our colleagues in Microsoft to ensure our staff and our clients are working with the best and most modern technology stacks.
The ideal candidate will have practical experience in several Data Warehouse technologies. We are looking for a self-starter who loves to continually evaluate new technologies, innovate, educate, and collaborate, all to deliver critical services that help our clients succeed.
Our Data & AI Practice
OpenSky Data Systems has a 20-year history in delivering Technology Innovation to our customers across Ireland, UK, and Europe. We have multi-disciplinary teams working across our 3 Centres of Excellence, Modern Applications (.NET), Microsoft Cloud (Power Platform), and Data & AI. We deliver projects that matter, whether it is working to reduce HPV cancer in Europe or reducing homelessness in Ireland, our projects create a positive impact on others.
Our Data & AI Practice works at the very forefront of Microsoft solutions and is partnered with leading AI institutes globally including CeADAR (Ireland’s Centre for AI) and the Alan Turing Institute (UK). We invest extensively every year in research & training, ensuring your skills are at the highest level so we can deliver excellence every time to our customers.
Key Responsibilities
Client Consultation: Provide expert consultation services to clients regarding data engineering strategies. Offer innovative solutions by thinking creatively and outside the box.
Data Pipeline Development: Design, develop, and maintain scalable data pipelines using Microsoft Azure Synapse Analytics and Microsoft Fabric.
Database Systems & ETL: Build, maintain, and optimize database systems and ETL pipelines using tools like Azure Data Factory (ADF) and SQL Server Integration Services (SSIS).
Data Warehousing: Design and maintain star schema data models, reusable pipelines, and warehouse objects.
Data Quality & MDM: Implement master data management solutions and apply best practices for data profiling, cleansing, and standardization.
DevOps & CI/CD: Use Azure DevOps, GitHub, and CI/CD workflows to manage deployments.
Data Governance: Adhere to Microsoft best practices and methodologies while implementing data governance and cataloguing solutions using Microsoft Purview ensuring compliance with GDPR, NIS2, and ISO27001 standards.
BI Reporting & Data Visualization: Create, update, and maintain interactive dashboards and reports using Power BI, SSRS, and Excel to provide actionable insights for business stakeholders.
Machine Learning: Using machine learning techniques to prepare and analyse data.
Team Leading: Lead and mentor team members to support their development and ensure successful project delivery
Requirements
Bachelor's degree in Computer Science, Information Technology, or a related field.
Minimum of 3 years of experience in a Senior Data Engineering or a similar role working with Azure Synapse Analytics for data ingestion, ETL/ELT workloads, and data integration in real world projects.
Strong experience in client engagement, acting as a technical advisor, providing insights and recommendations.
Proven ability to manage multiple projects and meet deadlines, while working as part of a team
Strong problem-solving skills and attention to detail with excellent communication skills with both technical and non-technical teams.
Strong understanding of AI and machine learning concepts, with exposure to applying AI techniques to data projects or understanding their potential impact.
Expertise in data wrangling and data preparation tools and techniques
Proficiency in Microsoft SQL Server and T-SQL scripting.
Creative thinker with the ability to innovate and provide strategic solutions as part of a team.
Desirable Skills
Experience in team leading and mentorship.
Microsoft Certifications: Azure AI Engineer Associate, Power BI Data Analyst Associate
Expertise in Microsoft Purview & Microsoft Cloud Adoption Framework
Knowledge of Azure AI services.
Expertise in Microsoft Azure Synapse Analytics, and Power BI.
Proficient in Azure DevOps, GitHub, and CI/CD processes.
Advanced knowledge of Azure Data Factory, SSIS, and Azure Data Storage (Blobs, Files, Queues, Tables, Disks, Data Lake Storage). –
What We Offer
You will form part of a high-performance team, working together to deliver projects of national and international importance, changing the way large businesses and governments work.
Competitive salary
Incremental increases in annual leave
Continuous Professional Development
Education Assistance Programme
Digital doctor service
Hybrid working
Employee Assistance Programme (EAP)