Join Kainos and Shape the Future

At Kainos, we’re problem solvers, innovators, and collaborators - driven by a shared mission to create real impact. Whether we’re transforming digital services for millions, delivering cutting-edge Workday solutions, or pushing the boundaries of technology, we do it together.

We believe in a people-first culture, where your ideas are valued, your growth is supported, and your contributions truly make a difference. Here, you’ll be part of a diverse, ambitious team that celebrates creativity and collaboration.

Ready to make your mark? Join us and be part of something bigger.

MAIN PURPOSE OF THE ROLE & RESPONSIBILITIES IN THE BUSINESS:

As a Senior Data Engineer (Senior Associate) at Kainos, you will be responsible for designing and implementing a reusable, scalable data migration platform using Apache NiFi, integrating multiple source systems, transforming data to predefined format, and integration with Power BI for downstream analytics.

Key Responsibilities

Build and maintain NiFi flows for ingestion, transformation, and loading.
Implement parameterized, version-controlled pipelines using NiFi Registry.
Design data models and optimize queries for Azure SQL.
Ensure data quality, error handling, and auditability.
Containerize and deploy NiFi using Docker/Kubernetes; automate with CI/CD.
Secure credentials and flows using Azure Key Vault and TLS.
Collaborate with functional teams for mapping and cutover planning.

Tech Stack

Apache NiFi

Designing robust flows using processors: Fetch/PutSFTP, QueryDatabaseTable, PutSQL, ConvertRecord, UpdateRecord, ExecuteScript, RouteOnAttribute, MergeRecord, HandleHttpRequest/Response.
Record-oriented processing with schemas (Avro/JSON/CSV), Controller Services (RecordReader/Writer, DBCPConnectionPool, SSLContextService).
Parameter Contexts, Variable Registry, FlowFile attributes, back pressure, prioritizers, and retry patterns.
NiFi Registry for flow versioning, promoting between environments, and flow comparison.
Error handling & DLQ patterns (failure, retry, provenance-based replay).
Performance tuning (Concurrent Tasks, Run Schedule, batch sizes, repositories tuning).

Scripting & Extensibility

Groovy/Python/Java for ExecuteScript and custom processors where needed.
REST APIs.
JSON/XML transformation

Data Modeling & SQL (Azure SQL / SQL Server)

Strong SQL.
JDBC connectivity, bulk load strategies and query optimization.
Understanding Power BI consumption patterns (star schema, fact/dimension design, incremental refresh).

Containers & Orchestration

Docker for local/dev environments (mounting JDBC drivers, persisting repos/logs).
Docker Compose for NiFi + Registry + dependencies.

SAP Connectivity (Nice-to-Have)

Experience integrating SAP ECC or S/4HANA data sources.
Familiarity with SAP connectors in NiFi (e.g., via JDBC).
Understanding IDoc/BAPI structures and how to extract transactional/master data.
Handling SAP authentication (Basic, OAuth, or SAP-specific mechanisms).

Embracing our differences  

At Kainos, we believe in the power of diversity, equity and inclusion. We are committed to building a team that is as diverse as the world we live in, where everyone is valued, respected, and given an equal chance to thrive.   We actively seek out talented people from all backgrounds, regardless of age, race, ethnicity, gender, sexual orientation, religion, disability, or any other characteristic that makes them who they are.   We also believe every candidate deserves a level playing field.

Our friendly talent acquisition team is here to support you every step of the way, so if you require any accommodations or adjustments, we encourage you to reach out.

We understand that everyone's journey is different, and by having a private conversation we can ensure that our recruitment process is tailored to your needs.