Posted 13h ago

Principal Observability Engineer

@ Jack Henry
United States
RemoteFull Time
Responsibilities:leading onboarding, defining standards, collaborating teams
Requirements Summary:Ten years IT experience; five years with observability tools; experience leading enterprise observability strategy; multi-cloud/on-prem deployments; automation tooling (Python/Java).
Technical Tools Mentioned:Dynatrace, OneAgent, Splunk, Python, Java
Save
Mark Applied
Hide Job
Report & Hide
Job Description
At Jack Henry, we’re more than a technology company, we’re a force for good in financial services. We’re redefining how community banks and credit unions connect with the people they serve. Our mission is rooted in people inspired innovation, empowering financial institutions to deliver seamless, secure, and human centered experiences. We deliver cutting-edge solutions that are paving the way for the next generation of digital banking and payments, but our true impact begins with our associates.  If you're ready to help transform an industry and grow with a company that values purpose, collaboration, and excellence then we’d love to meet you. 
This position may be worked remotely within the United States, with the exception of California. 
This position is ineligible for immigration sponsorship and support. Please do not apply if at any time you need immigration support now or in the future (i.e., H-1B, PERM). All positions, regardless of location, may require an onsite interview or in-person onboarding requirement to verify your identity.
What you’ll be responsible for:
Serve as a subject matter expert on observability platforms (Dynatrace OneAgent, Splunk, synthetic and real-user monitoring), including evaluation/selection, integration, rollout, and ongoing optimization.
Partner with product, engineering, operations, and security teams to gather requirements and translate business needs into secure, scalable technical specifications and standards.
Provides technical advice to other departments within the company. Provides escalated technical assistance to developers. Guides others in the implementation of enhancements and fixes by providing coding knowledge. 

Act as escalation point for complex defects and production incidents; perform deep-dive analysis by reverse-engineering code paths and transaction flows to identify root cause and drive remediation.
Define repeatable patterns, templates, and onboarding standards for instrumentation, data collection, naming/tagging, and alert thresholds to improve consistency and reduce time-to-value.
Collaborate with application teams to instrument services and validate telemetry completeness across environments.
Maintains an awareness and understanding of competing products and provides ideas for innovation and improvement in order to maintain a competitive advantage in the marketplace. 

Lead cross-functional training and onboarding; create documentation and guides, mentor engineers, and drive adoption of observability best practices across teams.
Performs the most complex product technical design and prototyping, software development, bug verification and resolution. 
Performs system analysis and programming activities which require extensive research and analysis. 
Develops and publishes application integration frameworks, patterns and practices to reduce cost and complexity. 
Develops key technology strategy artifacts such as architecture diagrams, white papers and proof of concepts. 
Completes project level architecture reviews and vendor selection. 
Identifies and evaluates new technologies and development environments. 
Ensures analysis, architecture, design, code, test, deploy and support practices include consideration for various customer segments and deployment architectures 
Defines or refines standards for the design and development of software. Collaborates with developers, QA, operations and management to provide technical direction in requirements analysis, design, development, testing, and deployment. 
Creates system and development documentation. 
Mentors team and provides guidance to achieve technical consistency and continuous improvement 
May perform other job duties as assigned. 

What you’ll need to have:
Minimum of 10 years’ experience in information technology.

Minimum of 5 years’ experience working with observability tools for enterprise applications.
Experience leading observability strategy and execution for enterprise-scale platforms, ensuring end-to-end coverage across infrastructure, logs, and application performance monitoring (APM).
Experience delivering observability at scale across numerous hosts, applications, and services in multi-cloud and on-premise environments.
Experience designing and building automation and enablement tooling (Python/Java) for onboarding, deployments, configuration management, data export, and analysis to reduce engineering overhead and operational risk.
Experience developing actionable dashboards, alerts, and reporting in observability tools to support operations, engineering, capacity planning, and executive visibility.
Experience supporting modern runtime environments on premise AIX servers and cloud solutions.
If you got this far, we hope you're feeling excited about this opportunity. Even if you don't feel you meet every single requirement on this posting, we still encourage you to apply. We’re looking for passionate, driven individuals who align with our mission and can bring unique perspectives to our team.
Why Jack Henry?
At Jack Henry, we live by the motto: “Do the right thing, do whatever it takes, and have fun.” It’s more than a tagline, it’s the foundation of our culture. We recognize that our associates are the key to our success, and we’re deeply committed to their wellbeing. That’s why we offer designed to support your physical, mental, and financial health so you can thrive both personally and professionally.
We’re also leading the way in technology modernization, helping financial institutions evolve with speed, security, and flexibility. Our strategy focuses on delivering secure data access, mitigating fraud, and enabling seamless integration.   Empowering our teams to build innovative solutions that meet the evolving needs of accountholders.
Culture of Commitment
Ask our associates why they love Jack Henry, and many will tell you it is because our culture is exceptional. We do great things together. Our culture empowers us to rise to challenges, seek new opportunities, and support one another through change. It’s this shared commitment that drives our success. We’re proud to foster an environment where inclusion, sustainability, and community impact are more than values, they’re how we operate.  Visit our site to learn more about our culture and commitment to our people, customers, community, environment, and shareholders.
Equal Employment Opportunity
At Jack Henry, we know we are better together. We value, respect, and protect the uniqueness each of us brings. Innovation flourishes by including all voices and makes our business - and our society - stronger. Jack Henry is an equal opportunity employer and we are committed to providing equal opportunity in all of our employment practices, including selection, hiring, performance management, promotion, transfer, compensation, benefits, education, training, social, and recreational activities to all persons regardless of race, religious creed, color, national origin, ancestry, physical disability, mental disability, genetic information, pregnancy, marital status, sex, gender, gender identity, gender expression, age, sexual orientation, and military and veteran status, or any other protected status protected by local, state or federal law.
No one will be subject to, and Jack Henry prohibits, any form of discipline, reprisal, intimidation, or retaliation for good faith reports or complaints of discrimination of any kind, pursuing any discrimination claim, or cooperating in related investigations.
Requests for full corporate job descriptions may be requested through the interview process at any time.