Senior Software Engineer, DevProd (Infrastructure Observability)

RemoteSeniorPosted Aug 20, 2026

GoKubernetesClickHousePrometheusGrafanaLokiThanosTemporal+10 more

About this role

Lead observability infrastructure at Temporal, building scalable distributed systems for internal and customer-facing monitoring. Work with ClickHouse, Prometheus, Grafana, Kubernetes, and Temporal's own platform to drive developer productivity and platform reliability.

Must have

Expert in Go or similar high-level programming language

Expert-level Kubernetes skills in production environments

Expert-level SQL query development skills

Experience with large scale distributed observability systems

Experience with high throughput data streaming and processing pipelines

Hands-on experience with AWS or GCP

Deep understanding of computer architecture, operating systems, and networking

Experience with monitoring, instrumenting, and configuring infrastructure

Ability to participate in on-call rotation

Technologies

SQLAWSGitDockerRESTLinuxMicroservicesGCPGrafanaPrometheusKubernetesGoClickHouseCI/CDDistributed systemsTemporalThanosLoki

Responsibilities

Lead end-to-end software development lifecycle for observability infrastructure

Design and build multi-component distributed systems operating at scale

Formulate feature designs and drive consensus with stakeholders

Document design choices and operational knowledge for deployment

Provide test and production readiness coverage for owned features

Investigate issues with methodical approach to identify root cause

Understand performance and reliability implications of design options at scale

Participate in design reviews and contribute to other feature designs

Share design principles for building reliable systems at scale

Benefits

EquityHealth insuranceDental insuranceVision insuranceWellness platform with incentivesHome office allowanceUnlimited PTOProfessional developmentLife insuranceDisability insuranceLifestyle stipend401k matchLearning and career development

Amenities

Fully remote position based in CanadaHome office setup stipendInternet stipendWFH meals stipendAccess to Calm app for mental wellnessProfessional memberships support