Senior Software Engineer (Agentic Search) - Web Access Engineer

About Tavily

We're building the infrastructure layer for agentic web interaction at scale. Our API is designed from the ground up to power Retrieval-Augmented Generation (RAG) and real-time reasoning in AI systems. By connecting LLMs to high-quality, trustworthy web content, we help developers build agents that are not only intelligent — but also informed.

We work with some of the most innovative teams in AI — from small startups shaping the ecosystem to the largest enterprises deploying AI at scale. Whether it's powering sales assistants, research copilots, or internal knowledge tools, we're the missing link between LLMs and the real world.

The Role

We are looking for a Senior Software Engineer to build the web access infrastructure behind a novel search engine designed for agentic AI.

In this role, you will investigate how modern websites communicate with browsers and translate that understanding into production systems operating at internet scale. You will build browser infrastructure and tooling that enables reliable, efficient access to web content across a rapidly changing web.

Your responsibilities will include:

Research and analyse how modern websites communicate with browsers across the complete request lifecycle

Investigate browser fingerprinting, client verification mechanisms, and modern web technologies to enable reliable web access

Build tooling for browser instrumentation, debugging, observability, and large-scale experimentation

Translate technical research into production systems operating at internet scale

Requirements

You have 5+ years of experience as a software engineer working on production backend or infrastructure systems, and are an expert in several of the following areas:

Browser Technologies

Chromium architecture and browser internals

Browser lifecycle and navigation

Chrome DevTools Protocol (CDP)

Playwright, Puppeteer, Selenium, or similar browser automation frameworks

Browser instrumentation and debugging

Web Platform

HTTP/1.1, HTTP/2, HTTP/3 — TLS, DNS, and browser networking

Cookies, browser storage, caching, redirects, and session management

JavaScript execution and modern client-side rendering

Resource loading, page lifecycle, and browser networking

Browser fingerprinting concepts and browser characteristics

Nice to Have

Experience working on browser engines or browser infrastructure

Experience reverse engineering browser or web application behaviour

Experience building internet-scale distributed systems

Go, C++, Rust, or Python

Kubernetes and cloud infrastructure

We conduct coding interviews as part of the process.

Why Tavily ?

Full ownership — small team, you own the entire infrastructure, not a slice of it

Real scaling challenges — bursty scraping workloads, cache invalidation, multi-region, millions of daily requests

AI-native company — your infra directly powers AI agents used by leading companies in the space.

Find Jobs in United Kingdom on Arbeitnow