hirly

Kog

GPU Engineer

Paris, France

hirly Pro

Get in front of the people hiring at Kog

  • Reach the hiring manager at Kog on LinkedIn, from your own account
  • hirly applies to this job for you, with unlimited applications
  • A resume and cover letter written for this job, unlimited
  • The hiring manager and recruiter at Kog, with contact details
Get Pro for this job →

$49 a month · ₹1,999 for 30 days in India · cancel any time

See how you match this job — and similar ones. Free.

Upload your resume and hirly scores it against this role at Kog first, then against similar open jobs, and shows where you fit and why.

PDF or DOCX, up to 12MB. No sign-up to see your matches.

Get past the screening software and onto a recruiter's desk

hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.

  • Keywords matched to this posting
  • Fit score before you apply
  • Cover letter included

Matched against 2.8M live jobs from 220,000+ employers in 200+ countries.

Tailor my resume for this job →

Apply from your AI assistant

Connect hirly to Claude or ChatGPT and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending.

Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.

hirly's read of this role

Seniority
Mid level
Country
FR
Work mode
On-site / unstated
First seen by hirly
11 Nov 2026

Derived automatically from the posting. Upload your resume above to see how the role scores against it.

the posting

About Kog

At Kog, we're building real-time LLM inference for AI agents.

Coding agents execute sequences of tasks where each step depends on the model's previous response. The faster the model generates tokens, the faster these agents can reason, code, and act.

Our approach is to co-design model architecture, the inference engine, and low-level GPU kernels to minimize generation latency on standard NVIDIA and AMD datacenter GPUs.

We've developed several technologies to make this possible:

Monokernel: a persistent GPU program that keeps the entire token generation loop on the GPU, avoiding CPU handoffs.

KCCL: our custom inter-GPU communication layer, designed to minimize latency.

Delayed Tensor Parallelism (DTP): a model architecture that overlaps communication with computation and weight loading.

Laneformer 2B: our code-generation model demonstrating this co-design approach.

Our engineers work directly with GPU hardware, using CUDA, PTX, HIP, and CDNA ISA to optimize execution.

Implementing and optimizing a new AI model for a specific GPU architecture can take months of manual engineering. Meanwhile, new models are constantly being released.

Our goal is to use AI agents to implement and optimize the models we choose on the GPUs we choose, in a fraction of the time required today.

These agents will build on the GPU optimizations and hardware insights our team has developed. They'll explore optimization strategies, generate and modify kernels, verify correctness, benchmark performance on real hardware, and iterate based on the results.

We want to make model porting and GPU optimization much faster and repeatable, allowing Kog to keep pace with the latest AI models rather than spending months adapting each one manually.

This is a major engineering direction we're now developing, and you'll help shape it.

Learn more at https://blog.kog.ai .

What you'll work on

You'll join our GPU engineering team to tackle challenging performance problems and help build the internal agents that will accelerate this work.

Develop and optimize GPU kernels using C++, CUDA, HIP, and low-level instructions.

Investigate GPU architecture, memory access, synchronization, and execution bottlenecks.

Profile and benchmark workloads to identify and validate performance improvements.

Optimize inference operations and communication across multiple GPUs.

Implement and optimize new AI models on NVIDIA and AMD GPUs.

Help build AI agents for GPU engineering , enabling automated code optimization, correctness testing, benchmarking, and iterative improvements.

Take ownership of technical decisions and their implementation.

What we're looking for

We're looking for an experienced GPU Engineer who can contribute quickly and independently to complex performance problems.

Strong hands-on experience developing and optimizing GPU kernels, ideally using CUDA C++ or HIP/ROCm.

Deep understanding of GPU architecture, memory hierarchy, parallel execution, and performance bottlenecks.

Strong C++ skills and experience profiling and benchmarking GPU workloads.

Proven ownership of challenging technical projects, from implementation to measured results.

Interest in developing AI agents and tools to accelerate GPU engineering.

Experience with PTX, CDNA ISA, multi-GPU systems, low-latency inference, or GPU performance portability is particularly valuable.

A PhD in HPC, computer science, or a related field is a plus when backed by substantial engineering work. Previous experience building AI agents is not required.

Location and availability

Candidates must already be based in Paris or elsewhere in Île-de-France.

We are not considering relocation from other regions or countries for this position.

We're looking for someone who can join the team quickly.

Find Jobs in France on Arbeitnow

Original posting on Kog's site ↗

Listed on hirly, a job board. hirly is not the employer: Kog is hiring for this role.

Browse similar roles

Want this one?

Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.

Tailor my resume for this job