Ruby Labs
AI Engineer
Ukraine · Moldova · Albania · Kazakhstan · Montenegro · European Union · Serbia · Georgia
hirly Pro
Get in front of the people hiring at Ruby Labs
- Reach the hiring manager at Ruby Labs on LinkedIn, from your own account
- hirly applies to this job for you, with unlimited applications
- A resume and cover letter written for this job, unlimited
- The hiring manager and recruiter at Ruby Labs, with contact details
$49 a month · ₹1,999 for 30 days in India · cancel any time
Get past the screening software and onto a recruiter's desk
hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.
- Keywords matched to this posting
- Fit score before you apply
- Cover letter included
Matched against 2.9M live jobs from 220,000+ employers in 200+ countries.
Tailor my resume for this job →Apply from your AI assistant
Connect hirly to Claude or ChatGPT and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending.
Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.
hirly's read of this role
- Seniority
- Mid level
- Countries
- UA, MD, AL, KZ, ME, RS, US
- Work mode
- Remote-friendly
- First seen by hirly
- 17 Nov 2026
Derived automatically from the posting. Upload your resume above to see how the role scores against it.
the posting
About us
Ruby Labs is a leading tech company that creates and operates innovative consumer products. We offer a diverse range of opportunities across the health, education, and entertainment industries. Our innovative teams are driving the future of consumer-led products, and we're always looking for passionate individuals to join us. Learn more about our story at: https://rubylabs.com/about-us/
About the role
At Ruby Labs we are looking for an AI Engineer (Strong Middle / Senior level) to own and drive the quality, reliability and evolution of our AI systems in production.
This is a high-ownership role. You will be responsible for end-to-end delivery of AI features, production stability of AI systems, and data-driven experimentation using tools like Langfuse and Cloudflare AI gateway for model routing. Increasingly, this includes agentic, tool-using AI systems: defining clean tool contracts (including MCP-based tools) and orchestrating how AI interacts with internal services, search and background pipelines.
The stack is TypeScript end to end: Node.js and Hono services on Cloudflare Workers with Durable Objects and Containers, PostgreSQL, OpenSearch. Models from several providers run behind an AI gateway, with prompts, traces and evaluations in Langfuse.
Key Responsibilities
AI Systems Ownership & Feature Delivery
Take ownership of major AI features and LLM workflows and deliver them to production within agreed timelines.
Own AI output quality, structure and predictability across user-facing AI interactions, with consistent structured output across different LLMs for the same request type.
Integrate and orchestrate multiple LLM providers through an AI gateway, managing model selection, fallback strategies and cost optimisation.
Design and orchestrate tool-using and agentic AI workflows: clean tool contracts (including MCP-based tools), function-calling interfaces and reliable AI-to-system integrations.
Build and maintain multi-step LLM workflows and RAG pipelines (indexing, embeddings, retrieval, re-ranking) for reasoning, context reuse and search.
Prompt Engineering, Evaluation & Experimentation
Design and manage production prompt systems with dynamic prompting, context injection, and conditional logic.
Own prompt management, the release of LLM experiments and Langfuse-based evaluation pipelines: test datasets, LLM-as-a-judge, output scoring.
Run A/B tests across models and prompts, analyse the results and present the data-driven impact of AI features and experiments.
Deep-debug LLM chains using Langfuse traces: identify bottlenecks, optimise for cost, latency and context-window usage, and root-cause hallucinations and logic errors.
Code Quality & Production Reliability
Write clean, scalable and maintainable TypeScript across the Node.js / Cloudflare Workers stack.
Build reliable backend logic for AI systems: request and output validation, error handling, fallback flows for malformed or low-quality model responses, and reliable tool execution.
Ensure high code quality through tests (including validation and fallback paths for AI output), code reviews and clear engineering standards.
Monitor AI system metrics, quality signals, latency and release health, and resolve production issues with a documented root cause.
Document prompt designs, model and routing choices, evaluation results and architectural decisions, so others can pick up the work.
Qualifications
4+ years of backend/fullstack software engineering experience, with production-grade TypeScript/Node.js.
1+ year of AI/LLM systems in production with real users, not only side projects or experiments.
Daily use of AI-centred development tools (Claude Code, Cursor or similar).
Deep hands-on experience with LLM APIs (OpenAI, Anthropic, Google Gemini or similar) in production: structured output, function calling, streaming, token and cost control.
Experience with agentic AI, multi-step orchestration, tool-based workflows (function calling / tool execution) or RAG pipelines (indexing, retrieval, re-ranking).
Experience with LLM observability and evaluation tools (Langfuse, LangSmith or similar).
Experience with AI gateways and model routing (OpenRouter, Cloudflare AI Gateway or equivalent).
Solid understanding of relational databases (PostgreSQL) and caching (Redis, KV or similar).
Exceptional ownership and personal responsibility for engineering quality and delivery.
Nice to have
Evaluation frameworks (LLM-as-a-judge, RAGAS) and building test datasets.
MCP (Model Context Protocol): building MCP servers/clients or designing tool contracts for AI agents.
Edge/serverless runtimes (Cloudflare Workers) and their services: KV, Durable Objects, Queues, R2, Containers.
Search engines and vector search (OpenSearch, Elasticsearch, pgvector), embeddings.
Background workflow engines (Hatchet, Temporal, Inngest) for high-volume LLM pipelines.
Browser automation and browser agents (Playwright, CDP, browser-use).
Practical fine-tuning for domain-specific tasks or strict JSON/schema compliance.
Working Python for data science, evaluation scripts, or AI tooling.
Location
Ruby Labs operates within the CET (Central European Time) zone. Applicants from any country are welcome to apply for the position as long as they are located within approximately ± 4 hours of CET. This ensures optimal collaboration and communication during working hours.
Benefits
Discover the perks of being part of our vibrant team! We offer:
Remote Work Environment: Embrace the freedom to work from anywhere, anytime, promoting a healthy work-life balance.
Unlimited PTO: Enjoy unlimited paid time off to recharge and prioritize your well-being, without counting days.
Paid National Holidays: Celebrate and relax on national holidays with paid time off to unwind and recharge.
Company-provided MacBook: Experience seamless productivity with top-notch Apple MacBooks provided to all employees who need them.
Flexible Independent Contractor Agreement: Unlock the benefits of flexibility, autonomy, and entrepreneurial opportunities. Benefit from tax advantages, networking opportunities, reduced employment obligations, and the freedom to work from anywhere. Read more about it here: https://docs.google.com/document/d/1nkrN76JlZkbKj9WSOhlT1_mni_CZeDkHdwfIjPXVwvk/preview?tab=t.0#heading=h.ndsdl4wapxtt
Be part of our fast-growing team and seize this excellent opportunity for personal and professional growth!
Interview Process
After submitting your application, we conduct a thorough review which typically takes 3 to 5 days, but may occasionally take longer due to the volume of applications received. If we see a potential fit, we proceed with the following steps:
Recruiter Screening (40 minutes)
Technical Interview (90 minutes)
Final Interview (60 minutes)
Life at Ruby Labs
At Ruby Labs, we move fast, aim high, and expect the same from our team. We’re not here to play small—we’re here to build, grow, and win. That means we look for people who are ambitious, driven, and ready to give their best every single day.
This is a place for individuals who thrive under pressure, embrace challenges, and see opportunity in every obstacle. If you’re hungry to achieve, motivated by impact, and want to grow at the speed of your own ambition, Ruby Labs offers the platform to make it happen.
Here, effort is matched with reward. We recognize those who go all in and deliver results, and we create space for people who want more—more responsibility, more growth, and more success.
#LI-Remote
Listed on hirly, a job board. hirly is not the employer: Ruby Labs is hiring for this role.
Similar jobs
- AI EngineerCreatio · UkraineFirst seen 50d agoremote
- Applied AI EngineerEsrtreit · New York, New York, United StatesFirst seen today
- Forward Deployed AI Engineer Edison Scientific · San FranciscoFirst seen today
- Founding AI Engineer, AgentsClera · San FranciscoFirst seen today
- Founding Applied AI EngineerClera · San FranciscoFirst seen today
Browse similar roles
Want this one?
Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.
Tailor my resume for this job