Data Engineer

About Karya

• Karya provides AI-enabled earning and learning opportunities to economically underserved communities, and
• high-quality, ethically sourced datasets to research labs and technology companies. Digital workers earn at least 20
• times the local minimum wage. The platform has delivered over 40 million tasks.
• About the role
• This role runs live client projects on the Karya platform. The work is the execution layer above the core product:
• project workflows, data jobs, checks, reports, and delivery.
• You will work with Operations and client teams on questions of progress, quality, pay, and files, and with platform
• engineers when a fix belongs in the product. Worker payouts and client deliverables depend on getting these checks
• right.

• Responsibilities
• •Run and monitor data jobs on remote Linux servers, and recover failed jobs from logs and process state.
• •Configure project workflows, including the handoff from automated processing to human tasks, and track what
• is in progress, held, or ready to deliver.
• •Write PostgreSQL and ClickHouse queries for throughput, completion, quality, pay, and delivery status.
• •Apply completion and quality rules to access, pay, and delivery decisions, after a sample check.
• •Write Python, SQL, or Bash scripts for those checks and decisions, and keep them in the repository.
• •Package datasets to client specifications, move them through cloud object storage, and record what has shipped.
• •Read the TypeScript / Node.js codebase to follow tasks, assignments, payments, and file storage.
• •Reply to Operations and client teams with the finding, the change made, and what is still open.
• •Report repeated manual work to platform engineering, with an example.

• Requirements
• •PostgreSQL, including joins, aggregates, and JSON fields.
• •Scripts in Python, Bash, or TypeScript, checked into git.
• •Ability to read a TypeScript codebase and a relational schema.
• •Linux for running jobs: SSH, logs, long-running processes, and disk.
• •Ability to write technical updates that give non-technical teammates a clear picture of the situation.
• •Queries or scripts already run against real project or production data.

• Good to have
• •Cloud object storage (Google Cloud Storage, S3, or Azure Blob).
• •Experience with collected datasets such as speech, text, or images.
• •ClickHouse, Metabase, or a similar reporting tool.

• Perks
• •Flexible leave, with remote or hybrid work.
• •Health insurance.
• •Direct work on data collection that determines worker earnings and client deliverables.

• Karya is an equal opportunity employer. Applicants are considered without regard to race, religion, gender identity, sexual orientation,
• disability, or any other protected status. For accommodations, contact [email protected].