BOT VFX (INDIA) PRIVATE LIMITED
Data Engineer (ETL Specialist)
Chennai, India
hirly Pro
Get in front of the people hiring at BOT VFX (INDIA) PRIVATE LIMITED
- Reach the hiring manager at BOT VFX (INDIA) PRIVATE LIMITED on LinkedIn, from your own account
- hirly applies to this job for you, with unlimited applications
- A resume and cover letter written for this job, unlimited
- The hiring manager and recruiter at BOT VFX (INDIA) PRIVATE LIMITED, with contact details
$49 a month · ₹1,999 for 30 days in India · cancel any time
Get past the screening software and onto a recruiter's desk
hirly rewrites your resume for this job — matching the keywords and skills in the posting, moving your most relevant experience to the top, and writing a cover letter to fit. About 30 seconds.
- Keywords matched to this posting
- Fit score before you apply
- Cover letter included
Matched against 2.8M live jobs from 220,000+ employers in 200+ countries.
Tailor my resume for this job →Apply from your AI assistant
Connect hirly to Claude or ChatGPT and ask it to apply to this job. hirly tailors your resume, fills the employer’s form and asks before sending.
Some employer sites stop an application at a CAPTCHA or sign-in and hand it back with a link. Applying needs a paid plan. Works with any assistant that supports MCP.
hirly's read of this role
- Role family
- Data & ML
- Seniority
- Mid level
- Country
- IN
- Work mode
- On-site / unstated
- First seen by hirly
- 23 Sept 2026
Derived automatically from the posting. Upload your resume above to see how the role scores against it.
the posting
POSITION SUMMARY
BOT VFX, a visual effects services company with global clients, is looking for a Data Engineer (ETL Specialist) as a full-time contract role. This is strictly an on location role in Chennai, India.
In this role, you will be responsible for transforming petabytes of unstructured, legacy VFX data (including heavy video plates, multi-layered OpenEXR sequences, and proprietary DCC workfiles) into highly structured, sanitized, and compressed datasets.
The ideal candidate brings deep expertise in large-scale data engineering and ETL pipeline architecture alongside an understanding of physical infrastructure limits. You will bridge legacy storage/tape systems, VFX pipeline scripts, and Creative Innovation needs. Reporting to the CIO, the role works closely with IT/IO and Creative Innovation teams.
POSITION RESPONSIBILITY
- Lead the architecture, implementation, and automation of scalable ETL/ELT pipelines capable of moving and processing tens of terabytes of unstructured media data daily.
- Implement automated "Purge & Keep" business rulesets to systematically clean directory trees, wiping intermediate render caches, temporary scratch files, and duplicates while preserving core visual assets.
- Build high-throughput processing pipelines to transcode, compress, and restructure massive image sequences (linear EXR, DPX) and video formats into AI-friendly data structures (e.g., WebDataset shards).
- Integrate and normalize lightweight metadata scrapings (camera telemetry, tracking curves, geometry tags) extracted from VFX workfiles (Silhouette, Nuke) and bind them deterministically to their corresponding visual assets.
- Manage high-velocity data movement across tiered storage layers (Hot NVMe/SSD staging, Warm Object Storage, and Deep Cloud/Tape Archives), ensuring the pipeline never bottlenecks network bandwidth or staging limits.
- Establish robust data quality assurance (QA) validation loops within the pipeline to catch corrupted frames, missing frame ranges, and accidental inclusion of restricted IP or sensitive assets.
REQUIRED SKILLS
- At least 3–5 years of experience as a Data Engineer building large-scale, automated ETL/ELT pipelines, with a proven track record of handling unstructured data, heavy media assets, or computer vision datasets.
- Strong technical grounding in pipeline development using Python (and bash/shell scripting) along with heavy data processing frameworks (e.g., Apache Spark, Ray, Dask).
- Hands-on experience with modern data architectures, containerization (Docker, Kubernetes), and cloud/on-prem block/object storage systems.
- Solid problem-solving capabilities focused on maximizing throughput under strict hardware constraints (balancing egress speeds with staging capacities).
- Exceptional communication skills with the ability to collaborate effectively across multidisciplinary teams, including VFX technical directors, systems engineers, and AI research teams.
PREFERRED SKILLS
Basic familiarity with VFX file structures, directory archetypes, image sequence formatting, or open-source media utilities (FFmpeg, OpenEXR toolset).
Listed on hirly, a job board. hirly is not the employer: BOT VFX (INDIA) PRIVATE LIMITED is hiring for this role.
Similar jobs
- Data Engineer - AWS, Python, DBT, Snowflake - 6-10 Years - PuneTsys · PUNE, , INDIAFirst seen 6d ago
- FS Data Engineer - Experience AssociatePwc · Kolkata (AC) - Eagle Ridge at Embassy Golf Links Business Park (KSDC)First seen 6d ago
- Data EngineerRbs · 3 LocationsFirst seen 6d ago
- Data Engineer (Databricks)Pg · HYDERABAD OFFICE INDIA PSC PGHFirst seen 6d ago
- Associate Data EngineerMdlz · Mumbai, IndiaFirst seen 6d ago
Browse similar roles
Want this one?
Upload your resume and hirly rewrites it for this job and writes the cover letter — in about thirty seconds, before you sign up.
Tailor my resume for this job