AI Multimedia Generation Product Evaluator

SGS_JOB_2243

Engineering
Remote
Multimedia Data
Image and video data
Python
SQL
JSON
Model Evaluation

Contract - 3 Months

Location (mandatory): USA Remote The Multimedia Generation team focuses on fine tuning and productionizing media foundational models in the GenAI space. The team consists of AI applied scientists of five members, each responsible for different products like videos, image editing, and developing evaluation metrics. We are seeking a highly motivated and detail-oriented individual to join our team as an AI Multimedia Generation Product Evaluator. In this role, you will support the evaluation of various AI multimedia generation products for images and videos. You will work closely with model development teams to conduct offline evaluations, connect offline metrics with online user behavior, and ensure offline metrics are predictive of online user engagement. 2+ years of basic Python knowledge, specifically for managing data and working with image and video data

Job Responsibilities:

  • Set up Halo tasks and run model inference
  • Enqueue new queues to Halo
  • Audit annotations from vendors
  • Build necessary tooling for managing evaluation datasets
  • Collaborate with model development teams to conduct offline evaluations and automate pipelines
  • Facilitate, set up queues, manage image radio data, and audit results
  • Ensure consistency and accuracy in measurements, involving programming and auditing tasks
  • Collaborate with model development teams to conduct offline evaluations, connect offline metrics with online user behavior, and ensure offline metrics are predictive of online user engagement. Main tasks include facilitating, setting up queues, managing image radio data, and auditing results.

Skills:

  • 1-2 years of basic Python knowledge, particularly in working with image/video data and JSON
  • Experience in SQL and handling large data tables
  • Experience in the image and video domain
  • Ability to adapt to new code
  • General know-how
  • Flexibility in working hours
  • Nice-to-Have Skills:
  • Experience as a GenAI user in the image and video domain
  • Basic shell script knowledge
  • 1-2 years of basic Python knowledge, particularly in working with image/video data and JSON
  • Experience in SQL and handling large data tables
  • Experience in the image and video domain
  • Experience as a GenAI user in the image and video domain
  • Basic shell script knowledge

Education/Experience:

  • Bachelor’s preferred, not required

Related Jobs

Web Developer III

Engineering
Remote
06 Months

Location (mandatory): Remote (EST Only) We're seeking experience a software engineering with a background in building web apps with 3+ years of experience in Python to help us build the next generation of computer-use agents. Your role will be to grow our app simulation pipeline for training and evaluating computer-use agents. You'll be contributing to the frontiers of AI agent research. Interviews: Technical (discuss previous projects) and team fit (interest, previous experience collaborations. Technical/coding interview in Python.

Web Development
Artificial Intelligence
AI Agents
Python
Portfolio
App Simulation
AI Applications Development.

Web Developer III

Engineering
Remote
06 Months

Location (mandatory): Remote (EST Only) We're seeking experience a software engineering with a background in building web apps with 3+ years of experience in Python to help us build the next generation of computer-use agents. Your role will be to grow our app simulation pipeline for training and evaluating computer-use agents. You'll be contributing to the frontiers of AI agent research. Interviews: Technical (discuss previous projects) and team fit (interest, previous experience collaborations. Technical/coding interview in Python.

Web Development
Artificial Intelligence
AI Agents
Python
Portfolio
App Simulation
AI Applications Development.

Algorithm Developer

Engineering
Remote
60-65/Hr. on W2
11 Months

Job Description The role is an AI engineer in the AI research team to execute its engineering tasks. The team aims at driving innovation towards superintelligence from the perspective of data curation algorithms for perception, better modeling of spatial and temporal knowledge, and more efficient research tools. We work on research in various modalities (e.g., CV, NLP, embodied AI) and build large scale foundation data and models with high quality and diversity. In this role, you will be embedded into the team and other AI research collaborators to convert ideas into implementation and solutions. You will build new algorithms, new functionalities, and new architectures in our research platforms. You will participate in the team publication effort to turn works into broad research outcomes and push the research frontier in superintelligence.

GenAI
LLM
Foundational Models
C++
Python
Rust
Computer Vision
Deep Learning

Computational Linguist -Large Language Models

Engineering
Remote
50-55/Hr. on W2
6 Months

We are looking for a skilled Linguistic Engineer to join our team to build, maintain, and analyze datasets powering LLM powered features. In this role, you will be instrumental in building and assessing the quality of data processed by our LLM production systems. Using new and existing data quality workflows and pipelines, you will collaborate closely with a cross functional team of engineers, research scientists, project managers, and data scientists to build datasets for, report on, and generally guide improvements on our LLM powered features, ensuring their accuracy and reliability in smart glasses applications.

SQL
Python
LLM
Foundational Models
Data Annotation
Linguistics

Product Lifecycle Management Analyst

Engineering
 California
80-95/Hr. on W2
12 Months

Location : Sunnyvale, CA, Summary • As Product Lifecycle Analyst (PLM) at Client, you will take on a critical role in bringing AR/VR to our customers. You will work side-by-side with engineering and business teams that are leading innovation in this exciting new product category. • The PLM Analyst will support a variety of product projects through the entire product lifecycle including concept, prototype, new product introduction, and sustaining PLM activities. Product types include research, consumer intent, accessories, and service offerings. You must be flexible, responsive, and able to manage competing demands.

PLM
Agile
Arena
ECO

Manufacturing Project Manager

Engineering
 Texas
40-45/Hr. on W2
3 Months

Location : El Paso, TX.

Manufacturing
Project Management
Plant Management
Quality Engineering
Continuous Improvement

Project Engineer

Engineering
 Iowa
68-70/Hr. on W2
3 Months

Location : Cedar Rapids, IA

Project Engineering
Manufacturing
Change Orders

Electrical Test Technician

Engineering
 California
29-31/Hr. on W2
12 Months

Location : Costa Mesa, CA.

Power Testing
Electrical Engineering
Lab equipment

Software Test Engineer

Engineering
 Texas
60-68/Hr. on W2
3 Months

Role Summary: • We are seeking a Software Test Engineer experienced in verifying VoIP software applications, specifically those integrated with LMR systems. • The ideal candidate possesses a robust command of Windows and Linux operating systems, virtualization technologies, fundamental networking, and test automation.

Manual or Automation Testing
SDET
AI
Python
Selenium
logo

At SGS Consulting, we go beyond resume-job matches, creating meaningful connections and pathways for individuals to thrive in defining careers.


© 2026 All rights reserved.
logologologologo