AI Multimedia Generation Product Evaluator

SGS_JOB_2243

Engineering
Remote
Multimedia Data
Image and video data
Python
SQL
JSON
Model Evaluation

Contract - 3 Months

Location (mandatory): USA Remote The Multimedia Generation team focuses on fine tuning and productionizing media foundational models in the GenAI space. The team consists of AI applied scientists of five members, each responsible for different products like videos, image editing, and developing evaluation metrics. We are seeking a highly motivated and detail-oriented individual to join our team as an AI Multimedia Generation Product Evaluator. In this role, you will support the evaluation of various AI multimedia generation products for images and videos. You will work closely with model development teams to conduct offline evaluations, connect offline metrics with online user behavior, and ensure offline metrics are predictive of online user engagement. 2+ years of basic Python knowledge, specifically for managing data and working with image and video data

Job Responsibilities:

  • Set up Halo tasks and run model inference
  • Enqueue new queues to Halo
  • Audit annotations from vendors
  • Build necessary tooling for managing evaluation datasets
  • Collaborate with model development teams to conduct offline evaluations and automate pipelines
  • Facilitate, set up queues, manage image radio data, and audit results
  • Ensure consistency and accuracy in measurements, involving programming and auditing tasks
  • Collaborate with model development teams to conduct offline evaluations, connect offline metrics with online user behavior, and ensure offline metrics are predictive of online user engagement. Main tasks include facilitating, setting up queues, managing image radio data, and auditing results.

Skills:

  • 1-2 years of basic Python knowledge, particularly in working with image/video data and JSON
  • Experience in SQL and handling large data tables
  • Experience in the image and video domain
  • Ability to adapt to new code
  • General know-how
  • Flexibility in working hours
  • Nice-to-Have Skills:
  • Experience as a GenAI user in the image and video domain
  • Basic shell script knowledge
  • 1-2 years of basic Python knowledge, particularly in working with image/video data and JSON
  • Experience in SQL and handling large data tables
  • Experience in the image and video domain
  • Experience as a GenAI user in the image and video domain
  • Basic shell script knowledge

Education/Experience:

  • Bachelor’s preferred, not required

Related Jobs

Optical Engineer III

Engineering
 Washington
6 Months

Location (mandatory): Redmond WA We are looking for an Optical Engineer with passion for new technology development to join our team, whose mission is to deliver beyond state-of-the-art Waveguide Technologies for consumer near to eye displays at our research and development facilities. We are looking for a candidate with experience in novel optical device design and metrology either as part of their PhD or industry experience.

diffractive optics
Optical Alignment
AR/VR
PhD Degree

Firmware Software Engineer IV

Engineering
Remote
6 Months

This role is focused on building a cutting-edge interactive user-facing demo that bridges science and AI through advanced front-end engineering and visualization technology. This role will integrate AI model output data to create interactive AI model visualizations. This role will develop the front-end and integrate it with backend /model infrastructure and data. Experience with AI model visualization tools, with software design and development, and experience with Python will be necessary for the role.

WebGL
Python

Design Verification Engineer – Static & Dynamic Power-Aware Verification

Engineering
Remote
12 Months

Power and performance modeling or DV (C, system C, system Verilog, or MATLAB). Strong DV background (test plan development, test writing, UVM). Experience with low power verification (UPF). Experience with both static (i.e., VC LP) and dynamic (i.e., VCS NLP) power-aware verification flows.

Design Verification
System Verilog
UPF
Low Power Verification
VC LP
VCS NLP
testbench

Senior Embedded Software Engineer - AOSP

Engineering
 California
$100-$110/Hr. on W2
12 Months

Location : Sunnyvale, CA or Redmond, WA. We are looking for OS developers with strong design and build skills, experience in multiple levels of the OS stack from drivers to frameworks and experience building embedded devices. A successful candidate in this role is self-driven, creative and doesn’t mind delving into different areas of the stack. This person will take initiative and should be willing to execute consistently in an agile, fast-paced environment.

C++
Java
Linux
Kernel
Embedded systems
Android
AOSP
SDK
NDK
Consumer Electronics

Administrative Assistant

Engineering
 Massachusetts
3 Years

Location (mandatory): Lexington, MA Responsibilities will involve the prioritization, coordination, implementation, and follow through of all administrative workflow within the group, including shopping, timesheet entry, travel, work orders, visit requests, etc Interim is sufficient to start; potential for upgrade to Top Secret later.

Calendar Management
Documentation
Record Keeping
Handling Sensitive Information.

Silicon Performance Modeling Engineer IV

Engineering
Remote
12 Months

• Create bridge modules in System C to translate between different flavors of TLM • Integrate System C components that support different flavors of TLM into Synopsys Platform Architect • Ensure support for multi-beat protocols like AXI when building translation bridges

Python
SimPy
NumPy
Performance Modeling
Power Management

Data Engineer

Engineering
Remote
11 Months

• Data Engineer with 3-5 years of experience in ads data platform engineering, SQL/Presto query optimization, data pipeline development, revenue metrics analysis, and data quality management.

Python
SQL
Presto
Tableau
Ads Measurement
Revenue Analytics
Privacy

Senior ML Research Engineer

Engineering
Remote
12 Months

Responsibilities include developing deep learning libraries that support large-scale distributed training, open sourcing high quality code and reproducible results for the community, and bringing the latest research to products for connecting billions of users. The chosen candidate will work with a diverse and highly interdisciplinary team of scientists, engineers, and cross-functional partners, and will have access to cutting edge technology, resources, and research facilities.

Pytorch
Python
FSDP
DDP
Distributed Training

NPI Program Manager

Engineering
Remote
12 Months

• Collaborate on the Tracking/Closure of material shortages based on CTB report and urgent requests from ODM. Proactively identify supply chain risks, create mitigation strategies, and drive to closure. Work with NPI core team and ISCE to drive program supply chain strategy • Manage Purchase Order process to ODM for Rack Hardware, L10, loose demand & NRE. Drive Quote from ODM, track PO status and hardware landing confirmation to close PO. Work with commodity managers, finance, logistics, and procurement operations to understand and unblock blockers and mitigate

NPI
CTB
ODM
Supply Chain
Materials Management
logo

At SGS Consulting, we go beyond resume-job matches, creating meaningful connections and pathways for individuals to thrive in defining careers.


2025. All right reserved.
logologologologo