Linguist III

sgs-job-5843

Engineering
Remote
LLM
Datasets
Linguistics
SQL
Python
Annotation
Computational Linguistics.

Contract - 12 Months

We are looking for a skilled Linguistic Engineer to join our team to build, maintain, and analyze datasets powering LLM powered features. In this role, you will be instrumental in building and assessing the quality of data processed by our LLM production systems. Using new and existing data quality workflows and pipelines, you will collaborate closely with a cross functional team of engineers, research scientists, project managers, and data scientists to build datasets for, report on, and generally guide improvements on our LLM powered features, ensuring their accuracy and reliability in smart glasses applications.

Job Responsibilities:

  • Aggregate cross-functional requests and translate requests into actionable, high quality, datasets via synthetic data collections and on live user traffic.
  • Deliver analytics, statistics, and model performance results on datasets
  • Design and conduct experiments for evaluating rater quality, inter-rater reliability; write summary reports based on findings and speak on those findings in meetings.
  • Develop manual and automated processes for multiple concurrent projects ensuring high-quality labeled data.
  • Create and perfect LLM Quality grading queues and LLM related component quality error attribution grading queues.
  • Build datasets and write guidelines in rapid fashion for new and emergent LLM data rating, creation, and annotation needs.
  • Analyze system metrics such as factuality, brevity, coherence, as well as subcomponent performance, summarize findings, and communicate results.
  • Dataset Building & Curation: Receive requests from engineers and research scientists, then design and execute synthetic data collections or sample from
  • existing data to produce clean, labeled datasets for LLM training and evaluation.
  • Annotation Queue Management: Stand up and maintain grading queues — define rubrics, write annotation guidelines, onboard raters, and iterate on queue design
  • to keep pace with rapidly evolving LLM features.
  • Quality Auditing & Error Attribution: Review annotated data daily, flag inconsistencies, run inter-rater reliability checks, and trace quality issues back to specific LLM subcomponents (e.g., factuality, coherence, brevity).
  • Data Analysis & Reporting: Use AI to write SQL queries and Python scripts to pull metrics, compute agreement scores, and generate dashboards; summarize findings in
  • weekly reports shared with cross-functional partners.
  • Experiment Design: Plan and run controlled experiments to test rater calibration, guideline clarity, or model performance changes — then present results
  • and recommendations in team meetings.
  • Guideline Authoring: Draft, test, and refine annotation guidelines for new LLM capabilities on tight timelines, ensuring raters can consistently apply them at scale.
  • Cross-Functional Collaboration: Attend syncs with engineering, research, and PM stakeholders to align on data priorities, surface quality insights, and inform roadmap decisions for smart glasses LLM features.

Skills:

  • Basic Python, basic SQL with strong desire to grow required for this position. Intermediate level preferred.
  • Basic knowledge of linguistics (some of Phonetics, Syntax, Semantics, Dialectology) required.
  • Ability to analyze numerical rating results and draw conclusions based on data.
  • Basic stats / math for data analysis.
  • Written and oral communication skills necessary for communicating on project milestones and for reporting findings .
  • Data Annotation
  • SQL Python
  • Linguistic Background
  • Computational Linguistics (master’s preferred)
  • Statistics & Data Science
  • 4-6 year of experience

Education/Experience:

  • Bachelor’s degree in Linguistics, Computational Linguistics, Speech Science, or related field OR graduate degree in linguistics OR industry similar experience required.
  • Master’s degree or beyond preferred OR equivalent industry experience.
  • Additional learning via Coursera, Udemy, or other online resources is great too.

Related Jobs

Analyzing Technician

Engineering
 Illinois
3 Months

Location : Elgin, IL We are seeking a highly skilled Analysis Technician to join our dedicated team for the 1st shift. Based at our state-of-the-art facility, you'll be responsible for board-level analysis of failed 2-way subscriber products (both mobile and portable 2-way radios). This is an exciting opportunity to leverage your technical expertise in testing, diagnosing, and repairing electronic assemblies to identify the root causes of failures.

Electrical Engineer
RF

Repair Technician

Engineering
 Maryland
6 Months

Location : Lanham, MD Repair, upgrade, and program two-way radios Set up, adjust, and operate test equipment per procedure Monitor equipment performance Perform test runs and document radio/device performance Troubleshoot and diagnose issues using documented methods Collect and report test data; validate results

Radio repair & Testing

Video Surveillance Operator I

Engineering
 Nevada
6 Months

Location : Las Vegas, NV The Surveillance Operator is a desk-based, onsite security monitoring role responsible for reviewing live video feeds, identifying potential threats, and taking immediate action such as issuing real-time audio warnings or contacting law enforcement/property representatives. Operators monitor multiple sites nationwide using proprietary software and work in a fast-paced, multi-screen environment. This role is not related to casino surveillance and is not located on the Las Vegas Strip.

CCTV Surveillance
40 WPM Typing

Radio Subscriber Programming & Installation Technician

Engineering
 Florida
6 Months

Location : Sarasota, FL 34240 The Radio Subscriber Programming & Installation Technician (Field Service Technician I / FST I) is a hands-on technical role responsible for the configuration, programming, deployment, installation assistance, and preventative maintenance of mission-critical Land Mobile Radio (LMR) subscriber fleets and related communication hardware. Acting as a key technical resource, this individual ensures that all portable and mobile radios operate at peak performance to support secure, reliable daily operations.

Radio
RF
Testing
Installation

Wiring Harness Technician

Engineering
 California
28.00
6 Months

Location : Culver City, CA 90230 We are seeking a hands-on Wiring Technician to support the setup of internal QA test harnesses. This role is ideal for candidates with low-voltage wiring experience, strong technical documentation skills, and comfort working in a fast-paced, team-oriented environment.

Wiring
Harness
Cat 6
RJ45

Diagnostic Software Engineer III

Engineering
 Texas
6 Months

Location : San Antonio, TX 78205 Responsible for diagnosing and resolving complex Linux, software, hardware, and network issues in production environments. Works closely with engineering and operations teams to identify root causes, implement solutions, improve system reliability, and support infrastructure operations.

Linux
Server
Hardware
Networking
Python
Bash

Manufacturing Systems Support Engineer

Engineering
 Connecticut
37.00
01 Years Contract + (Highest Possibilities of extension)

location : Groton CT USA 06340 We are seeking a Manufacturing Systems Support Engineer to support digital manufacturing systems within a GMP-regulated pharmaceutical manufacturing environment. This individual will work closely with cross-functional teams to maintain, enhance, and support manufacturing execution systems, electronic batch records, data collection processes, and manufacturing reporting solutions. The ideal candidate combines a strong engineering mindset with technical aptitude, excellent communication skills, and the ability to learn new systems quickly. This position offers an excellent opportunity for early-career engineers interested in manufacturing technology, process improvement, and digital transformation.

Develop
troubleshoot SQL queries and database solutions.

Software Engineer II

Engineering
 California
$65/Hr. on W2 - $75/Hr. on W2
02+ Months

Location : Menlo Park, CA (Onsite) The role: • Join the small team building Conductor, the data and operations platform for our robotics program. Conductor manages high-volume, multimodal robot data from ingestion through quality control, discovery, training, and evaluation. You will own meaningful production systems, work directly with researchers and robotics engineers, and ship quickly with a high degree of autonomy. What you’ll do: • Build reliable backend services, APIs, and data pipelines using Python and Go across PostgreSQL and AWS/S3. • Design systems for ingesting, indexing, transforming, validating, and serving large robotics datasets. • Develop agentic and LLM-powered workflows for data quality, enrichment, automation, and research productivity, with appropriate evaluations and guardrails. • Improve performance, observability, correctness, and operational reliability across the platform. • Take projects end to end clarify requirements, make pragmatic design choices, implement, test, deploy, and iterate with users. What we’re looking for: • Exceptional software-engineering fundamentals, including data structures, algorithms, systems, databases, and debugging. • Evidence of building a substantial backend, data-intensive, distributed, or developer-infrastructure system through internships, research, open source, or ambitious independent/course projects. • Strong programming skills and experience with at least one statically typed language; working knowledge of SQL. • Ability to write clear, maintainable production code and reason carefully about reliability, performance, and data correctness. • High ownership, intellectual curiosity, sound judgment, and comfort moving quickly in an ambiguous environment.

Backend Development
Infrastructure
Distributed System
Python
SQL
GO
PostgreSQL
AWS/S3
Open Source Experience.

Business Systems Analyst I

Engineering
 California
$40/Hr. on W2 - $49/Hr. on W2
06 Months

Location : Fremont, CA – Onsite. This is a compliance, operations, and data analytics-based role. The candidate is expected to perform operations-based duties in order to understand the full scope of the assignment. The candidate is expected to own their own workflow and follow established processes aimed at maintaining data integrity. The ideal candidate should possess a forward-thinking mindset; learning the project they are assigned and then seeing if there is any room for process improvement or driving automated solutions.

Business Operation
Compliance
Data Analysis
MS Word
Visio
Flowcharts
SQL
Python.
logo

At SGS Consulting, we go beyond resume-job matches, creating meaningful connections and pathways for individuals to thrive in defining careers.


© 2026 All rights reserved.
logologologologo