Remote Senior Software Engineer - 34123 (San Francisco) Job at Turing, San Francisco, CA

M3VWNmRQTU5nZlpzTURBMENzQ2N2YU9NOHc9PQ==
  • Turing
  • San Francisco, CA

Job Description

We are building LLM evaluation and training datasets to train LLMs to work on realistic software engineering problems. One of our approaches is to create verifiable SWE tasks based on public repository histories in a synthetic manner with human-in-the-loop, expanding dataset coverage across different task types, programming languages, and difficulty levels.

About the Role:

We seek experienced software engineers (tech lead level) familiar with high-quality public GitHub repositories to contribute to this project. Experience with well-maintained, widely-used repositories with 500+ stars is required. This role involves hands-on software engineering tasks, including environment automation, issue triaging, and evaluating test coverage and quality.

Why Join Us?

Turing is one of the worlds fastest-growing AI companies, advancing and deploying powerful AI systems. You will evaluate how LLMs interact with real code, influencing the future of AI-assisted software development. This role offers a unique blend of practical software engineering and AI research.

Day-to-day responsibilities include:

  • Analyzing and triaging GitHub issues across trending open-source libraries.
  • Setting up and configuring code repositories, including Dockerization and environment setup.
  • Evaluating unit test coverage and quality.
  • Modifying and running codebases locally to assess LLM performance in bug-fixing scenarios.
  • Collaborating with researchers to identify repositories and issues challenging for LLMs.
  • Potentially leading a team of junior engineers on various projects.

Required Skills:

  • Experience with well-maintained, widely-used repositories with 500+ stars.
  • Proficiency with Git, Docker, and software pipeline setup.
  • Ability to understand and navigate complex codebases.
  • Comfort with running, modifying, and testing real-world projects locally.
  • Experience contributing to or evaluating open-source projects is a plus.

Note: Experience with repositories having 500+ stars is mandatory.

Nice to Have:

  • Participation in LLM research or evaluation projects.
  • Experience building or testing developer tools or automation agents.

Perks of Freelancing With Turing:

  • Remote work environment.
  • Opportunity to work on cutting-edge AI projects with leading LLM companies.
  • Commitment of 20 hours/week with some overlap with PST hours.
  • Contractor role (no medical or paid leave).
  • Contract duration: 1 month, starting next week.

Seniority Level

  • Mid-Senior level

Employment Type

  • Contract

Job Function

  • Engineering and Information Technology

Industry

  • Software Development
#J-18808-Ljbffr

Job Tags

Full time, For contractors, Freelance, Remote work,

Similar Jobs

Avis Budget Group

Car Detailer - FT Job at Avis Budget Group

 ...responsible for detailing our vehicles. This includes cleaning, washing, vacuuming, removing trash and sanitizing. You will fill gas...  ...for dash warning lights. As needed, you also may drive and park cars on our airport lots as needed. Perks Youll Get:... 

Sanford Health

Cath Lab Tech (RCIS) - Full Time Days | Sanford Health Job at Sanford Health

Careers With Purpose Have a heart for healthcare? Check out this opportunity to join our Heart and Vascular team as a Cardiac Technologist. Sanford Health is one of the largest and fastest-growing not-for-profit health systems in the United States. Committed to...

noah properties

Senior Interior Designer ( {{city}}) Job at noah properties

 ...Are you an experienced interior designer with a passion for modern design? Do you thrive in a fast...  ...team at Noah Properties is seeking a full-time Interior Design Project Manager to...  ...design trends, materials, and products to assist in the design process Prioritize and... 

America's Swimming Pool Co. - Troy

Swimming Pool Maintenance Technician Job at America's Swimming Pool Co. - Troy

 ...earned loyal customers who expect and desire dependable, quality swimming pool solutions. We guarantee satisfaction with our services and do...  ...are seeking a solution-oriented and customer-focused Pool Maintenance Technician to join our team. This position is responsible to... 

Flawless AI

Compositor Job at Flawless AI

"The most talked about AI company in Hollywood" Flawless is shattering the boundaries of traditional filmmaking with its groundbreaking suite of Gen AI film editing tools. Our mission is to empower filmmakers with cutting-edge technology that allows creativity without...