Prompt Engineer Job at Checkmate, New York, NY

ZW0yc1NOQlZuSG91c3pzdGpzS1N6NjJtSkE9PQ==
  • Checkmate
  • New York, NY

Job Description

In this hybrid role, you will blend traditional software engineering with natural language processing expertise to develop and maintain systems that leverage LLMs to solve real-world challenges in the restaurant tech domain. You’ll collaborate with cross-functional teams to implement AI-driven features that support everything from customer service automation to order management, reporting, and staff training.

Essential Job Functions:

  • Prompt Development & Optimization : Design, build, test, and refine prompts for AI tasks like Q&A, classification, extraction, and synthetic data creation.
  • Evaluation & Testing Build robust test suites using tools like CoVal, LangFuse, and Galileo to measure prompt accuracy, compliance, and performance at scale.
  • Performance Analysis & Improvement : Analyze prompt outputs using metrics, product feedback, and business goals. Iterate to maximize accuracy and reliability.
  • Collaboration: Work closely with operations, product, data science, and engineering teams to ensure prompts meet quality standards
  • Model Adaptation: By understanding their unique behaviors, create effective prompts across different models (GPT, LLaMA, Gemini, and internally fine-tuned LLMs).
  • End-to-End Ownership Drive prompts projects from planning to deployment, including monitoring and continuous improvement.
  • Team Leadership & Mentorship Lead a team of analysts, guiding their evaluations and data work to support prompt development. Mentor and collaborate with ops teams to ensure seamless integration of prompts into production.


100% Remote

Minimum of three years of experience in the areas of AI, ML, NLP, and prompt engineering.

$125,000 to $160,000

Requirements

Requirements:

  • Strong Python programming skills
  • Solid data and computer science fundamentals
  • Experience with relational databases (e.g., MySQL, PostgreSQL, Oracle, MS SQL)
  • Hands-on development experience, preferably full-stack
  • Good data processing and testing skills
  • Ability to handle ambiguous problems and drive projects from start to finish
  • Strong problem-solving mindset with a drive to improve and optimize systems
  • Ability to use scientific and analytical approaches to measure and evaluate designs
  • Excellent communication skills
  • Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field
  • Flexible to work US hours until at least 6 pm ET with a strong remote setup

Preferred Qualifications

  • Experience with multiple LLMs and tools like LangFuse and Galileo
  • Knowledge of cloud platforms (AWS, GCP, Azure, OpenStack) and tools like Docker and Kubernetes
  • Focus on scalability, performance, and cost optimization in cloud environments
  • Broad technical expertise across front-end and back-end systems
  • Familiarity with machine learning concepts and workflows
  • Master’s or PhD in Computer Science, Engineering, Math, Physics, or related field

Benefits

  • Health Care Plan (Medical, Dental & Vision)
  • Retirement Plan (401k)
  • Life Insurance (Basic, Voluntary & AD&D)
  • Flexible Paid Time Off
  • Family Leave (Maternity, Paternity)
  • Short Term & Long Term Disability
  • Training & Development
  • Work From Home
  • Stock Option Plan

Job Tags

Full time, Temporary work, Remote work, Work from home, Flexible hours,

Similar Jobs

Medical College of Wisconsin —Milwaukee, WI

Trauma and Acute Care Surgeon Job at Medical College of Wisconsin —Milwaukee, WI

JobsMedical College of Wisconsin Posted Jun 12, 2025Milwaukee, WITrauma and Acute Care Surgeon The Medical College of Wisconsin Department of Surgery, Division of Trauma and Acute Care Surgery, is seeking a candidate for a Faculty Appointment as a Trauma and Acute... 

RTX Corporation

Planning Production Control Specialist Job at RTX Corporation

 ...Location:**AZ859: RMS Rita Road Bldg 9022 9000 South Rita Road Building 9022, Tucson, AZ, 85747 USA**Position Role Type:**OnsiteAt Raytheon, the foundation of everything we do is rooted in our values and a higher calling - to help our nation and allies defend freedoms... 

ATC Marietta

Registered Nurse (RN) Job at ATC Marietta

Registered Nurse (RN)Location: Augusta, GAUnit: Med SurgNight 3x12-Hour (19:00 - 07:00)Starts:10/30/2023Duration: 9 WeeksWeekly Stipend will be qualified if lived 50miles form the locationWeekend: Yes (every third)Floating: YesContract Length: 9 weeks... 

CP Engineers, Architecture & Environmental Services

Open Resume Submission Job at CP Engineers, Architecture & Environmental Services

 ...Interested in working at CP Engineers, Architecture & Environmental Services, but don't see...  ...paid time off. ~ Optional work from home/remote work flexibility. ~ Training and...  ...~ Quality benefits including medical, dental and vision coverage. ~ Support for employee... 

Albertsons

Baker Job at Albertsons

 .... The Company operates stores across 34 states and the District of Columbia with 24 banners including Albertsons, Safeway, Vons, Jewel-Osco, Shaw's, Acme, Tom Thumb, Randalls, United Supermarkets, Pavilions, Star Market, Haggen, Carrs, Kings Food Markets and Balducci's...