AI / LLM Consultant (Part-Time)

Job Description

🧠 Job Title: AI / LLM Consultant (Part-Time)

📍 Remote | Part-Time (2 Hours/Day)

🕒 Flexible Hours | Advisory Role Only

Role Overview

We are seeking an experienced AI / LLM Consultant to provide technical guidance and architectural direction to our engineering team. As a strategic consultant, you will help define best practices, evaluate design decisions, and guide the development of scalable, production-grade LLM-based systems with a particular focus on prompt engineering, RAG, and AI coding tool workflows.

You must be an excellent communicator who can explain complex technical ideas in simple, actionable ways to a cross-functional engineering team.

Key Responsibilities

• Advise on prompt engineering best practices, including the design of prompt templates and managing complex tasks through structured system and user prompt templates
• Guide the team on how to reliably control LLM behavior and output using prompt templates
• Provide architectural guidance on Retrieval-Augmented Generation (RAG) systems, retrieval strategies, and vector database (VDB) design
• Advise on AI coding tool workflows, including strategies for improving code generation accuracy, code compilation, and bug fixing
• Help define and evaluate prompt templates using evaluation frameworks such as DeepEval and LangSmith
• Provide guidance on LangGraph for multi-step and graph-based workflow design
• Help identify potential pitfalls in LLM scaling, system latency, and infrastructure choices
• Mentor the team on how to build modular, reliable, and scalable LLM-based workflows
• Participate in technical design reviews, planning sessions, and engineering discussions
• Share industry best practices, anti-patterns, and strategies for deploying LLMs in production

Requirements

• Minimum 5 years of overall software development experience
• Hands-on experience and currently working on an ongoing AI coding tool project such as Claude, Cursor, Windsurf, GitHub Copilot, or similar
• Strong knowledge of AI coding tool workflows, including accuracy improvements, code compilation, and automated bug fixing
• Deep understanding of Large Language Models (LLMs) and structured prompt design
• Strong knowledge of prompt templates and how to control LLM outputs through templating
• Strong knowledge of Retrieval-Augmented Generation (RAG) concepts and vector databases (VDB)
• Experience evaluating LLM prompt templates using DeepEval and LangSmith
• Experience with LangGraph for multi-step or graph-based workflow design
• Ability to identify and address pitfalls in LLM scaling, latency, and infrastructure choices
• Background in software/system architecture, technical leadership, and mentorship
• Excellent verbal and written communication skills
• Ability to explain complex AI/LLM concepts in a simple, structured, and actionable manner

Nice to Have

• Experience advising or reviewing production-level LLM applications
• Dedicated, tech enthusiastic and should have good communication and collaboration with developers
• Prior experience in a consulting, technical advisor, or architect role