Vellum

Prompt Engineering: Super powers for prompt engineers

• Compare prompts, models, and even LLM providers side-by-side
• Curate a library of test cases to evaluate prompts against
• Quantitatively evaluate the output of your prompts using industry-standard ML metrics (Bleu, Meteor, Levenshtein distance, Semantic similarity)

Deployments: Confidently iterate on models in production

• Simple API interface that proxies requests to any model provider
• Back-testing & version control
• Observability of all your inputs and outputs; UI & API to submit explicit or implicit user feedback

Documents: Use your proprietary data in LLM applications

• Robust API endpoint to submit documents (“corpus of text”) for querying against
• Configurable chunking and semantic search strategies
• Ability to query against corpus of text at run time

Continuous Improvement: Continuously fine-tune to improve quality and lower cost

• Passively accumulate training data to fine-tune your own proprietary models
• Swap model providers or parameters under the hood – no code changes required

We’re a team of MIT engineers and McKinsey consultants who’ve been building apps on GPT-3 for 3 years since it first came out. We’ve built similar tools in MLOps for 4 years and have closely experienced the pain we’re solving for our customers today.

We believe that AI is the greatest technological leap since the internet. Our mission is to help companies adopt AI by taking their prototypes to production. If you have an AI use-case in mind, please reach out!