Skip to main content

General Prompt Engineering Guide

Prompt engineering may be the most important part of your assistant—it can make the difference between success and failure. This guide shares our insights on how to write prompts that assistants can follow more reliably.
This guide is a work in progress and will be updated as we learn more. If you have suggestions or feedback, please let us know.
To see some of the prompts we have created, you can check out the templates in the dashboard (create a new assistant and select a template to get started).

Structured Prompts

Why Structured Prompts?

When writing a large prompt like the general prompt, it’s good practice to break it down into smaller sections, each with its own focus such as identity, style, guidelines, tasks, and goals. This has several advantages:
  • Reusable – sections can be used in other prompts
  • Easier to maintain – changes can be made in a targeted way
  • Easier for LLMs to understand – clear structure improves comprehension

Example of a Structured Prompt

## Identity
You are a friendly AI assistant for Famulor. You help customers manage their calls in a professional and efficient manner.

For Single/Multi-Prompt Agents: Be Explicit About When Tools Should Be Called

Conversation Flow agents handle function calls deterministically, so you don’t need to worry about this. The following section applies only to Single/Multi-Prompt agents.

Example of Explicit Tool Calls

## Tool Calls

1. Ask the user whether they need a refund or just want to get information
  - If the user needs a refund, call the function transfer_to_support to provide further assistance
  - If the user needs a replacement, switch to the replacement status

Best Practices for Famulor

Language Adaptation

  • Use German terms and expressions
  • Consider German business etiquette
  • Adjust the tone to your target audience

Technical Integration

  • Integrate Famulor-specific tools
  • Make optimal use of available functions
  • Test prompts with real calls

Common Mistakes to Avoid

What to Avoid

  • Too long prompts – LLMs can get lost in overly long instructions
  • Contradictory instructions – Ensure all parts are consistent
  • Unclear tool calls – Be explicit about when and how to use tools
  • Missing examples – Provide concrete examples of expected behavior
  • Overly complex logic – Break complex tasks into simpler steps

Testing and Optimization

Steps for Testing

  • Test step-by-step – test each section individually
  • Simulate real calls – use various scenarios
  • Gather feedback – listen to recordings
  • Iterate improvements – adjust based on results
  • Monitor performance – pay attention to response times and quality

Help and Support

Our support team can assist you with creating and optimizing your prompts.

Contact Support

Need help with prompt engineering? Contact our support team.