Skip to main content

How to Set Up a Phone Agent

A LoyJoy Phone Agent can be set up in just a few minutes. Thanks to speech-to-speech technology the conversations feel natural, and the shipped defaults let you get started without deep prior knowledge.

Step-by-step setup​

  1. Create a new agent: After signing in, open the admin area, click New Agent and select Phone Agent. See New Agent for the full list of agent creation options.

  2. Configure the AI Agent module: This is where the instructions for the AI (the prompt) live. Sensible defaults are pre-filled so you can start right away. You can edit the prompt as free text or use the prepared dropdowns, for example to set the Personality of your agent.

  3. Enable tools:

    1. Knowledge Search: Enabled by default. Add a short description of what is available in your knowledge base, then use the checkboxes to control which data sources the agent may access. The knowledge base is filled in advance with website content and documents. See AI and Retrieval Augmented Generation.
    2. Web research: Optional. Activate it if you want your agent to look things up on the internet.
    3. MCP tools: Connect any number of additional tools via the Model Context Protocol to extend the agent's capabilities. See LoyJoy Agent as MCP Server.
  4. Configure the consent question and the intro: Calls are recorded only after the caller consents. In the Intro card of the AI Agent module you configure:

    1. Consent question: Enter the text of the question. It is played as audio at the beginning of every call and cannot be skipped. The caller then has about 3 seconds to answer. Recording starts only after a clear yes; without an answer, with a no or an unclear answer the call continues without recording.
    2. Consent question audio: Upload the question as a .wav file or click Create audio from text. Create the audio again after every text change, otherwise callers hear the old text. Without audio, nothing is asked and nothing is recorded.
    3. Intro: The AI Agent speaks the intro after the consent question. If the consent question has no audio, it speaks the intro right away. See Texts.

    The intro must clearly state that the caller is speaking with an AI system. If you change this notice, you are responsible for the legal assessment of your greeting.

    Intro settings with text intro, audio upload and create audio from text

  5. Choose a language: German and English are currently supported. More languages will follow soon. See Languages in LoyJoy.

  6. Publish: Release your current changes in the Publish section. See Publish Your Agent.

Testing and going live​

  1. Test instantly: Use the Test button in the admin area to talk to your agent right away, without any additional configuration. The test runs directly in the browser with microphone input and a live transcript, no phone call required.

    Browser test of a Phone Agent with microphone, live audio response, and real-time transcript

  2. Phone number: Set up a dedicated phone number so you can call your agent from any phone. See Set Up a Phone Number for Your Phone Agent. Once a number is connected to your agent, it is shown in the Publish section and as a badge on the agent's card in the process overview.

  3. More integrations: Connections to your existing telephony infrastructure via SIP and Websocket are in preparation. For background see Telephony Integration & Architecture.

  4. LoyJoy demo: The phone number of the LoyJoy Phone Agent is shown directly on the LoyJoy website. Call it to experience the agent in action.

Reviewing conversations​

The Conversations section gives you access to all calls handled by your agent. Listen to recordings and analyze content to systematically improve quality and identify optimization potential.

The telephony settings of the Publish section show how calls are recorded:

  1. Recording only after consent (default): the consent question decides per call.
  2. Prevent audio log: no audio recording is kept for the calls, and no consent question is played.
  3. Prevent consent: calls are recorded without asking. The responsibility for this lies with you as the customer.

Tips​

  1. Start with the defaults and validate your agent via the Test button before fine-tuning prompt and tools.
  2. Carefully populate your knowledge base with website content and documents up front. It is the single most important quality lever for your agent's responses. See AI.
  3. After the first test calls, review the conversations and iteratively refine both the prompt and the knowledge search description.