5,365,291 AI resources indexedWorking toward the world’s largest AI resource index.

PDF

Evaluate tool usage accuracy in multi-agent AI workflows using evaluation nodes

Research & reporting workflow for n8n with 15 active steps. Starts with Chat Trigger, Evaluation Trigger. Uses OpenRouter, OpenAI. Integrations include OpenRouter, OpenAI, Qdrant.

What it does

15 active nodes · Starts with Chat Trigger, Evaluation Trigger.

Steps in the template include:

  • Calculator (Calculator)
  • Check if tool called (Edit Fields (Set))
  • When chat message received (Chat Trigger)
  • Match chat format (Edit Fields (Set))

Nodes and integrations

  • Calculator
  • Edit Fields (Set) ×2
  • Chat Trigger
  • No Operation, do nothing
  • Evaluation Trigger
  • Evaluation ×3
  • AI Agent
  • Call n8n Workflow Tool
  • http Request Tool
  • OpenRouter Chat Model
  • Embeddings OpenAI
  • Qdrant Vector Store
See the author’s step names
  • Calculator (Calculator)
  • Check if tool called (Edit Fields (Set))
  • When chat message received (Chat Trigger)
  • Match chat format (Edit Fields (Set))
  • Return chat response (No Operation, do nothing)
  • When fetching a dataset row (Evaluation Trigger)
  • Evaluation (Evaluation) — setMetrics
  • Evaluating? (Evaluation) — checkIfEvaluating
  • Set Outputs (Evaluation)
  • Search Agent (AI Agent)
  • Summarizer (Call n8n Workflow Tool)
  • Web search (http Request Tool)
  • OpenRouter Chat Model (OpenRouter Chat Model)
  • Embeddings OpenAI (Embeddings OpenAI)
  • Search_db (Qdrant Vector Store)

Accounts and credentials

  • Google Sheets
  • OpenRouter access
  • OpenAI access
  • Qdrant

Credential types in the graph: googleSheetsOAuth2Api, httpBearerAuth, openRouterApi, openAiApi, qdrantApi

Check the HTTP request steps for any additional service accounts or API keys.

AI models and swaps

OpenRouter · Chat

openai/o3 in OpenRouter Chat Model. Potentially swappable with a compatible n8n chat model node. Match tool calling before testing.

OpenAI · Embeddings

Model ID not specified in the template in Embeddings OpenAI. Changing the embedding model may require rebuilding the vector index and matching its dimensions.

Resource information

Credit basis
Author listed by n8n
Pricing
Template access shown on n8n
License
Not specified
Last record update
Nov 5, 2026