<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>llmnet.nl – Benchmark</title><link>https://benchmark.llmnet.nl/en/</link><description>Latest articles from Benchmark on llmnet.nl, the knowledge network on AI and LLMs.</description><language>en</language><lastBuildDate>Fri, 13 Nov 2026 18:08:31 +0000</lastBuildDate><atom:link href="https://benchmark.llmnet.nl/en/feed.xml" rel="self" type="application/rss+xml"/><item><title>Quantifying sycophancy: measuring how readily a model agrees with the user</title><link>https://benchmark.llmnet.nl/en/sycophancy-kwantificeren-meet-hoe-snel-een-model-meepraat</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/sycophancy-kwantificeren-meet-hoe-snel-een-model-meepraat</guid><pubDate>Sun, 23 Aug 2026 00:00:00 +0000</pubDate><description>Learn how to quantify sycophancy (yes-man behavior) in LLMs using controlled test sets, paired evaluations, and robust measurement statistics.</description></item><item><title>Filtering synthetic evaluation data on density</title><link>https://benchmark.llmnet.nl/en/synthetische-evaluatiedata-filteren-op-informatiedichtheid</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/synthetische-evaluatiedata-filteren-op-informatiedichtheid</guid><pubDate>Sun, 23 Aug 2026 00:00:00 +0000</pubDate><description>How do you filter synthetic evaluation sets by information density? Measure token entropy, semantic redundancy, and prevent data bloat in LLM benchmarks.</description></item><item><title>Bootstrapping confidence intervals for LLM tests</title><link>https://benchmark.llmnet.nl/en/betrouwbaarheidsintervallen-bootstrappen-voor-llm-tests</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/betrouwbaarheidsintervallen-bootstrappen-voor-llm-tests</guid><pubDate>Sat, 22 Aug 2026 00:00:00 +0000</pubDate><description>Learn how to calculate non-parametric bootstrap intervals for LLM evaluations to substantiate noise, spread and measurement uncertainty quantitatively.</description></item><item><title>Calibrating G-Eval criteria with human data</title><link>https://benchmark.llmnet.nl/en/g-eval-scoringscriteria-kalibreren-met-menselijke-data</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/g-eval-scoringscriteria-kalibreren-met-menselijke-data</guid><pubDate>Sat, 22 Aug 2026 00:00:00 +0000</pubDate><description>Learn how to precisely calibrate G-Eval scoring criteria and prompt rubrics using human annotation data and correlation statistics.</description></item><item><title>Calculating inter-annotator agreement for LLM juries</title><link>https://benchmark.llmnet.nl/en/inter-annotator-agreement-berekenen-bij-llm-jury-s</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/inter-annotator-agreement-berekenen-bij-llm-jury-s</guid><pubDate>Sat, 22 Aug 2026 00:00:00 +0000</pubDate><description>Calculate inter-annotator agreement for LLM juries using Cohen&#x27;s kappa, Krippendorff&#x27;s alpha, and pairwise consensus to validate evaluations.</description></item><item><title>Measuring and Neutralizing Position Bias in LLM-as-a-Judge</title><link>https://benchmark.llmnet.nl/en/positiebias-bij-llm-as-a-judge-meten-en-neutraliseren</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/positiebias-bij-llm-as-a-judge-meten-en-neutraliseren</guid><pubDate>Sat, 22 Aug 2026 00:00:00 +0000</pubDate><description>Measure and neutralize position bias in pairwise LLM-as-a-judge evaluations with swap tests, statistical consistency measurements, and calibration.</description></item><item><title>Prompt caching simulator: measuring cost and latency</title><link>https://benchmark.llmnet.nl/en/simulator-voor-prompt-caching-kostenbesparing-en-latency</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/simulator-voor-prompt-caching-kostenbesparing-en-latency</guid><pubDate>Fri, 21 Aug 2026 00:00:00 +0000</pubDate><description>Calculate and simulate the real cost savings and latency reduction of prompt caching. Measure the impact of cache hit rates and prefix lengths.</description></item><item><title>Comparing chunking strategies quantitatively for RAG</title><link>https://benchmark.llmnet.nl/en/chunking-strategieen-kwantitatief-vergelijken-voor-rag</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/chunking-strategieen-kwantitatief-vergelijken-voor-rag</guid><pubDate>Thu, 20 Aug 2026 00:00:00 +0000</pubDate><description>How do you quantitatively compare chunking strategies for RAG? A measurement method for retrieval statistics, context precision, and token costs.</description></item><item><title>Measuring the lost-in-the-middle effect in context windows</title><link>https://benchmark.llmnet.nl/en/het-lost-in-the-middle-effect-meten-in-lange-contextvensters</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/het-lost-in-the-middle-effect-meten-in-lange-contextvensters</guid><pubDate>Thu, 20 Aug 2026 00:00:00 +0000</pubDate><description>Measure the lost-in-the-middle effect in long LLM context windows. Discover test matrices, noise distribution, statistical validation, and Python…</description></item><item><title>Indirect prompt injection: measuring resilience</title><link>https://benchmark.llmnet.nl/en/indirecte-prompt-injection-weerbaarheid-systematisch-meten</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/indirecte-prompt-injection-weerbaarheid-systematisch-meten</guid><pubDate>Thu, 20 Aug 2026 00:00:00 +0000</pubDate><description>Learn how to measure the resilience of LLM systems against indirect prompt injection systematically and repeatably through a structured benchmark.</description></item><item><title>Calibrating temperature and top-p for determinism</title><link>https://benchmark.llmnet.nl/en/temperature-en-top-p-calibreren-voor-deterministische-output</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/temperature-en-top-p-calibreren-voor-deterministische-output</guid><pubDate>Thu, 20 Aug 2026 00:00:00 +0000</pubDate><description>Learn to systematically calibrate temperature, top-p, and seed values for deterministic and reproducible LLM evaluations and reliable JSON extraction.</description></item><item><title>Measuring TTFT under varying server load</title><link>https://benchmark.llmnet.nl/en/time-to-first-token-meten-onder-varierende-serverbelasting</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/time-to-first-token-meten-onder-varierende-serverbelasting</guid><pubDate>Thu, 20 Aug 2026 00:00:00 +0000</pubDate><description>A measurement method for time to first token (TTFT) under varying server load. Analyze prefill delay, queuing, and percentiles in LLM inference.</description></item><item><title>Setting up an Elo rating system for model comparison</title><link>https://benchmark.llmnet.nl/en/elo-ratingsysteem-opzetten-voor-paarsgewijze-modelvergelijking</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/elo-ratingsysteem-opzetten-voor-paarsgewijze-modelvergelijking</guid><pubDate>Wed, 19 Aug 2026 00:00:00 +0000</pubDate><description>Learn how to set up a reliable Elo or Bradley-Terry rating system for pairwise LLM evaluations, including matchmaking, bias correction, and code.</description></item><item><title>Testing function calling accuracy with schemas</title><link>https://benchmark.llmnet.nl/en/function-calling-nauwkeurigheid-testen-bij-complexe-schema-s</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/function-calling-nauwkeurigheid-testen-bij-complexe-schema-s</guid><pubDate>Wed, 19 Aug 2026 00:00:00 +0000</pubDate><description>A measurement method for function calling accuracy with complex JSON schemas. Test nested objects, polymorphism, and strict validation systematically.</description></item><item><title>Determining Sample Size for LLM Evaluations</title><link>https://benchmark.llmnet.nl/en/steekproefgrootte-bepalen-voor-betrouwbare-llm-evaluaties</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/steekproefgrootte-bepalen-voor-betrouwbare-llm-evaluaties</guid><pubDate>Wed, 19 Aug 2026 00:00:00 +0000</pubDate><description>Calculate the exact sample size for reliable LLM evaluations. Prevent statistical noise, power errors, and unnecessary API costs.</description></item><item><title>Setting Up Human Evaluation: When You Need a Jury</title><link>https://benchmark.llmnet.nl/en/menselijke-evaluatie-opzetten-wanneer-een-jury-nodig-is</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/menselijke-evaluatie-opzetten-wanneer-een-jury-nodig-is</guid><pubDate>Sun, 16 Aug 2026 00:00:00 +0000</pubDate><description>Discover when you need a human jury for LLM evaluation, how to write annotation guidelines, and how to measure inter-rater reliability.</description></item><item><title>Choosing benchmark datasets: does the test fit your question?</title><link>https://benchmark.llmnet.nl/en/benchmark-datasets-kiezen-past-deze-test-bij-mijn-vraag</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/benchmark-datasets-kiezen-past-deze-test-bij-mijn-vraag</guid><pubDate>Sat, 15 Aug 2026 00:00:00 +0000</pubDate><description>How do you choose the right benchmark dataset for your AI problem? Avoid misleading scores, recognize contamination and match test data to production tasks.</description></item><item><title>Measuring drift in production: LLM performance over time</title><link>https://benchmark.llmnet.nl/en/drift-meten-in-productie-modelprestaties-over-tijd-volgen</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/drift-meten-in-productie-modelprestaties-over-tijd-volgen</guid><pubDate>Sat, 15 Aug 2026 00:00:00 +0000</pubDate><description>How do you measure data drift, concept drift, and model drift for LLMs in production? Measurement methods, statistical tests, and pitfalls in practice.</description></item><item><title>Evaluating small models: where they surprise and where they fail</title><link>https://benchmark.llmnet.nl/en/kleine-modellen-evalueren-waar-ze-verrassen-en-falen</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/kleine-modellen-evalueren-waar-ze-verrassen-en-falen</guid><pubDate>Sat, 15 Aug 2026 00:00:00 +0000</pubDate><description>Learn how to systematically evaluate small language models. Discover where compact models perform surprisingly well and where they fail structurally in production.</description></item><item><title>Model Quality per Task: One Score Says Too Little</title><link>https://benchmark.llmnet.nl/en/modelkwaliteit-per-taak-n-score-zegt-te-weinig</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/modelkwaliteit-per-taak-n-score-zegt-te-weinig</guid><pubDate>Sat, 15 Aug 2026 00:00:00 +0000</pubDate><description>Why a single composite benchmark score misleads model selection. Learn to evaluate task-specifically with metrics for extraction, RAG, and reasoning.</description></item><item><title>Practically Measuring Dutch Translation Quality</title><link>https://benchmark.llmnet.nl/en/nederlandse-vertaalkwaliteit-praktisch-meten</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/nederlandse-vertaalkwaliteit-praktisch-meten</guid><pubDate>Sat, 15 Aug 2026 00:00:00 +0000</pubDate><description>Learn how to practically and reproducibly measure translation quality into Dutch with test sets, automated metrics, and LLM-as-a-judge.</description></item><item><title>Evaluations in your pipeline: automatic testing</title><link>https://benchmark.llmnet.nl/en/evaluaties-in-je-pijplijn-elke-wijziging-automatisch-toetsen</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/evaluaties-in-je-pijplijn-elke-wijziging-automatisch-toetsen</guid><pubDate>Sun, 09 Aug 2026 00:00:00 +0000</pubDate><description>Automate LLM evaluations in your CI/CD pipeline. Monitor model quality, prevent regression on every prompt or model change and control evaluation costs.</description></item><item><title>Benchmarks for Dutch-language model output | LLMnet</title><link>https://benchmark.llmnet.nl/en/benchmarks-voor-nederlandstalige-modellen</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/benchmarks-voor-nederlandstalige-modellen</guid><pubDate>Fri, 07 Aug 2026 00:00:00 +0000</pubDate><description>An overview of Dutch benchmarks, translation loss, LLM-as-a-judge for Dutch and setting up your own evaluation set.</description></item><item><title>Reporting evaluation results: from table to decision map</title><link>https://benchmark.llmnet.nl/en/evaluatieresultaten-rapporteren-van-scoretabel-naar-besliskaart</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/evaluatieresultaten-rapporteren-van-scoretabel-naar-besliskaart</guid><pubDate>Fri, 07 Aug 2026 00:00:00 +0000</pubDate><description>Learn how to turn raw LLM evaluation results into actionable decision maps. A practical method for well-founded model and provider choices.</description></item><item><title>Evaluating JSON Validity Under Load | LLM Benchmark</title><link>https://benchmark.llmnet.nl/en/json-validiteit-evalueren-bij-belasting</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/json-validiteit-evalueren-bij-belasting</guid><pubDate>Fri, 07 Aug 2026 00:00:00 +0000</pubDate><description>Evaluating JSON formatting validity and schema compliance of language models under high concurrency. Distinguish infrastructure errors from model errors.</description></item><item><title>Measuring Latency with Percentiles Instead of Averages — LLM Benchmark</title><link>https://benchmark.llmnet.nl/en/latency-percentielen-meten</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/latency-percentielen-meten</guid><pubDate>Fri, 07 Aug 2026 00:00:00 +0000</pubDate><description>Discover why averages fail for LLM latency and how to properly measure, aggregate, and translate p50, p95, and p99 into a reliable SLO.</description></item><item><title>JSON schema output validator &amp; benchmark tool</title><link>https://benchmark.llmnet.nl/en/tool-json-schema-validator</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/tool-json-schema-validator</guid><pubDate>Fri, 07 Aug 2026 00:00:00 +0000</pubDate><description>Validate JSON schema output and benchmark multiple model results directly in your browser with this interactive client-side tool from llmnet.nl.</description></item><item><title>Reading and interpreting safety benchmarks for LLMs</title><link>https://benchmark.llmnet.nl/en/veiligheidsbenchmarks-lezen</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/veiligheidsbenchmarks-lezen</guid><pubDate>Fri, 07 Aug 2026 00:00:00 +0000</pubDate><description>A critical guide to interpreting safety benchmarks for LLMs. Discover the pitfalls, testing methods, and Dutch-language nuance.</description></item><item><title>Making bias in model output measurable | LLMNet Benchmark</title><link>https://benchmark.llmnet.nl/en/bias-en-stereotypen-meten-in-modellen</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/bias-en-stereotypen-meten-in-modellen</guid><pubDate>Thu, 06 Aug 2026 00:00:00 +0000</pubDate><description>Methodology for quantifying bias and stereotypes in language models through paired testing, Dutch context, and outcome measures.</description></item><item><title>Setting up your own benchmark: a practical step-by-step plan</title><link>https://benchmark.llmnet.nl/en/eigen-benchmark-opzetten-stappenplan</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/eigen-benchmark-opzetten-stappenplan</guid><pubDate>Thu, 06 Aug 2026 00:00:00 +0000</pubDate><description>Discover how to set up your own custom benchmark for LLMs. Follow our step-by-step plan from dataset design and metrics to reliable automation.</description></item><item><title>Measuring instruction following with IFEval</title><link>https://benchmark.llmnet.nl/en/ifeval-instructie-volgzaamheid-meten</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/ifeval-instructie-volgzaamheid-meten</guid><pubDate>Thu, 06 Aug 2026 00:00:00 +0000</pubDate><description>How do you measure whether a language model sticks to strict formatting rules? An in-depth analysis of the IFEval methodology for LLMs&#x27;s.</description></item><item><title>Measuring the quality impact of quantization</title><link>https://benchmark.llmnet.nl/en/kwantisering-effect-op-modelkwaliteit</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/kwantisering-effect-op-modelkwaliteit</guid><pubDate>Thu, 06 Aug 2026 00:00:00 +0000</pubDate><description>Discover how to accurately measure the effect of quantization on language model quality, where the first errors emerge, and which pitfalls to avoid.</description></item><item><title>Evaluating reasoning steps in math and logic tasks</title><link>https://benchmark.llmnet.nl/en/redeneerkwaliteit-evalueren-gsm8k-math</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/redeneerkwaliteit-evalueren-gsm8k-math</guid><pubDate>Thu, 06 Aug 2026 00:00:00 +0000</pubDate><description>A guide to evaluating reasoning quality, intermediate steps, and answer accuracy in mathematical and logical LLM benchmarks.</description></item><item><title>Measuring system prompt variation and consistency | Benchmark</title><link>https://benchmark.llmnet.nl/en/systeem-prompt-variatie-consistentie-meten</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/systeem-prompt-variatie-consistentie-meten</guid><pubDate>Thu, 06 Aug 2026 00:00:00 +0000</pubDate><description>Discover how to measure an LLM&#x27;s sensitivity to system prompt variations and safeguard comparable outcomes during model evaluations.</description></item><item><title>Generator for needle-in-a-haystack tests</title><link>https://benchmark.llmnet.nl/en/tool-needle-haystack-generator</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/tool-needle-haystack-generator</guid><pubDate>Thu, 06 Aug 2026 00:00:00 +0000</pubDate><description>Interactively build prompts for needle-in-a-haystack tests to examine the information processing and context range of language models.</description></item><item><title>Evaluating the translation quality of LLM output</title><link>https://benchmark.llmnet.nl/en/vertaalkwaliteit-evalueren-comet-bleurt</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/vertaalkwaliteit-evalueren-comet-bleurt</guid><pubDate>Thu, 06 Aug 2026 00:00:00 +0000</pubDate><description>An analysis of methods for evaluating translation quality in LLMs, from n-gram overlap such as BLEU to neural metrics such as COMET and BLEURT.</description></item><item><title>Needle-in-a-haystack test method for LLM context windows</title><link>https://benchmark.llmnet.nl/en/needle-in-a-haystack-testmethode</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/needle-in-a-haystack-testmethode</guid><pubDate>Wed, 05 Aug 2026 00:00:00 +0000</pubDate><description>Learn how to use the needle-in-a-haystack method to test and quantify the true reliability of large context windows in language environments.</description></item><item><title>Benchmark contamination explained | llmnet.nl Benchmark</title><link>https://benchmark.llmnet.nl/en/benchmark-contaminatie-uitgelegd</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/benchmark-contaminatie-uitgelegd</guid><pubDate>Mon, 03 Aug 2026 00:00:00 +0000</pubDate><description>Discover what benchmark contamination in LLMs means, how data pipeline leaks affect scores, and how to detect contamination effectively.</description></item><item><title>A/B Testing Prompts: Systematically Getting Better Results</title><link>https://benchmark.llmnet.nl/en/ab-testen-prompts</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/ab-testen-prompts</guid><pubDate>Mon, 27 Jul 2026 00:00:00 +0000</pubDate><description>Learn how to systematically A/B test prompts for better LLM results. Discover the right setup, measurable outcomes, and avoid common pitfalls.</description></item><item><title>How to Evaluate an AI Agent: From Task Success to Trajectory</title><link>https://benchmark.llmnet.nl/en/agent-evaluatie</link><guid isPermaLink="true">https://benchmark.llmnet.nl/en/agent-evaluatie</guid><pubDate>Mon, 27 Jul 2026 00:00:00 +0000</pubDate><description>Learn how to test autonomous AI agents. Discover methods for trajectory analysis, tool evaluation, measuring step success, and use the practical evaluation…</description></item></channel></rss>
