From 1d672ff8d9d25230ce07f9bbe9ea788523e0b1ad Mon Sep 17 00:00:00 2001 From: Tiara Rodney Date: Tue, 16 Jun 2026 20:14:35 +0200 Subject: [PATCH] todo(3): open --- TODO | 15 +++++++++++++++ 1 file changed, 15 insertions(+) diff --git a/TODO b/TODO index d4e9dce..1a10bf8 100644 --- a/TODO +++ b/TODO @@ -46,3 +46,18 @@ Description: Add the supervised fine-tuner: render trajectories through the tokenizer's own chat template (matching serving), canonicalise turns (fold system, merge consecutive), derive an assistant-only loss mask by token-prefix differencing, and train a QLoRA adapter. + +--ISSUE +Content-Type: application/issue +ID: 3 +Type: feature +Title: Behavioural evaluator +Status: open +Priority: medium +Created: 2026-06-16 +Module: sekft +Relationships: +Description: Add the behavioural eval: load base plus LoRA adapter, drop it into + held-out scenarios with no scaffold, drive them through a local + operator that renders with the model's chat template, and report + reach/terminate/checker rates.