4e45bacf0b
Trainer renders with the model's chat template, canonicalises turns, masks to assistant-only by token-prefix differencing, and trains a QLoRA adapter.
48 lines
1.3 KiB
Text
48 lines
1.3 KiB
Text
--ISSUE
|
|
Content-Type: application/sprints
|
|
Sprints:
|
|
|
|
--ISSUE
|
|
Content-Type: application/modules
|
|
Modules:
|
|
- Name: sekft
|
|
Path: .
|
|
|
|
--ISSUE
|
|
Content-Type: application/bugzilla
|
|
URL: https://bugs.code.tiararodney.com/rest
|
|
Mappings:
|
|
- Module: sekft
|
|
Product: sek
|
|
Component: sekft
|
|
|
|
--ISSUE
|
|
Content-Type: application/issue
|
|
ID: 1
|
|
Type: feature
|
|
Title: Package sekft as an installable namespace package
|
|
Status: done
|
|
Priority: medium
|
|
Created: 2026-06-16
|
|
Module: sekft
|
|
Relationships:
|
|
Description: Turn the flat trainer scripts into an installable tiararodney.sekft
|
|
namespace package: src layout, pyproject with the abstract
|
|
posix-sdc dependency and an optional gpu extra, console scripts, a
|
|
Pipfile pinning posix-sdc as a local editable override, and tox
|
|
environments.
|
|
|
|
--ISSUE
|
|
Content-Type: application/issue
|
|
ID: 2
|
|
Type: feature
|
|
Title: SFT trainer with chat-template render and assistant-only mask
|
|
Status: done
|
|
Priority: medium
|
|
Created: 2026-06-16
|
|
Module: sekft
|
|
Relationships:
|
|
Description: Add the supervised fine-tuner: render trajectories through the
|
|
tokenizer's own chat template (matching serving), canonicalise
|
|
turns (fold system, merge consecutive), derive an assistant-only
|
|
loss mask by token-prefix differencing, and train a QLoRA adapter.
|