Raise Nova AI review context to 128k #135

Closed
opened 2026-08-01 08:04:21 +01:00 by nimmo · 0 comments
Owner

Context

PR #134 produces a 65,880-token review prompt while the trusted base configuration requests a 65,536-token Ollama context. Ollama consequently context-shifts away the leading schema and instructions, and the reviewer receives malformed output. Controlled idle-GPU reruns ruled out Nova load and Tdarr contention.

The configured Qwen model advertises a 262,144-token native context. Engram and Git history record that 65,536 was chosen deliberately, but do not record a resource rationale.

Scope

  • Raise provider.context_size from 65,536 to 131,072.
  • Keep the existing model, diff limits, guidance limits, review gates, and trusted-base configuration model unchanged.
  • Keep PR #134 remediation changes isolated; this issue must merge independently so its trusted base configuration can be used on a later rerun.
  • Do not deploy or manually force an updater run.

Acceptance criteria

  • The trusted reviewer configuration requests exactly 131,072 tokens.
  • Workflow and repository validation pass.
  • The change is reviewed and merged before PR #134 is rerun.
  • Any broader prompt-budgeting and structured-output hardening remains a separate reviewer implementation change.
## Context PR #134 produces a 65,880-token review prompt while the trusted base configuration requests a 65,536-token Ollama context. Ollama consequently context-shifts away the leading schema and instructions, and the reviewer receives malformed output. Controlled idle-GPU reruns ruled out Nova load and Tdarr contention. The configured Qwen model advertises a 262,144-token native context. Engram and Git history record that 65,536 was chosen deliberately, but do not record a resource rationale. ## Scope - Raise provider.context_size from 65,536 to 131,072. - Keep the existing model, diff limits, guidance limits, review gates, and trusted-base configuration model unchanged. - Keep PR #134 remediation changes isolated; this issue must merge independently so its trusted base configuration can be used on a later rerun. - Do not deploy or manually force an updater run. ## Acceptance criteria - The trusted reviewer configuration requests exactly 131,072 tokens. - Workflow and repository validation pass. - The change is reviewed and merged before PR #134 is rerun. - Any broader prompt-budgeting and structured-output hardening remains a separate reviewer implementation change.
nimmo closed this issue 2026-08-01 08:13:22 +01:00
Sign in to join this conversation.
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
nimmo/nixos-config#135
No description provided.