Skip to content

docs: fix wrong model defaults, fabricated CLI commands, and stale references#1298

Open
kovtcharov wants to merge 1 commit into
mainfrom
kalin/docs-accuracy-fixes
Open

docs: fix wrong model defaults, fabricated CLI commands, and stale references#1298
kovtcharov wants to merge 1 commit into
mainfrom
kalin/docs-accuracy-fixes

Conversation

@kovtcharov
Copy link
Copy Markdown
Collaborator

A repo-wide doc audit found documentation that actively misleads users and contributors. docs/reference/cli.mdx documented six commands that don't exist (gaia mcp add/remove, visualize, groundtruth, batch-experiment, eval -f) — anyone copy-pasting them hits an error — plus wrong defaults (SD model, download/Lemonade ports) and a duplicate Kill section. The chat/global default model is Gemma-4-E4B-it-GGUF, but CLAUDE.md, the LLM and Chat SDK docs, and the EMR guide all claimed Qwen variants (CLAUDE.md contradicted itself). The code guide falsely stated Python generation was removed (it's still the default), CLAUDE.md's structure/agent/tool tables had drifted from the source, and agent-ui.mdx showed the wrong Lemonade port. After this PR the docs match the code.

This is the documentation half of the audit; the code-hygiene + test-coverage findings ship separately.

Test plan

  • python -c "import json; json.load(open('docs/docs.json'))" — nav still valid JSON
  • grep -rE "gaia (mcp add|mcp remove|visualize|groundtruth|batch-experiment)" docs/reference/cli.mdx — returns nothing
  • Spot-check the corrected defaults against the CLI: gaia sd -h (SDXL-Turbo), gaia download -h (port 13305), gaia init -h (npu profile present)
  • grep -rn "GaiaAgent" src/gaia — still zero matches, confirming the "planned, not done" wording is correct

…ale references

Several docs described commands and defaults that don't exist in the code, so
users copy-pasting them hit errors and contributors trusted wrong values. The
chat/global default model is Gemma-4-E4B-it-GGUF, but CLAUDE.md, the LLM SDK
doc, the Chat SDK doc, and the EMR guide all claimed Qwen variants (CLAUDE.md
even contradicted itself). docs/reference/cli.mdx documented six commands that
were never implemented (`gaia mcp add`/`remove`, `visualize`, `groundtruth`,
`batch-experiment`, `eval -f`) plus wrong defaults (sd model, download/Lemonade
ports) and a duplicate Kill section. CLAUDE.md's structure tree, agent table,
tool-mixin table, and CLI list had drifted from the code, and the code guide
falsely claimed Python generation was removed.

Changes:
- Default model corrected to Gemma-4-E4B-it-GGUF across CLAUDE.md, llm.mdx,
  chat.mdx, and emr.mdx (EMR VLM included); per-agent table now matches code.
- cli.mdx: removed the six fabricated commands, fixed sd/download/Lemonade
  defaults, added the `npu` init profile, dropped the stale duplicate Kill
  section, and documented previously-missing real commands (summarize, jira,
  docker, telegram).
- CLAUDE.md: structure tree, agent table, and KNOWN_TOOLS table synced to the
  real source; GaiaAgent rename marked planned (not done); CLI list corrected.
- code.mdx: Python generation documented as still supported (it's the default).
- agent-ui.mdx: Lemonade port 13305 and a broken in-page anchor fixed.
- AGENTS.md: removed the stale "currently active PR #606" note (merged).
- Removed the orphaned duplicate guides/telegram.mdx (superseded by
  telegram-adapter.mdx).
@github-actions github-actions Bot added documentation Documentation changes devops DevOps/infrastructure changes labels May 29, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

devops DevOps/infrastructure changes documentation Documentation changes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant