Skip to content

docs: add a codebase-focused Tasksmith evaluation tutorial - #181

Merged
adithya-s-k merged 2 commits into
mainfrom
codex/tutorials-codebase-evaluations
Sep 30, 2026
Merged

adithya-s-k merged 2 commits into
mainfrom
codex/tutorials-codebase-evaluations

Conversation

@adithya-s-k

@adithya-s-k adithya-s-k commented Sep 30, 2026 •

Copy link
Copy Markdown
Collaborator

Readers can now follow a codebase-focused tutorial from choosing a merged PR to generating a Tasksmith task, reviewing its evidence, freezing a suite and comparing agent runs with Harbor.

Adds a Tutorials section to navigation and the homepage, a maintained Daytona/CPU options example, and a workflow diagram. Includes an original abstract thumbnail on the tutorial card, article and social-sharing preview, with its generation prompt recorded alongside the asset. The walkthrough separates task-quality checks from agent evaluation, explains the current input limits and budget boundaries, and grounds its case study in the recorded HF_ML_Tasksmith results.

Tutorials receive visible author/date/version metadata, canonical URLs, Article structured data, social previews, sitemap dates, search coverage and an RSS feed. A contributor guide documents future articles, and CI checks their exported metadata and discovery links.

Validation: static site build, TypeScript, Ruff, metrics consistency and 10,651 internal links pass. Options validate against the Tasksmith schema; Harbor commands parse without dispatching jobs. The suite-freezing snippet was exercised for identity/mode preservation, unready-task rejection and overwrite protection. Desktop/mobile rendering and interactive search were checked locally. No paid generation or cloud evaluation was run for this documentation change; indexing can be requested after deployment.

@adithya-s-k
adithya-s-k merged commit 5555443 into main Sep 30, 2026
11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant