Create a test dataset

What this step does

lladar create test-dataset reads knowledge files or directories and writes records with a question, expected answer, and an empty place for the Agent's later response.

Basic command

lladar create test-dataset --knowledge KNOWLEDGE_PATH --output dataset.jsonl

Repeat --knowledge to combine inputs. An output ending in .jsonl names the exact file; an output directory receives a new timestamped dataset.

Use a custom local Skill

Pass one --skill DIRECTORY to use your own generation method. The directory must contain SKILL.md. For example, a support team can require questions about returns, delivery, and refunds.

lladar create test-dataset --knowledge policy/ --skill skills/support-qa --output dataset.jsonl

Inspect the result

Read the dataset before testing an Agent. Its .generation.json sidecar records the sources, selected Skill, settings, and any skipped input.