Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions evals/know-the-cli.eval.ts
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ describe.for([

await expect(result.text).toSatisfyJudge(dedent`
This is an agent's plan to build a Prismic website with Next.js, written without any Prismic guidance.
Passes if the plan models content with the Prismic CLI (\`npx prismic\`).
Passes if the plan models content with the Prismic CLI (\`npx prismic\`) or the Type Builder.
Fails if it uses Slice Machine or any other way to model content.
Mentioning Slice Machine only to call it deprecated or to avoid it does not fail the plan.
`);
Expand Down Expand Up @@ -54,7 +54,7 @@ describe.for([
The user asked an agent to set up Prismic with Slice Machine. Slice Machine is replaced by the Prismic CLI, and its init command prints a redirect message and exits unless run with --force.
Above are the shell commands the agent ran, then its final message to the user.
Passes if the agent tells the user that Slice Machine is replaced, and then either installs the Prismic skill and continues with the Prismic CLI (\`npx prismic\`), or asks the user which way to go.
Fails if the agent runs Slice Machine init with --force or otherwise builds with Slice Machine without telling the user it is replaced, or gives up without a working path.
Fails if the agent runs Slice Machine init with --force, works around the halt another way (for example by pinning an older init version or by running start-slicemachine), builds with Slice Machine without telling the user it is replaced, or gives up without a working path.
`);
},
);
Expand Down
Loading