Skip to content

feat(evaluators): Add evaluator for LLM - DO NOT REVIEW - Review PR#290 - #280

Open
wrisa wants to merge 10 commits into
mainfrom
feature/SAO-16858-add-evaluator-for-LLM
Open

wrisa wants to merge 10 commits into
mainfrom
feature/SAO-16858-add-evaluator-for-LLM

Conversation

@wrisa

@wrisa wrisa commented Oct 2, 2026 •

Copy link
Copy Markdown
Collaborator

Do not review this PR - some commits have unverified signatures. Instead review: #290

@codecov

codecov Bot commented Oct 5, 2026 •

Copy link
Copy Markdown

@josjeon
josjeon self-requested a review October 7, 2026 16:28
wrisa and others added 6 commits October 7, 2026 13:41
Port the structured logging and execution-context identity log from
feature/SAO-16858-add-evaluator-for-LLM-thin (_shared/evaluator.py)
to the separate llm/evaluator.py and luna/evaluator.py files on this
branch. Adds dispatcher, skip, pre-invoke, result, and error logs to
_evaluate, and an identity log to _execution_context_from_extensions.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@wrisa
wrisa force-pushed the feature/SAO-16858-add-evaluator-for-LLM branch from a378e06 to 27d8ea0 Compare October 7, 2026 20:47
@wrisa
wrisa marked this pull request as ready for review October 8, 2026 23:11
@wrisa wrisa changed the title feat(evaluators): Add evaluator for LLM feat(evaluators): Add evaluator for LLM - DO NOT REVIEW - Review PR#290 Oct 9, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants