[FEAT]: Manually scoring messages and attacks via GUI - #2589
Open
jbolor21 wants to merge 13 commits into
Open
Conversation
jbolor21
marked this pull request as draft
September 7, 2026 00:05
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 097eaf76-ae49-44f8-b44d-9841fa2cc1cb
Preserve legacy attack scores as automated scores while adding human-score precedence and a boolean manual-scoring workflow. Validate attack/message ownership so scoring also works safely for forked conversations. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Permit PATCH requests through CORS and restrict manual scoring to user-visible attack conversations, excluding internal adversarial chats. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Point the attack-score split migration at the current upstream migration head and remove imports made obsolete by upstream test organization. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Behnam (behnam-o)
force-pushed
the
jbolor/manual_scores
branch
from
September 10, 2026 20:49
15572fe to
0550f43
Compare
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Behnam (behnam-o)
marked this pull request as ready for review
September 10, 2026 21:05
Allow objectives to be set only when absent, while treating the same value as an idempotent update and returning a conflict for replacements. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Keep objective entry available after messages are sent, reuse history outcome badges, and center empty-objective controls. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Separates automated and human scoring on attack results and keeps manual scoring focused on objective true/false verdicts.
automated_scoreandhuman_scoreto attack results.last_scorea read-only effective-score property with human-score precedence.last_score_idvalues toautomated_score_idand addshuman_score_id.automated_score.human_score,outcome, andoutcome_reasonare updated.Tests
git diff --check.