Repository navigation
fix: 数据处理状态&数据评估 - #537
Merged
Merged
fix: 数据处理状态&数据评估#537
Conversation
- 数据项缺少 input 等字段时不再抛 TypeError，prompt 渲染统一转换为文本 - 单条评估失败记为 FAILED，全部失败时任务置为 FAILED 并返回 evaluation.0005 - 没有可评估数据项时报 evaluation.0004，避免进度 100% 但结果为空 - COT 校验只要求 instruction/output，JSON 单对象和 JSONL 空行可正常解析 - evaluate_item 不再自行 commit，避免并发协程共用会话时互相干扰
轮询拿不到结论（runtime 不可达、返回 NOT_FOUND 或异常响应）时保持 RUNNING，只有持续超时才兜底置 FAILED：默认 7200s，可用 CLEANING_POLL_ORPHAN_TIMEOUT_SECONDS 覆盖。此前一次 60s 超时就判失败，而数据面稍后才写入成功终态，于是出现先失败、过一会儿又变成功的现象。 每轮轮询先回读数据库终态，数据面已写入终态时不再覆盖；写入终态改为带状态条件的更新，保证幂等。状态查询单独设置 10s 超时，不再沿用提交任务的 60s 超时。 另外禁止重复提交运行中的任务，避免起第二个 Ray Job 并产生重复清洗结果；需要重跑时先停止任务。 新增 test_module_cleaning_scheduler.py 与 test_module_cleaning_service.py 覆盖上述行为。
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.