Skip to content

perf: update chats incrementally instead of replaying their history - #650

Open
rschmukler wants to merge 1 commit into
editor-code-assistant:masterfrom
rschmukler:rs/incremental-chat-updates
Open

rschmukler wants to merge 1 commit into
editor-code-assistant:masterfrom
rschmukler:rs/incremental-chat-updates

Conversation

@rschmukler

Copy link
Copy Markdown
Contributor

Add the incrementalUpdates client capability. For clients declaring it:

  • chat/rollback emits chat/truncated instead of chat/cleared plus a replay of the kept messages.

  • chat/addFlag emits only the new flag, positioned by afterContentId.

  • Chats the server creates (chat/fork, /fork, /btw) stream only their newest historyPageSize messages (default 50), with the paging meta in the new history field of chat/opened so older ones load via chat/history. Other clients keep the full replay behavior.

  • I added a entry in changelog under unreleased section.

  • This is not an AI slop. (Please take a human time to write a comprehensive context about the problem, alternatives and rationale)

@rschmukler
rschmukler marked this pull request as ready for review October 15, 2026 18:45
@rschmukler
rschmukler force-pushed the rs/incremental-chat-updates branch 2 times, most recently from c6545d2 to 33aacfa Compare October 15, 2026 19:12
Add the incrementalUpdates client capability. For clients declaring it:
- chat/rollback emits chat/truncated instead of chat/cleared plus a
  replay of the kept messages.
- chat/addFlag emits only the new flag, positioned by afterContentId.
- Chats the server creates (chat/fork, /fork, /btw) stream only their
  newest historyPageSize messages (default 50), with the paging meta in
  the new history field of chat/opened so older ones load via
  chat/history.
Other clients keep the full replay behavior.
@rschmukler
rschmukler force-pushed the rs/incremental-chat-updates branch from 33aacfa to aaa2e68 Compare October 15, 2026 19:34

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant