Skip to content

External Storage Integration: Lazy resolving references, general refactoring - #3016

Open
cconstable wants to merge 1 commit into
mainfrom
extstore/foundation
Open

External Storage Integration: Lazy resolving references, general refactoring#3016
cconstable wants to merge 1 commit into
mainfrom
extstore/foundation

Conversation

@cconstable

@cconstable cconstable commented Aug 18, 2026

Copy link
Copy Markdown
Contributor

What was changed

  • Renames ExternalStorageMessageTransformer to ExternalStorage.
  • Adds a DataConverter decorator, ExternalStorageResolvingDataConverter, that does the external storage work and delegates to the existing data converter for everything else.
    • This means we defer extstore operations until values are actually needed (e.g. fromPayload). We don't eagerly load them.
    • This was implemented as a decorator because the existing data converter is used in the workflow sandbox (and extstore shouldn't be in there).

Why?

These changes support the following PRs:

  1. Workflow worker integration External Storage Integration: WorkflowWorker, replay, history #3017
  2. Nexus worker integration External Storage Integration: NexusWorker #3018
  3. Activity worker and client integration External Storage Integration: Activity worker, client #3020
  4. E2E extstore tests

Checklist

  • Added tests

@cconstable
cconstable force-pushed the extstore/foundation branch from 3fe47fb to 831c284 Compare August 18, 2026 21:03
private boolean allowActivityHeartbeatDuringShutdown;
private String workerControlTaskQueue;
private PreferredVersionProvider preferredVersionProvider;
private @Nullable ExternalStorage externalStorage;

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This doesn't have any callers in this PR but three of the PRs that build off this will use it. Included it here since those PRs are being up together.

…former to ExternalStorage, create a lazy extstore resolving data converter.
@cconstable
cconstable force-pushed the extstore/foundation branch from 831c284 to 460bfbf Compare August 19, 2026 17:40
@cconstable cconstable changed the title refactor(extstore): general extstore refactoring. rename MessageTransformer to ExternalStorage, create a lazy extstore resolving data converter. External Storage refactoring for workflow, activity, client, and nexus integration Aug 19, 2026
@cconstable cconstable changed the title External Storage refactoring for workflow, activity, client, and nexus integration External Storage Integration: general refactoring Aug 19, 2026
@cconstable cconstable changed the title External Storage Integration: general refactoring External Storage Integration: Lazy resolving references, general refactoring Aug 19, 2026
@cconstable
cconstable marked this pull request as ready for review August 19, 2026 18:57
@cconstable
cconstable requested a review from a team as a code owner August 19, 2026 18:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant