Skip to content

[spark] Support EXTRACT in Spark 4.2 Ossie semantic views - #11295

Open
QuakeWang wants to merge 1 commit into
apache:masterfrom
QuakeWang:spark42-extract
Open

QuakeWang wants to merge 1 commit into
apache:masterfrom
QuakeWang:spark42-extract

Conversation

@QuakeWang

Copy link
Copy Markdown
Member

Purpose

The Spark 4.2 Ossie expression allowlist rejects EXTRACT during query analysis, so models that declare date-part dimensions cannot be queried. Translate EXTRACT(YEAR|MONTH|DAY FROM date_expr) to Spark's built-in date functions so MEASURE queries can group by integer date parts.

Tests

All 51 Spark 4.2.1 connector tests passed. Maven verify and the documentation build passed.

The Ossie expression allowlist rejects EXTRACT during query analysis.
Map YEAR, MONTH, and DAY in the standard FROM form to Spark builtins
so Ossie models can group measures by integer date parts.

Signed-off-by: QuakeWang <wangfuzheng0814@foxmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant