From 312922e7fc044a45064de74b8a79c9631c8d16d5 Mon Sep 17 00:00:00 2001 From: "dependabot[bot]" <49699333+dependabot[bot]@users.noreply.github.com> Date: Wed, 14 Oct 2026 21:50:12 +0000 Subject: [PATCH 1/2] build(deps-dev): Bump dev.hardwood:hardwood-core Bumps [dev.hardwood:hardwood-core](https://github.com/hardwood-hq/hardwood) from 1.1.0.Beta1 to 1.1.0.Beta2. - [Release notes](https://github.com/hardwood-hq/hardwood/releases) - [Changelog](https://github.com/hardwood-hq/hardwood/blob/main/release-test-settings.xml) - [Commits](https://github.com/hardwood-hq/hardwood/compare/v1.1.0.Beta1...v1.1.0.Beta2) --- updated-dependencies: - dependency-name: dev.hardwood:hardwood-core dependency-version: 1.1.0.Beta2 dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] --- pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pom.xml b/pom.xml index 754475a2..aefaf5a7 100644 --- a/pom.xml +++ b/pom.xml @@ -65,7 +65,7 @@ 4.4.0 - 1.1.0.Beta1 + 1.1.0.Beta2 1.37 1.5.7-22 From b4bab38516fbea84e0e7a1a4e65909767ae0d484 Mon Sep 17 00:00:00 2001 From: Davide Angelocola Date: Fri, 16 Oct 2026 20:55:59 +0200 Subject: [PATCH 2/2] test: adapt to hardwood 1.1.0.Beta2, drop the #1380 oracle-skip notes Beta2 rejects a DECIMAL with scale > precision, so the unsupported-annotation test swaps its arguments; the long page-header statistics read fix (#1380) shipped, so the 14 'oracle cannot read' comments and doc sentence go. Co-Authored-By: Claude Sonnet 5 --- docs/compatibility.md | 3 +-- .../test/resources/raincloud/expected-status.csv | 14 -------------- .../dfa1/vortex/parquet/ParquetImporterTest.java | 2 +- 3 files changed, 2 insertions(+), 17 deletions(-) diff --git a/docs/compatibility.md b/docs/compatibility.md index bf91e69b..78b5a2e6 100644 --- a/docs/compatibility.md +++ b/docs/compatibility.md @@ -100,8 +100,7 @@ distinguishing "blocked on a credential" from plain `untriaged`). A scheduled wo (`raincloud-conformance.yml`) hydrates a size-capped subset weekly. Current triage — 252 `ok`, 0 known gaps, 33 `missing_auth`, 145 untriaged (mostly large datasets and the `tpcgen-rs-*` family, which needs `tpcgen-cli` to build). On the v0.3.0 corpus, 172 hydrated -datasets match their Parquet sibling exactly; 14 more report as skipped because the oracle -(hardwood 1.1.0.Beta1) cannot read their Parquet files (hardwood#1380, fixed upstream). Every gap found so far is fixed +datasets match their Parquet sibling exactly. Every gap found so far is fixed ([#206](https://github.com/dfa1/vortex-java/issues/206)–[#211](https://github.com/dfa1/vortex-java/issues/211), [#215](https://github.com/dfa1/vortex-java/issues/215)–[#217](https://github.com/dfa1/vortex-java/issues/217), [#221](https://github.com/dfa1/vortex-java/issues/221), diff --git a/integration/src/test/resources/raincloud/expected-status.csv b/integration/src/test/resources/raincloud/expected-status.csv index 5826b4b2..cebd8a93 100644 --- a/integration/src/test/resources/raincloud/expected-status.csv +++ b/integration/src/test/resources/raincloud/expected-status.csv @@ -26,7 +26,6 @@ airbnbopendata,missing_auth amazon-reviews-2023-subscription-boxes,ok ampds-whe,ok anthropic-economic-index,ok -# oracle: hardwood 1.1.0.Beta1 cannot read this raincloud v0.3.0 parquet (long page-header statistics, hardwood#1380, fixed upstream but unreleased), so it reports as skipped anthropic-hh-rlhf-helpful-base,ok anthropic-interviewer,ok appian-address,ok @@ -92,7 +91,6 @@ bi-uberlandia,ok bi-uscensus,untriaged bi-wins,ok bi-yalelanguages,ok -# oracle: hardwood 1.1.0.Beta1 cannot read this raincloud v0.3.0 parquet (long page-header statistics, hardwood#1380, fixed upstream but unreleased), so it reports as skipped bigscience-p3-eval-subset,ok # kaggle auth login / KAGGLE_API_TOKEN building-permit-applications-data,missing_auth @@ -106,13 +104,11 @@ cardiovascular-diseases-risk-prediction-dataset,ok # Fixed upstream on main (hardwood-hq/hardwood#1104, milestone 1.1.0.Beta2; our reproducer landed # as their regression test in #1381), so the bump to Beta2 should make this slug assert for real # again — drop this comment then, and if it still aborts, the blocker is a new one. -# oracle: hardwood 1.1.0.Beta1 cannot read this raincloud v0.3.0 parquet (long page-header statistics, hardwood#1380, fixed upstream but unreleased), so it reports as skipped chess,ok clickbench-hits,untriaged cnn-dailymail,ok codeparrot-clean-valid,ok cohere-wikipedia-simple-embed,untriaged -# oracle: hardwood 1.1.0.Beta1 cannot read this raincloud v0.3.0 parquet (long page-header statistics, hardwood#1380, fixed upstream but unreleased), so it reports as skipped coig,ok # kaggle auth login / KAGGLE_API_TOKEN coronahack-chest-xraydataset,missing_auth @@ -123,7 +119,6 @@ covid-world-vaccination-progress,ok covid19-data-from-john-hopkins-university,missing_auth # kaggle auth login / KAGGLE_API_TOKEN crimes-in-boston,missing_auth -# oracle: hardwood 1.1.0.Beta1 cannot read this raincloud v0.3.0 parquet (long page-header statistics, hardwood#1380, fixed upstream but unreleased), so it reports as skipped databricks-dolly-15k,ok dbpedia-embeddings,untriaged diabetes-health-indicators-dataset,ok @@ -168,7 +163,6 @@ emotions-dataset-for-nlp,ok fhv_tripdata_2025,ok fhvhv_tripdata_2025,untriaged finemath-4plus,untriaged -# oracle: hardwood 1.1.0.Beta1 cannot read this raincloud v0.3.0 parquet (long page-header statistics, hardwood#1380, fixed upstream but unreleased), so it reports as skipped finepdfs-en-test,ok finetranslations-swedish,ok fineweb-2-swedish,untriaged @@ -193,13 +187,11 @@ gtsrb-german-traffic-sign,ok hacker-news,untriaged heart-disease-health-indicators-dataset,ok hellaswag,ok -# oracle: hardwood 1.1.0.Beta1 cannot read this raincloud v0.3.0 parquet (long page-header statistics, hardwood#1380, fixed upstream but unreleased), so it reports as skipped helpsteer2,ok hotel-booking-demand,ok hotpotqa-fullwiki,ok # kaggle auth login / KAGGLE_API_TOKEN housing-prices-dataset,missing_auth -# oracle: hardwood 1.1.0.Beta1 cannot read this raincloud v0.3.0 parquet (long page-header statistics, hardwood#1380, fixed upstream but unreleased), so it reports as skipped humaneval,ok imdb-job-aka-name,ok imdb-job-aka-title,ok @@ -238,14 +230,11 @@ loan-default-dataset,missing_auth lung-cancer,ok marketing-data,ok mbpp,ok -# oracle: hardwood 1.1.0.Beta1 cannot read this raincloud v0.3.0 parquet (long page-header statistics, hardwood#1380, fixed upstream but unreleased), so it reports as skipped medmcqa,ok # kaggle auth login / KAGGLE_API_TOKEN mlcourse,missing_auth -# oracle: hardwood 1.1.0.Beta1 cannot read this raincloud v0.3.0 parquet (long page-header statistics, hardwood#1380, fixed upstream but unreleased), so it reports as skipped mmlu,ok mmlu-pro,ok -# oracle: hardwood 1.1.0.Beta1 cannot read this raincloud v0.3.0 parquet (long page-header statistics, hardwood#1380, fixed upstream but unreleased), so it reports as skipped mmmlu,ok mmmu,untriaged mnist,ok @@ -254,14 +243,12 @@ movies,ok new-york-city-airbnb-open-data,missing_auth news-headlines-dataset-for-sarcasm-detection,ok nips-papers,ok -# oracle: hardwood 1.1.0.Beta1 cannot read this raincloud v0.3.0 parquet (long page-header statistics, hardwood#1380, fixed upstream but unreleased), so it reports as skipped no-robots,ok nyc-311,ok nyc-parking-tickets,ok # fails to hydrate on raincloud v0.3.0: nyc.gov returns HTTP 403 for the rolling-sales download nyc-property-sales,ok nypd-complaints,ok -# oracle: hardwood 1.1.0.Beta1 cannot read this raincloud v0.3.0 parquet (long page-header statistics, hardwood#1380, fixed upstream but unreleased), so it reports as skipped oasst1,ok open-food-facts,untriaged openlibrary-authors,ok @@ -295,7 +282,6 @@ pleias-synth,untriaged pubmedqa-labeled,ok sf-salaries,ok slimpajama-6b,untriaged -# oracle: hardwood 1.1.0.Beta1 cannot read this raincloud v0.3.0 parquet (long page-header statistics, hardwood#1380, fixed upstream but unreleased), so it reports as skipped squad-v2,ok stack-overflow-2018-developer-survey,ok stackoverflow-badges,ok diff --git a/parquet/src/test/java/io/github/dfa1/vortex/parquet/ParquetImporterTest.java b/parquet/src/test/java/io/github/dfa1/vortex/parquet/ParquetImporterTest.java index 6bbe278a..db013ff1 100644 --- a/parquet/src/test/java/io/github/dfa1/vortex/parquet/ParquetImporterTest.java +++ b/parquet/src/test/java/io/github/dfa1/vortex/parquet/ParquetImporterTest.java @@ -158,7 +158,7 @@ void byteArray_unsupportedAnnotation_stillThrows() { // Given — a BYTE_ARRAY annotation that is neither string-like nor absent (e.g. // DECIMAL) must not be silently downgraded to raw Binary, losing its semantic ColumnSchema schema = col("amount", PhysicalType.BYTE_ARRAY, RepetitionType.REQUIRED, - new LogicalType.DecimalType(2, 10)); + new LogicalType.DecimalType(10, 2)); // When / Then assertThatThrownBy(() -> ParquetImporter.mapDType(schema))