Skip to content

[ENH] Make Parquet downloads configurable - #1752

Open
Jayant-kernel wants to merge 1 commit into
openml:mainfrom
Jayant-kernel:feature/configurable-parquet-skip-1743
Open

Jayant-kernel wants to merge 1 commit into
openml:mainfrom
Jayant-kernel:feature/configurable-parquet-skip-1743

Conversation

@Jayant-kernel

Copy link
Copy Markdown

Metadata

Details

This adds a persistent skip_parquet configuration option for dataset downloads. When enabled, datasets use the ARFF download path even when a Parquet URL is available.

The existing OPENML_SKIP_PARQUET environment variable remains supported. Both dataset download paths now use the same configuration check so the behaviour is consistent.

Tests cover loading skip_parquet from the config file and confirm that the dataset download path skips Parquet and falls back to ARFF when the option is enabled.

@codecov-commenter

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 81.33%. Comparing base (fabbc28) to head (b9c36a4).

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1752      +/-   ##
==========================================
- Coverage   81.50%   81.33%   -0.18%     
==========================================
  Files          63       63              
  Lines        5240     5239       -1     
==========================================
- Hits         4271     4261      -10     
- Misses        969      978       +9     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[ENH] Allow change of OPENML_SKIP_PARAQUET_ENV_VAR config

2 participants