You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
To support TB+ scale datasets, we should have a row sub-sampling parameter in the Tree Featurizer.
Why TreeFeat? The Tree Featurizer learns the feature interactions on a sub-set of the dataset. The leaves output of Tree Featurizer is then sent to a linear model (SDCA/AP/etc) which is scalable to TB scale datasets.
Gain:
This provides an end-to-end solution for scalable learning. You get the accuracy of the Tree model plus the streamability of the linear model.
Request:
Provide a subsample parameter for TreeFeat
Inside TreeFeat run the TrainTestSplit to get the correct subsample percent
Other solutions:
TrainTest split to create a sub-sample of the dataset before TreeFeat, and train TreeFeat on this subsample. This fails in CV since you need a singular dataview to train on.
Shuffle + Take. This fails since our shuffle is block-wise; the 1st 4k rows are shuffled against each other, then the next 4k rows are independently shuffled against each other. This leads to the Take only receiving rows from the top of the file. Also fails in CV.
Generate + RangeFilter. We hid our Generate transform. Also fails in CV.
We would like to use the TreeFeat plus a streamable Linear model in AutoML to provide a good model to the user on datasets larger than RAM.
Triage: We do not see a high demand for this feature, and we don't have capacity to work on it at the moment. In case this becomes a blocking case for some real-world scenario, please let us know.
Activity
matouskozak commentedon Oct 23, 2026
Triage: We do not see a high demand for this feature, and we don't have capacity to work on it at the moment. In case this becomes a blocking case for some real-world scenario, please let us know.