I need advice on how to create a train-test-split with a small data set of correlated time series to predict historical values.
My data consists of 30 different time series covering each 4000 periods, which are spatially and temporally correlated (e.g. GDP in different countries, measured daily across several years). I do not want to predict future values but compute predictions across the time series (e.g. predict GDP for a country given other countries). Based on my understanding, the best validation strategy would be leave-one-out nested cross-validation.
However, I have been asked by my supervisor also to implement a train-test-split in the most classical way (e.g. to fully put a few of the time series completely away as a test set.). How do I choose these time series? Randomization does not seem to make sense, given the small sample, and I am unsure how to do stratification in this context... Would be thankful for any advice!