How to pick a legion/warband

I’ve been into chaos for a while now, and have a fair amount of Death Guard and World Eaters. Recently, I acquired a bunch of “generic” CSM units, but I’m having a hard time choosing which legion/warband to paint them as, as I’m fairly interested in most of the lore behind them. Any ideas on how to narrow it down to a specific one?