[AchillesPunks]

This is the standard behavior

Hi Fuchs2468, thanks for the info. Out of curiosity, I'll take a closer look at how I have things setup. 
I think everything I have on the homescreen are playlists I have created.
The amount of widgets in combination with the 'sort order' function at the end of the playlists setup, might be what is taking a lot of time in my case. 
I usually have the 'sort order' set to 'last played'. Selecting something more stationary (sort 'date added or title' for example) is probably less work for the refresh to perform.

In Skin Helper Service Widgets, I also have Aggressive Refresh of Widgets enabled.

One more thing to check is inside the playlist.xml itself. Check and make sure the playlist you are selecting are not set as random INSIDE the XML and NOT the SKIN.