Turn smart shuffle on and play songs from search not from your liked songs playlist. Works every time for me. You will not be able to escape the popular songs though lol record labels be paying for those to always be queued
Ever notice that Spotify only shuffles the 40 songs youve been listening to? That's by design and you can turn it off to actually randomly shuffle ur whole library