You can actually influence that! All you have to do is remove recommended content by selecting "Not interested" on your home page, this will influence how YouTube suggests videos to you in the future. Here's more about managing your recommendations: https://yt.be/help/cJiM
But that's the thing we want the music and the other videos but not ONLY the music so not interested isn't really the best option. The system needs to shuffle better. IMO