You're always going to encounter some phrases and words you don't understand. Native speakers do too! Rather than worrying about it and wasting time with it, continue getting more input and you'll learn what you're ready to learn. Find easier input if it happens too often.