Ears when wearing a flat cap?

Do your ears go inside or outside of your hat when wearing a flat cap? They say outside but when i wear it like that my ears pop out like im an elf. Wtf do i do? And if i do wear my ears inside will it be a big deal/ easily noticable?