It would help if the arrow was glowing (slowly pulsing red or something) every time you obtained a new one of the respective items in there. This notification would then be deactivated again upon opening the menu.
That would make it more noticeable and teach players where to find it in the future, but still keeps it out of the way for most of the time, to not unnecessarily clutter the UI.