what you can do is bother to store them.. then place again, so as not to waste energy on collecting something you have maxed just to make an arrow disappear. at least for awhile until the next collection you can admire them.
I know it's a miserable solution on removing an arrow that's in the wrong place.. but satisfying results. lol!