For fishing, I do not need to leave because I can see flower in the pond during several fishing.
But for mining, I need to leave because the moss only appear when I leave the mine. So after one mining, I always leave to see I get the moss or not. And repeat to enter the mine again.