I lost 425 gems a couple days ago by accidentally hitting a weekly dropper who had 4 or 5 days left.
I'm not sure how the event took gems away. I ended up quitting before I got very far because I could see the writing on the wall - that I wouldn't be able to finish.