Not sure if during the time we have to slay beasts we will be receiving drops of WitchDust. As on Chapter 4 and previous... we can collect WitchDust only when Adventure is in course.
Maybe all will be different on Chapter 5 and 7 as reports have stated.. but in the meantime do suggest to stock up while doing Chapter Adventures as has been suggested. As you said.. that way you're prepared.