Upgrading the carousel increases the chance to spawn the goose and the Silver Ticket exchange also has a chance to spawn the ugly goose (in addition to getting other items). You can get additional feathers from the Bronze or Silver Ticket exchange and as a reward for completing the Gumptious Geese goal.