You can get feathers by leaving flower petals on the bird feeders in the Flying L.
NOTE: For 6 months, it has been broken so that you can't get flamingo feathers. It looks like you get them, but nothing is added to your inventory. So it only works for getting fire feathers currently.
But try one of each kind of flower petal, and if I'm wrong and it now works, we can all celebrate.