It might require a certain gathering level to gather them. There are some south of Archer Guard Post, near a patch of Violet flowers. I just gathered them and got Knowledge on them.
Try the ones that aren't just a decoration :') Like near Lake Flondor node or all around Navarn Steppe.
Edit: I'm quite sure you can't pick up the ones that some of main quest pointers indicate near Polly's Forest.