You can do either. Back before they implemented the heirloom gear from heroic badges I used the shards from dungeons to buy the WG shoulders for my druid. A few weeks ago I went ahead and bought the chest piece and the staff with heroic badges.
In hindsight I probably should have spent the badges on my T8.5 helm first, but I have it now so it's all good.
