So far I have discover Aldi is awesome for organic things like tomato paste and butter (ok no butter allowed but for general primal eating). They also have big bags of almonds, walnuts etc quite cheaply and I always seem to score fruit and vege bargains there.
Aldi does a range of grass fed beef
Coles and Safeway are both stocking coconut oil now, and Safeway has started stocking Kale and baby kale.
If you have a Bushy Park fruit and veg near you they have good organic eggs