There is green/grey fungus growing in my grow bag?

Anything other than white mycelium is most certainly contamination, somewhere during the process your bag has become contaminated, unfortunately the bag is ready for the compost heap. This is a part of mushroom growing and can be quite common if your grow room/grow area is not sterile (surfaces/air particles/pet hairs etc)