i would mix in some perlite for drainage. Make sure it is fully composted to that you dont get nutrient burn. Worm castigns are a good fert for little plants as they keep them healthy and dont burn. Real good with the bacteria too, so is compost. Did you buy a big bag? Those bags are diferent from that full black rich compost! I would mix some soil too.
IDk, what others will say, I bet you could but for a better mix add that other stuff