is that "real" compost?
or the crappy tree chunks they sell as compost?
if it's real grass/leaf compost you can sub out the castings for that (not ideal, but possible)
remember that pretty much all real compost is comprised of a lot of worm castings, well, I guess that depends, but most of the time.
i'd add a lil either manure or fish meal for another source of nitrogen, neem is slow release and not super high in available nitrogen.