I know what your are saying, I keep mine around 4-6 females depending on the strain. You should take atleast one clone from each plant that way if you find your "holy grail" of plants you won't have lost your gentics. You won't know how good the smoke is until your have smoked it.
Plus working from clones if your wanting to grow like two big bushes you will save yourself like a month of veg time, plus you dont have to waste the time, soil, nutes on male plants. Just some food for thought.