I think you definetely shouldn't have thinned your herd until you knew which ones where male or female...
Going with the healthiest, most vigorous plants is fine if your going from clone, because you know the sex already. From seed, as you've found out, the biggest, most vigorous plants usually are male....
sorry that only a bunch of dudes showed up at your party...

Better luck next time

f