I turned my 2x2x4 into a veg/clone area which includes my 2 5gal buckets. The light is annoying as hell so I don't look in there more than once a day or so but each time there's more and more damn aphids. Pretty sure these buckets are filled with eggs. Beat dude..
If the plants are still in veg, why not figure out a way to spray the plants off with some water for a minute or two, make sure the container is ready to be watered first then your good to go, I realize drenching a plant isn't an option for everyone sometimes there is nowhere to spray the plant off without someone seeing etc.
But if you can try and drown the majority of the aphids by soaking them from the undersides of the leaves, then just put a little dab or two of vegetable oil on the main stalk just make sure none will drip down into the dirt.
You can also tie on a rubber band and wrap a little ring like upside down bowl shape out of some aluminum foil to where it deflects the bugs downs after they reach this point where the aluminum is lightly fastened to the stalk with a band, most bugs turn back around once they reach the foil. If your very careful you might be able to wrap some bug strip around the stalk also, just be cautious of that area come harvest time.
I've had success with the 3 gal pump sprayers w/ hose nozzle they sale at the hardware stores for weed control, the pressurized water lifts the bugs from their bearing attachment to the plant and flings them off onto the ground, plus the pump sprayer doesn't drench the soil of the plant as badly if your worried about over watering or whatever because of it, just tip the plant on its side just a bit, hopefully without shifting the soil too much and the just spray her down for a minute or two at a time, gotta try and drench the bugs so that they let go, the pressurized water prys them off.
If you choose to you can also use like 60-80%water 20-40% rubbing alcohol if you'd like a little extra sterilization, but you must have a back up sprayer to rinse off the alcohol, if it sits for more than like 90 seconds it can burn the leaves, plus maybe put a towel down around the base of the pot to catch any overspray, and just don't let it reach the dirt much if it's got alcohol in it. I'd take the towel and immediately throw in the washer if you are able in you use one to catch the bugs as the fall from the leaves.
I've had aphids bad in a greenhouse and used to let the pots dry out then I'd, take all the plants outside, these were in 2 gallon containers and pepper plants at the time, but still, and I used a water hose from the house for like 120 plants, and I'd just soak each plant for about 90 seconds spraying underneath, sides, top, everywhere then I'd let them sit, I'd let them chill for about 20 mins while I did batches of about 40 plants at a time, then I'd drench the leaves again 90seconds or so and then I would let them drip dry and place them back out into the greenhouse, more than two soakings will harm or stunt your growth I found, this was back when we had abnormally cold temps that year for the first part of spring and I had to keep the bugs down until they could be planted outdoors, the plants were like 100 days from seeds that year before they found their way into the ground, had some nice productive plants that year though, they flowered out in their containers, but I plucked every flower until about one week before setting them out in the garden, this allowed for the roots to really take off once they were placed in the dirt, I also plucked a few pollinated flowers while they were young for about a week after they were placed into the garden, really helps the vegative side of things and helps the roots make a good anchor for themselves before the fruit start to develop.
Sorry I went a bit off topic there, it's late I'm bored, oh well. Cheers.