Putting perlite in place of soil

I want to use 5 gallon buckets but im not sure if im going to need all 5 gallons of soil. Can i Just put a gallon of perlite in the bottom of the bucket and then use 4 gallons of soil on top of that?

Mix the perlite up in the soil. There is no question about that.