Tried freezing it then quickly heating just the brass? What are you heating it with? It's probably "welded" due to galvanic reaction between the aluminum (or aluminium) and the brass. Heating the brass only may enlarge hole enough to gently twist it out. Aluminum gets soft - real soft - at 435F. Wrap a wet cloth or chamois around the aluminum to keep it cooled.