Do you want to be involved in the design of avionics? If so, you really need to get a degree in electronics with plenty of computer science thrown in. A typical college EE course should also provide enough physics background to get the grounding in basic aerodynamics you'd need, since modern avionics is a broad field that includes all sorts gadgets.