That is how the regulation reads -- no ifs, ands, or buts other than the emergency exception or not being "in an area where air traffic control is exercised," and that's all A, B, C, D, and E space, plus the G-space where there's a tower with no B/C/D/E-space (yes, there are a few, and I suspect that's why they phrased it that way rather than just "in controlled airspace").