High spectral efficiency access system using QAM and optical SSB