Here is a recent article in webupd8.org that explains how to use youtube-dl to directly download audio instead of first downloading video+audio and then extracting audio using -x.
https://askubuntu.com/questions/423508/can-i-directly-download-audio-using-youtube-dl



