On the spectrum of Farey and Gauss maps