It is believed without knowing why

Since the earth orbits the sun from east

Since we are near to eastern regions

As per Surya Upanishad, it is said that God reside in the rays of the Sun, to obtain the maximum benefit of rays when performing any noble deeds & ceremonies, the vedas direct that one must sit facing east direction