I felt really sorry for you! The first thing you should do is to communicate with him, see whether you two can find a workable schedule. If he is stubborn and unwilling to compromise, you might check how much you can compromise. If it is impossible or too hard to reach an agreement, you should think about changing your job, because you won't be happy in this job and he isn't a wise boss to work for. At least give it a try. For future job, be sure to check with the boss how tolerant he could be with versatility. We spend so much time on work and we deserve to be happy.

Actually my boss is exacly opposite. He is late and likes to give me projects very late of the day. At the beginning I felt unwilling to acommodate him by coming late and leaving late. Now comparing with you, I felt lucky.