Syilla “
Our prophet Muhammad did not start the direction of Jerusalem, It started earlier from Prophet Abraham”.
It is my understanding that the book of Daniel contains the first reference to praying toward Jerusalem:
http://www.biblegateway.com/passage/?search=daniel%206:10&version=31
Daniel 6:10
10 Now when Daniel learned that the decree had been published, he went home to his upstairs room
where the windows opened toward Jerusalem.
Three times a day he got down on his knees and prayed, giving thanks to his God, just as he had done before.
Perhaps I am wrong.
Many Prophets of God, more specifically the Children of Israel prayed in or towards the direction of the Temple of Solomon (Masjid Al-Aqsa.) This continued all the way till the time of Jesus son of Mary (peace be upon him.)
To answer the question more specifically, Prophet Abraham built the Ka'bah with his son Ishmael as a house of worship - where people would praise God and worship Him without associating partners with Him. The arabs recognized this clearly as they were his descendants, however they started to worship idols, which were introduced much later (maybe thousands of years later) after Prophet Abraham by a man called 'Amr ibn Luhay al-Khuzaa'i. This is the first time idols were worshipped at that house of worship in Makkah.
The Prophet (peace be upon him) was ordered by Allah to turn towards the direction of the Temple of Solomon during the early stages of his Prophethood. This signified in an indirect way that he was a Messenger, like the Messengers of old, calling to the worship and obedience of God Alone. It signified that he had departed from the ways of the polytheists.
As time progressed, the Jews and Christians disbelieved in Muhammad (peace be upon him) as the Messenger of God, although there were and still are irrefutable evidences from their own scriptures which signify his Prophethood. However, they rejected him.
Due to the fact that he really desired to pray towards the Ka'ba which Prophet Abraham (peace be upon him) had built, Allaah allowed him to turn towards that as a qibla;
Verily! We have seen the turning of your (Muhammad's - peace be upon hims) face towards the heaven. Surely, We shall turn you to a Qiblah (prayer direction) that shall please you, so turn your face in the direction of Al-Masjid- al-Haram (at Makkah).
And wheresoever you people are, turn your faces (in prayer) in that direction. Certainly, the people who were given the Scriptures (i.e. Jews and the Christians) know well that, that (your turning towards the direction of the Ka'bah at Makkah in prayers) is the truth from their Lord. And Allah is not unaware of what they do.
[Qur'an Al Baqarah 2:144]