Earlier the Raj Bhavan, the official residence of the Governor of Gujarat, was at Ahmedabad. It continued as so till 1978. The building where the Raj Bhavan was housed was one of the many interesting architectural buildings of the city. The imposing palatial mansion on the bank of the river Sabarmati presented a grand and picturesque view. It provided the locale and the inspiration to Late Rabindranath Tagore, the Poet Laurate for his famous story the (The Hungry Stones).'' The Poet had lived here in 1878 with his brother Late Satyendranath who was then the District Judge of Ahmedabad and the first Indian I.C.S. According to Gurudev Tagore's ''Reminiscences'' many tunes of the songs of the young poet were composed during his walks on the broad terrace at the back of the main building.
The main structure of the Raj Bhavan set in an area covering about 11 acres then was once a royal mansion surrounded by a royal garden [Bag-i-Shahi], popularly known as Shahi Bag, spread in an area of 105 bighas (52 acres). The royal palace and the garden were constructed in 1621-22 as a relief project following the famine by Shah Jahan, the then Mughal Subedar (Governor) of Gujarat, who later on became the Emperor of India.
After the Independence in 1947, the building became the residence of the Commissioner of the Ahmedabad Division in the former Bombay State. It was converted into the Raj Bhavan when the separate State of Gujarat was formed in 1960. It was in fact one of the smallest official residences that a Head of the State occupied in the country. It continued to be so till 1978.