The mosque, built in 1728 during the Dutch Occupancy, is the oldest mosque in the country. Its unique architectural style is a unique blend of Sumatran, Hindu and Western architecture.

All of the building's original wooden structures except the four main pillars and the roof structure were replaced with concrete. Within the mosque compound, you can find the grave of Sayyid Abdullah Al-Haddad, a famous religious teacher, whom many regarded as a "Wali" (Saint).

A good way to see the Kampung Hulu Mosque is to include it as part of your walking tour of nearby Jonker Street. The Mosque is set just one street back from the famous street.