It is the most important day on the Hindu calendar, but without a temple in the city, Krisna Roy and his wife Sadhana Adhikary will celebrate alone.
Friday marked the 'Janmashtami' - the birthday of Hindu deity Krishna.
"We start our day praying, but we have no place to do that together," Mr Roy said.
"We fast all day. In Bangladesh, the day is a government holiday, it is a big day with a big festival where we go from temple to temple, praying and singing together, wearing colourful clothing."
For Mr Roy, each day begins with an offering of fruit and water to Vishnu and Krishna. Where once the shrine would have filled a small room in the home, now Mr Roy says his prayers inside a small cupboard.
"There are only four Bangladeshi Hindu families in Wagga, I know them all. We meet together, but only in my house," Mr Roy said.
With so few families across the city, Mr Roy admits that the situation is adequate right now. But eventually, the population will grow.
"We need to have a place we can go weekly or daily so we can pray together," Mr Roy said.
A similar situation afflicts Wagga's growing Muslim community. Without a mosque or Islamic purpose centre, they meet inside a multipurpose building at Charles Sturt University.
"The centre is only meant for students and staff [of the university], so five times a day we pray," said Dr Ata-ur Rehman, former Muslim association chairperson.
But once a week, the city's entire Muslim population are invited to pray.
"On a Friday it can be quite cramped [when] 80 or 90 people are there," Dr Rehman said.
Having now procured land to build an Islamic Centre, the hope is that in a few years, the community will have a purpose-built place of worship.
"The place we have now, we are happy with it. But we would love to have a place that is more specific. It's in the pipeline, and not urgent [since] we're only a couple of hundred members right now," said Dr Waseem Afzal, current-serving chairperson of the association.