No action on harvest worker shortage frustrates peak industry body