Catholic League took time to build its reputation