def crawl_urls(self) -> List[str]:
        """Crawls all the urls from given domain."""
        self.visited = []

        fetched_urls = self.fetch_url(self.start_url)
        return list(set(fetched_urls))
Crawls all the urls from given domain.
llama-index-integrations/readers/llama-index-readers-mangoapps-guides/llama_index/readers/mangoapps_guides/base.py