def DecodeTokens(self, Tokens):
        """converts sentencepiece tokens to a text string"""
        if isinstance(Tokens, Tokenization):
            Tokens = Tokens.tokenization
        return self.sp.DecodeTokens(Tokens)
converts sentencepiece tokens to a text string
megatron_lm/megatron/deprecated_data_utils/tokenization.py