def DecodeTokens(self, Tokens):
        """just concatenates ascii tokens into text"""
        if isinstance(Tokens, Tokenization):
            Tokens = Tokens.tokenization
        return ''.join(Tokens)
just concatenates ascii tokens into text
megatron_lm/megatron/deprecated_data_utils/tokenization.py