def convert_by_vocab(vocab, items):
    """Converts a sequence of [tokens|ids] using the vocab."""
    output = []
    for item in items:
        output.append(vocab[item])
    return output
Converts a sequence of [tokens|ids] using the vocab.
training/DeepSpeed-Domino/megatron/tokenizer/bert_tokenization.py