def _text_reader(text_file, multiple=False):
  """Yields lines from the text file.

  Performs lowercasing and white-space tokenization on each line before
  returning.

  Args:
    text_file: String filename.
    multiple: Whether multiple references / generations are expected in a line.
  """
  with io.open(text_file) as f:
    for line in f:
      if multiple:
        yield [item.lower().split() for item in line.strip().split("\t")]
      else:
        yield line.strip().lower().split()
Yields lines from the text file.

  Performs lowercasing and white-space tokenization on each line before
  returning.

  Args:
    text_file: String filename.
    multiple: Whether multiple references / generations are expected in a line.
  
language/table_text_eval/table_text_eval.py