def f1_score_multiple(predictions):
  """Calculate word level F1 score across multiple predictions."""
  all_f1 = []
  for i, pred1 in enumerate(predictions[:-1]):
    for pred2 in predictions[i + 1:]:
      all_f1.append(f1_score(pred1, pred2))
  return all_f1
Calculate word level F1 score across multiple predictions.
language/bert_extraction/steal_bert_qa/utils/evaluate_squad.py