1 Introduction

2 Evaluating NLP Systems  
2.1 Intrinsic vs Extrinsic Evaluations  
2.2 General Purpose vs Task Specific Evaluations  
2.3 Probing Deep Learning NLP Models

3 Recognizing Textual Entailment  
3.1 Entailment as a Downstream NLP Task

4 Revisiting RTE as an NLP Evaluation  
4.1 Automatically Created  
4.2 Semi-Automatically Created  
4.3 Manually Created

5 Recommendations

6 Conclusion