I. INTRODUCTION  
A. Cognitive Radio Networks  
B. From Model-Based Network Management to Model-Free Strategy Learning  
C. A Brief Review of the Existing Survey Works on Learning in CRNs  
D. Organization of the Paper  

II. BACKGROUND: MODEL-FREE LEARNING IN THE DOMAINS OF DISTRIBUTED CONTROL AND GAME THEORY  

III. APPLICATIONS OF SINGLE-AGENT-BASED LEARNING IN COGNITIVE WIRELESS NETWORKS  

IV. APPLICATIONS OF LEARNING BASED ON LOOSELY COUPLED MULTI-AGENT SYSTEMS  

V. APPLICATIONS OF GAME-BASED LEARNING IN COGNITIVE WIRELESS NETWORKS  

VI. CHALLENGES AND OPEN ISSUES IN MODEL-FREE LEARNING FOR COGNITIVE RADIO NETWORKS  

VII. CONCLUSION