I. Introduction  
II. Markov Decision Processes  
A. The Markov Decision Process Framework  
B. Solutions of MDPs  
C. Extensions of MDPs and Complexity  
III. Data Exchange and Topology Formulation  
IV. Resource and Power Optimization  
V. Sensing Coverage and Object Detection  
VI. Security and Intrusion Detection  
VII. Custom Applications and Systems  
VIII. Future Trends and Open Issues  
IX. Summary