[1] Gocgun, Y., & Puterman, M. L. (2014). Dynamic scheduling with due dates and time windows: an ap- plication to chemotherapy patient appointment book- ing. Health Care Manag Sci., 17, 60-76.

[2] Green, L. V., Savin, S., & Wang, B. (2006). Manag- ing Patient Service in a Diagnostic Medical Facility. Operations Research, 54, 11-25.

[3] Cardoen, B., Demeulemeester, E., & Belien, J. (2010). Operating room planning and scheduling: A liter- ature review. European Journal of Operational Re- search, 201, 921-932.

[4] Hulshof, P., Kortbeek, N., Boucherie, R., Hans, E., & Bakker, P. (2012). Taxonomic classification of plan- ning decisions in health care: a structured review of the state of the art in OR/MS. Health Systems, 1, 129-175.

[5] Gocgun, Y., Bresnahan, B., Ghate, A., & Gunn, M.(2011). A markov decision process approach to multi- category patient scheduling in a diagnostic facility. Ar- tificial Intelligence in Medicine, 53, 73-81.

[6] Kolisch,R., & Sickinger, S. (2008). Providing radiology health care services to stochastic demand of diferent customer classes. OR Spectrum, 30, 375-395.

[7] Min, D., & Yih, Y. (2010). An elective surgery sched- uling problem considering patient priority. Computers and Operations Research, 37, 1091-1099.

[8] Patrick, J., Puterman, M. L., & Queyranne, M.(2008). Dynamic multi-priority patient scheduling for a diagnostic resource. Operations Research, 56, 1507- 1525.

[9] Lamiri M., Xie X., Dolgui, A., & Grimaud, F. (2008). A stochastic model for operating room planning with elective and emergency demand for surgery. European Journal of Operational Research, 185, 1026-1037.

[10] Liu, N., Ziya, S. & Kulkarni, V. G. (2010). Dynamic scheduling of outpatient appointments under patient no-shows and cancellation. Manufacturing and Service Operations Management, 12, 347-364.

[11] Saure, A., Patrick J., Tyldesley, S., & Puterman, M. L. (2012). Dynamic multi-appointment patient sched- uling for radiation therapy. European Journal of Op- erational Research, 223, 573-584.

[12] Geng, N., & Xiaolan, X. (2016). Optimal dynamic outpatient scheduling for a diagnostic facility with two waiting time targets. IEEE Transactions on Au- tomatic Control, 61, 3725-3739.

[13] Tsai, P. J., & Teng, G. (2014). A stochastic appoint- ment scheduling system on multiple resources with dynamic call-in sequence and patient no-shows for an outpatient clinic. European Journal of Operational Re- search, 239, 427-436.

[14] Turkcan, A., Zeng, B., & Lawley, M. (2012).Chemotherapy operations planning and scheduling. IIE Transactions on Healthcare Systems Engineering, 2, 31-49.

[15] Goldberg, S., Carter, M., Beck, J., Trudeau, M., Sousa, P., & Beattie, K. (2014). Dynamic optimiza- tion of chemotherapy outpatient scheduling with un- certainty. Healthcare Management Science, 17, 379- 392.

[16] Goldberg, S., Beck, J., Carter, M., Trudeau, M., Sousa, P., & Beattie, K. (2014). Solving the chemotherapy outpatient scheduling problem with constraint programming. Journal of Applied Opera- tional Research, 6, 135-144.

[17] Alvarado, M. & Ntaimo, L. (2018). Chemotherapy ap- pointment scheduling under uncertainty using mean- risk stochastic integer programming. Healthcare Man- agement Science, 21, 87-104.

[18] Parizi, M. S., & Ghate, A. (2016). Multi-class, multi- resource advance scheduling with no-shows, cancella- tions and overbooking. Computers Operations Re- search, 67, 90-101.

[19] Kleywegt, A. J., & Papastavrou, J. D. (1998). The Dy- namic and Stochastic Knapsack Problem. Operations Research, 46, 17-35.

[20] Powell W. B. (2007). Approximate Dynamic Program- ming: Solving the curses of dimensionality. John Wi- ley and Sons.

[21] Adelman, D. (2003). Price-directed replenishment of subsets: methodology and its application to inventory routing. Manufacturing and Service Operations Man- agement, 5, 348-371.

[22] Adelman, D. (2004). A price-directed approach to sto- chastic inventory routing. Operations Research, 52, 499-514.

[23] De Farias, D. P., & Roy, B. V. (2004). The linear programming approach to Approximate Dynamic Pro- gramming. Operations Research, 51, 850-865.

[24] Bertsekas, D., & Tsitsiklis, J. (1996). Neuro-Dynamic Programming. Athena Scientific.

[25] Sutton, R. S. & Barto, A. G. (1998). Reinforcement Learning. MIT Press.

[26] Chang, H. S., Fu, M. C., Hu, J., & Marcus, S. I.(2007). Simulation-based algorithms for Markov De- cision Processes. Springer.

[27] Gocgun, Y. (2018). Approximate dynamic program- ming for optimal search with an obstacle (Submitted).

[28] Maxwell, M. S., Henderson, S. G., & Topaloglu, H. (2013). Tuning Approximate Dynamic Program- ming Policies for Ambulance Redeployment via Direct Search. Stochastic Systems, 3, 1-40.