Education of the Spine Surgeon

Published on 27/03/2015 by admin

Filed under Neurosurgery

Last modified 22/04/2025

Print this page

rate 1 star rate 2 star rate 3 star rate 4 star rate 5 star
Your rating: none, Average: 0 (0 votes)

This article have been viewed 1507 times

Chapter 208 Education of the Spine Surgeon

There are two routes toward becoming a spine surgeon—orthopaedics or neurosurgery—both requiring long and distinct educational pathways. Historically, neurosurgeons performed surgery on the spine with special technical emphasis on alleviation of extrinsic decompression of the neurologic elements or operating intrinsically on the spinal cord and roots. Orthopaedic surgeons have historically focused on the structural spinal components and have pioneered instrumentation and deformity correction. Over the course of many decades, the differences between a competent spine orthopaedist and neurosurgeon have faded significantly. The care of most spinal pathology can be addressed with an equal level of expertise by either subspecialty. The aptitude of a fully trained spine surgeon is independent of which journey is taken. However, the pathway to become a fully trained spine surgeon remains quite different for the orthopaedist and neurosurgeon.

Orthopaedic Resident Education

The orthopaedic spine skill repertoire has expanded far beyond instrumentation and spine stabilization techniques. Several generations of orthopaedic surgeons have acquired advanced decompressive techniques and continue to pass that knowledge down via the residency training process. The training of orthopaedic residents remains a subcomponent of the general training period of 5 years. Most orthopaedic residency programs have dedicated rotations during the clinical training period, but there is no minimal time mandated by the Orthopaedic Residency Review Committee.1 It is typical that the orthopaedic residency exposure to spine surgery averages between 3 to 6 months during training. Many programs have focused attention on deformity treatment experiences during these months. Emphasis on providing the orthopaedic resident sufficient educational experiences in joint surgery, trauma, or sports medicine often precludes a more extensive spine surgery exposure during residency training. Although not mandatory, the majority of orthopaedic spine surgeons have achieved greater levels of expertise during fellowships.

Neurosurgery Resident Training

Contrary to commonly held beliefs, most practicing neurosurgeons perform more spinal operations than cranial operations. Nationally, 60% of all procedures performed by neurosurgeons are spine related.2 Similarly, the training of neurosurgical residents has a greater emphasis on spine surgery than on cranial surgery. Neurosurgery training exposes residents to spine surgery pathology and techniques—typically in the early years. This continues in most programs until completion of the chief experience. The residency experience is a minimum of 6 years. Neurosurgery residents have a significant degree of competency, with the operative management of most spinal pathologic conditions at the end of residency. Most residents go on to practice spine surgery without additional training. Many neurosurgical programs introduce residents to deformity correction principles, but many interested in spine deformity obtain fellowship positions. Increasing numbers are doing such under the direction of experienced orthopaedic surgeons.

Evolving Accreditation Council of Graduate Medical Education Changes

The Accreditation Council of Graduate Medical Education (ACGME) oversees all U.S. allopathic orthopaedic and neurosurgical residency programs. Residency programs must be accredited by the ACGME to receive government funding in support of graduate medical education and to enable their graduates to qualify for specialty certification.4 Over the past decade, there have been several mandates from the ACGME that have altered how residents are deemed competent and how long they can spend in the hospital.5 Each of the specialties has its own residency review committee within the umbrella of the ACGME that is responsible for accreditation of individual programs and monitors compliance with ACGME mandates. Currently, spine surgery fellowship programs “live” outside the domain of ACGME accreditation, but many have adopted the mandated changes in graduate medical education.6 Two ACGME directives in the past 10 years have had a major impact on residency training: the Outcome Project and duty hour regulations.

Outcome Project

In 1998, the ACGME mandated a paradigm shift in graduate medical education to a competency-based process of education with a focus on outcome measures.7 Concluding that the existing educational evaluative process was inadequate, the ACGME decided to specify six general competencies: patient care, medical knowledge, practice-based learning and improvement, professionalism, interpersonal skills and communication, and systems-based practice. When the ACGME adopted the general competencies, it was mindful that each specialty must engage in individualizing the task. Each specialty was given the assignment of establishing general outcomes, and defining competency regarding patient care and medical knowledge.

The definition and use of the six core competencies by the ACGME has posed challenges for educators.8 This challenge perhaps has been most apparent in the surgical subspecialties. The assessment of medical knowledge has been a difficult but not an insurmountable problem. However, the improvement and assessment of the remaining core competencies has been considerably more challenging. Assessing surgical performance must span across several of the competencies. Developed competency assessment tools have the potential to fall short in comprehensively addressing the specific needs of many program directors and, most noticeably, can provide suboptimal specific feedback to residents. Often, the faculty and residents struggle with well-established competency-based tools in place to “get to know” resident strengths and weaknesses.9 As such, residents have to struggle to self-reflect and improve based on measures, in particular, related to surgical experience.10 Many electronic assessment tools are in position, but systems do not integrate with one another across institutions. This limits the opportunity to unify the process of resident assessment and outcomes at the national level.

Resident Assessment Tools and Measures

Numeric and global rating assessment tools have been used to assess resident performance for quite some time. Rating systems provide a “unit of measure” or “grade,” which most learners (and teachers) have likely grown accustomed to during their own formalized educational process. One argument for numeric scoring summaries is that they may indeed provide some useful data, assisting the program director to “objectively” assess residents and the program as a whole. On the other hand, there is debatably greater value to providing highly meaningful detailed feedback to individual surgeons in training.11 Isolating a competency to a single numeric value provides feedback that often fulfills requirements but fails to provide the resident feedback concerning targeted areas of improvement. When measuring across multiple competencies, it is quite likely that there will be some residents who achieve an overall satisfactory score but who perform poorly in a single competency. Global ratings have been shown to be highly subjective when graders are not well trained.12 At times, some raters may rate all competencies equally, regardless of performance. Scores may be biased when raters inappropriately make severe or lenient judgments or avoid using the extreme ends of a rating scale. Reproducibility of scores by raters appears easier to achieve for the domain of knowledge and more difficult to achieve for patient care and interpersonal and communication skills. Perhaps the greatest criticism against the use of global rating tools is that a numeric score can provide suboptimal feedback to the individual resident attempting to learn from the evaluation process.

More specific and useful information used to create a summary of an individual resident’s performance can come from the narrative components of assessment tools. In many programs, emphasis on resident assessment numeric scoring is reduced or eliminated, and specific competency-based narrative commentary is heavily relied on. Self, peer, faculty, as well as 360-degree assessments make up a collective formative database. Strengths and weaknesses can be specifically and immediately queried by the resident, mentor, and program director. The resident should be responsible for keeping track of the formative database. The downside of a system that heavily relies up narrative feedback is that greater time is required to compose a summary compared with scoring schemes. There are also varying degrees of “narrative skill sets” that faculty have in regard to providing rich and meaningful feedback, which limits an assessment system that purely depends on the written word.

Portfolio for Assessment of Professional Development

Several residency programs have begun to use educational portfolios to assess graduate medical education performance.13 Principal functions are to lay the groundwork for reflective learning, assess to promote learning, provide useful feedback for improving performance, inform rather than just measure, and document the longitudinal progress. Portfolios were initially described as a purposeful collection of student work that exhibits to the student (and/or to others) the student’s efforts, progress, or achievement in one or more given area(s). This collection must include student participation in the selection of portfolio content, the criteria for selection, the criteria for judging merit, and evidence of student reflection.14 Essential to the core of the revamped assessment plan is that the resident must take responsibility for creating his or her own portfolio.

The ACGME issued an Executive Summary Report in 2007, launching their own pilot portfolio project15:

The ACGME is currently in the beta phase of this pilot project, and expected global presentation in the next few years should be anticipated.

Milestone Project

One major criticism of the Outcome Project is that it has not resulted in the practical implementation of effective measurements for specific residents, for specific programs, and more comprehensively for specific specialties. The competencies as created by the Outcome Project remain non–specialty-specific and without timelines for achievement. There remain no standards per competency per year of training for either the orthopaedic or neurosurgery resident. Certainly there are no guidelines using the current competency tools that provide program directors detailed specialty-specific parameters for resident advancement within the program.16 Making it even more difficult for program directors is that their faculty often do not share a collective conviction of definitive and particular defined expectations for their trainees. This makes it very challenging to devise a meaningful remedial plan for a learning physician struggling in a specific domain.

In recent years, the ACGME leadership has challenged the medical education community to create and develop milestones of the six core competencies for each discipline.17 The Milestone Project has the goal of providing programs with specialty-specific standards per competency, defined over a specific time period, to assist program directors in assessing if residents are meeting nationally defined benchmarks. Residents will not be allowed to move to the next level without first reaching certain milestones, and failure to reach certain targets would trigger appropriate corrective action. Residents currently receive feedback without a framework of defined expectations per competency per a period of time, and it is hoped that a longed-for structure to assist with meaningful action plans can be created via the Milestone Project. The ACGME expects to monitor each program’s participation in this process, and a breakdown to comply with the documentation of the process may result in accreditation action for the training site. The Milestone Project has engaged several of the nonsurgical specialties.18,19 The expected time frame for the rollout for orthopaedic and neurosurgery programs remains uncertain, but they are anticipated in the next few years.

Duty Hours

The ACGME-implemented duty hour mandates have dramatically altered how educators regulate the time residents spend in the hospital training. The 80-hour work week maximum has been implemented since 2003. Given no alternative due to accreditation ramifications, the specialties of neurosurgery and orthopaedics accepted the rules required by the ACGME. This represented a major cultural change for many demanding surgical residency programs, some of which worked residents more than 110 hours a week. Many educators would agree that the mandate has been reasonable given the issues that surround resident fatigue. Much controversy has existed over the impact of the reduction of duty hours on patient safety.2026

Results of a national survey of the program directors and residents in neurosurgery training programs included 93 program directors and 617 residents.27 As many as 93% of all respondents thought that work-hour restrictions had a negative effect on continuity of care. Forty-six percent of residents perceived that work-hour restrictions would facilitate research/publication activities, and only 21% of program directors agreed. Forty-one percent of residents and 74% of program directors perceived that chief residents operate on fewer complex cases. Seventy-five percent of residents thought that they are less familiar with their patients. Sixty-one percent of the residents and 79% of program directors noted that the ACGME guidelines have had a negative impact on their program.

In July of 2011, the ACGME mandated modified duty hours rules regulations, which further reduced the time training physicians can work continuously (16 hours for interns and 24 hours for all residents).5 The new rules do not further limit the work hours per week but do mandate a greater emphasis on safety and resident oversight. Some increased flexibility for residents in the advanced stages in training as defined by specialty residency review committees was created to allow for continuity of care in select circumstances.

The outcomes of the modified new regulations remain to be seen. There is some indication that the quality of resident life has improved since the 2003 hours went into effect.28 To date, no authorities have definitively shown that the reduction of work hours has led to improved patient safety. Concerns continue to surround the potential for detrimental impact of further reduction of hours on procedural skill acquisition and clinical decision making, discontinuity in care, and patient safety.29

Simulation Training

The use of technology to simulate real-world scenarios for training purposes has a rich history in the airline, aerospace, and military industry. Historically, surgical simulation was limited to cadaveric or animal laboratories. Recently, technologic advances make virtual surgical simulation possible. Surgical simulation provides a zero-risk setting in which skills can be obtained through repetition. Even the crudest simulation of multistep procedures can aid the trainee in planning for a procedure by allowing rehearsal of the steps involved. More advanced, technically accurate simulation systems that provide sensory feedback can further aid the trainee in developing and refining the mechanical skills required for the procedure. Ultimately, the best metric for a simulator is how well skills derived from simulation transfer to actual procedures.

Simulation is now widely accepted for enhancing the resident training experience in a wide range of scenarios, including surgical training of laparoscopic procedures,3033 endoscopy,34 colonoscopy,35,36 thoracoscopy,37 cataract surgery,38 peripheral vascular endovascular interventions,39 and airway management.4042 These simulation systems replicate procedures that involve two-dimensional visualization. The application of simulation in the realm of spine surgery training and education has lagged somewhat compared with other specialties, likely because of the challenge inherent in replicating a complex three-dimensional reality. However, improvements in computer processing power, volume rending, graphics, and haptics have allowed the creation of sophisticated, albeit limited, simulation systems with neurosurgical applications.43

Simulation of surgical procedures such as laparoscopy has been fully incorporated into the training of general surgery residents. The role of simulation in spinal surgical education is yet to be defined. There are two main components to a procedure that simulation can reinforce.

First, the order of steps required to perform any procedure successfully can be rehearsed under different scenarios. For example, A, then B, then C, is performed, and the outcome of this management algorithm is awaited. Once the outcome is defined by the simulation system (adverse or desired), a new treatment algorithm can be instituted in a reiterated process.44,45 This learning environment could be very beneficial and efficient, particularly for relatively rare yet vital occurrences in real-world patient encounters, such as critical resuscitation.46,47 Not surprisingly, there is evidence that simulation of cardiopulmonary resuscitative efforts, for example, can improve performance and subjective perceptions of self-competence among trainees,46,48 and an intensive, curriculum-based simulation module can be as beneficial as 6 months of clinical ward experience.49

Second, simulation of technical procedures can also be of benefit by providing a no-risk environment for rehearsal of mechanical skills required. Simulation has been shown to be effective for relatively simple procedures such as direct or peripherally inserted central venous access catheter placement and transnasal endoscopy.4951 These findings reflect a transfer of skills acquired from the simulator to an actual patient encounter. It would be expected that the closer a simulation can mimic an actual procedure the more readily the skills can be transferred. Strategies using simulation into training must also incorporate periodic retraining of skills to avoid deterioration over time.52

Limited simulation systems are currently available for the rehearsal of percutaneous spinal procedures such as kyphoplasty. Surgical planning using strategies that include the manipulation of three-dimensional stereoscopic imaging such as CT and magnetic resonance angiography has been demonstrated to be useful for intracranial surgeries.5362 Demonstrated benefits include the establishing a good surgical strategy, enhancing intraoperative spatial orientation, and increasing the surgeon’s confidence. Our center (the Cleveland Clinic) is investigating novel methods of incorporating surgical navigation systems into the spine realm whereby stereotactic coordinates can be used for the placement of virtual spinal instrumentation. In this manner, both resident and fellow trainees could rehearse different screw trajectories in the cervical, thoracic, and lumbar spine, all the while gaining a greater appreciation of the three-dimensional anatomy involved.

References

1. http://www.acgme.org/acWebsite/downloads/RRC_progReq/260orthopaedicsurgery07012007.pdf

2. AANS neurosurgical procedural statistics survey offers insight info practice management world of neurosurgeons. Available at http://www.newswise.com/articles/aans-neurosurgical-procedural-statistics-survey-offers-insight-into-practice-management-world-of-neurosurgeons

3. Neurological Institute. Cleveland Clinic. Available at http://my.clevelandclinic.org/spine/professionals/spine-surgery-fellowship.aspx

4. Accreditation Council for Graduate Medical Education. Available at http://www.acgme.org/acWebsite/home/home.asp

5. Accreditation Council for Graduate Medical Education, Resident Duty Hours in the Learning and Working Environment. Available at http://www.acgme.org/acWebsite/dutyHours/dh-ComparisonTable2003v2011.pdf

6. The Society of Neurological Surgeons, Subspecialty Training & Fellowships. Available at http://www.societyns.org/fellowships/index.asp

7. http://www.acgme.org/outcome/e-learn/e_powerpoint.asp

8. Heard J.K., Allen R.M., Clardy J. Assessing the needs of residency program directors to meet the ACGME general competencies. Acad Med. 2002;77(7):750.

9. Green M.L., Holmboe E. Perspective: the ACGME toolbox: half empty or half full? Acad Med. 2010;85(5):787-790. erratum 86(1):84, 2011

10. Yaszay B., Kubiak E., Agel J., Hanel D.P. ACGME core competencies: where are we? Orthopedics. 2009;32(3):171.

11. Silber C.G., Nasca T.J., Paskin D.L., et al. Do global rating forms enable program directors to assess the ACGME competencies? Acad Med. 2004;79(6):549-556.

12. Gray J. Global rating scales in residency education. Acad Med. 1996;71:S55-S63.

13. Carraccio C., Englander R. Evaluating competence using a portfolio: a literature review and web-based application to the ACGME competencies. Teach Learn Med. 2004;16(4):381-387.

14. Reckase M.D. Portfolio assessment: a theoretical estimate of score reliability. Educational Measurement: Issues and Practice. 1995;14:12-31.

15. http://www.acgme.org/acwebsite/portfolio/cbpac_memo.pdf

16. Carraccio C., Burke A.E. Beyond competencies and milestones: adding meaning through context. J Grad Med Educ. 2010;2(3):419-422.

17. Nasca T.J. Where will the “milestones” take us? The next accreditation system. ACGME Bull. September 2008:3-5.

18. Hicks P.J., Englander R., Schumacher D.J., et al. Pediatrics Milestone Project: next steps toward meaningful outcomes assessment. J Grad Med Educ. 2010;2(4):577-584.

19. Green M.L., Aagaard E.M., Caverzagie K.J., et al. Charting the road to competence: developmental milestones for internal medicine residency training. J Grad Med Educ. 2009;1(1):5-20.

20. Okie S. An elusive balance-residents’ work hours and the continuity of care. N Engl J Med. 356, 2007. 2665–2266

21. Petersen L.A., Brennan T.A., O’Neil A.C., et al. Does housestaff discontinuity of care increase the risk for preventable adverse events? Ann Intern Med. 1994;121:866-872.

22. Volpp K.G., Rosen A.K., Rosenbaum P.R., et al. Mortality among hospitalized Medicare beneficiaries in the first 2 years following ACGME resident duty hour reform. JAMA. 2007;298:975-983.

23. Volpp K.G., Rosen A.K., Rosenbaum P.R., et al. Mortality among patients in VA hospitals in the first 2 years following ACGME resident duty hour reform. JAMA. 2007;298:984-992.

24. Howard D.L., Silber J.H., Jobes D.R. Do regulations limiting residents’ work hours affect patient mortality? J Gen Intern Med. 2004;19:1-7.

25. Reed D.A., Levine R.B., Miller R.G., et al. Effect of residency duty hour limits: views of key clinical faculty. Arch Intern Med. 2007;167:1487-1492.

26. Lee C.J. Federal regulation of hospital resident work hours: enforcement with real teeth. J Health Care Law & Policy. 2006;9:162-216.

27. Cohen-Gadol A.A., Piepgras D.G., Krishnamurthy S., Fessler R.D. Resident duty hours reform: results of a national survey of the program directors and residents in neurosurgery training programs. Neurosurgery. 2005;56:398-403.

28. Fletcher K.E., Underwood W.III, Davis S.Q., et al. Effects of work hour reduction on residents’ lives: a systematic review. JAMA. 2005;294:1088-1100.

29. Rutka J.T. AANS President’s Perspective: Why less is not more. New rules for neurosurgical residency duty hours. AANS Neurosurgeon. 2011;20(1):20-21.

30. Torkington J., Smith S.G., Rees B.I., Darzi A. The role of simulation in surgical training. Ann R Coll Surg Engl. 2000;82(2):88-94.

31. Schijven M.P., Jakimowicz J.J. Introducing the Xitact LS500 laparoscopy simulator: toward a revolution in surgical education. Surg Technol Int. 2003;11:32-36.

32. Tavakol M., Mohagheghi M.A., Dennick R. Assessing the skills of surgical residents using simulation. J Surg Educ. 2008;65(2):77-83.

33. Miskovic D., Wyles S.M., Ni M., et al. Systematic review on mentoring and simulation in laparoscopic colorectal surgery. Ann Surg. 2010;252(6):943-951.

34. Fitzgerald T.N., Duffy A.J., Bell R.L., et al. Computer-based endoscopy simulation: emerging roles in teaching and professional skills assessment. J Surg Educ. 2008;65(3):229-235.

35. Snyder C.W., Vandromme M.J., Tyra S.L., Hawn M.T. Retention of colonoscopy skills after virtual reality simulator training by independent and proctored methods. Am Surg. 2010;76(7):743-746.

36. Yi S.Y., Ryu K.H., Na Y.J., et al. Improvement of colonoscopy skills through simulation-based training. Stud Health Technol Inform. 2008;132:565-567.

37. Solomon B., Bizekis C., Dellis S.L., et al. Simulating video-assisted thoracoscopic lobectomy: a virtual reality cognitive task simulation. J Thorac Cardiovasc Surg. 2011;141(1):249-255.

38. Selvander M., Asman P. Virtual reality cataract surgery training: learning curves and concurrent validity. Acta Ophthalmol. 2010. [Epub ahead of print]

39. Naughton P.A., Aggarwal R., Wang T.T., et al. Skills training after night shift work enables acquisition of endovascular technical skills on a virtual reality simulator. Vasc Surg. 2011;53(3):858-866.

40. Nargozian C.D. Simulation and airway-management training. Curr Opin Anaesthesiol. 2004;17(6):511-512.

41. Castanelli D.J. The rise of simulation in technical skills teaching and the implications for training novices in anaesthesia. Anaesth Intensive Care. 2009;37(6):903-910.

42. Ishman S.L., Brown D.J., Boss E.F., et al. Development and pilot testing of an operative competency assessment tool for pediatric direct laryngoscopy and rigid bronchoscopy. Laryngoscope. 2010;120(11):2294-3000.

43. Malone H.R., Syed O.N., Downes M.S., et al. Simulation in neurosurgery: a review of computer-based simulation environments and their surgical applications. Neurosurgery. 2010;67(4):1105-1116.

44. Auerbach M., Kessler D., Foltin J.C. Repetitive pediatric simulation resuscitation training. Pediatr Emerg Care. 2011;27(1):29-31.

45. Ruesseler M., Weinlich M., Müller M.P., et al. Simulation training improves ability to manage medical emergencies. Emerg Med J. 2010;27(10):734-738.

46. Langhan T.S., Rigby I.J., Walker I.W., et al. Simulation-based training in critical resuscitation procedures improves residents’ competence. CJEM. 2009;11(6):535-539.

47. Lam G., Ayas N.T., Griesdale D.E., Peets A.D. Medical simulation in respiratory and critical care medicine. Lung. 2010;188(6):445-457.

48. Healey A., Sherbino J., Fan J., et al. A low-fidelity simulation curriculum addresses needs identified by faculty and improves the comfort level of senior internal medicine resident physicians with in-hospital resuscitation. Crit Care Med. 2010;38(9):1899-1903.

49. Stolarek I. Procedural and examination skills of first-year house surgeons: a comparison of a simulation workshop versus 6 months of clinical ward experience alone. N Z Med J. 2007;120(1253):U2516.

50. Andreatta P., Chen Y., Marsh M., Cho K. Simulation-based training improves applied clinical placement of ultrasound-guided PICCs. Support Care Cancer. 2011;19(4):539-543.

51. Benadom E.M., Potter N.L. The use of simulation training graduate students to perform transnasal endoscopy. Dysphagia. 2011;26(4):352-360.

52. Kahol K., Ashby A., Smith M., Ferrara J.J. Quantitative evaluation of retention of surgical skills learned in simulation. J Surg Educ. 2010;67(6):421-426.

53. Pechlivanis I., Schmieder K., Scholz M., et al. 3-Dimensional computed tomographic angiography for use of surgery planning in patients with intracranial aneurysms. Acta Neurochir (Wien). 2005;147(10):1045-1053.

54. Fischer G., Stadie A., Schwandt E., et al. Minimally invasive superficial temporal artery to middle cerebral artery bypass through a minicraniotomy: benefit of three-dimensional virtual reality planning using magnetic resonance angiography. Neurosurg Focus. 2009;26(5):E20.

55. Peters T.M., Henri C., Collins L., et al. Clinical applications of integrated 3-D stereoscopic imaging in neurosurgery. Australas Phys Eng Sci Med. 1990;13(4):166-176.

56. Anil S.M., Kato Y., Hayakawa M., et al. Virtual 3-dimensional preoperative planning with the dextroscope for excision of a 4th ventricular ependymoma. Minim Invasive Neurosurg. 2007;50(2):65-70.

57. Ng I., Hwang P.Y., Kumar D., et al. Surgical planning for microsurgical excision of cerebral arterio-venous malformations using virtual reality technology. Acta Neurochir (Wien). 2009;151(5):453-463.

58. Ferroli P., Tringali G., Acerbi F., et al. Brain surgery in a stereoscopic virtual reality environment: a single institution’s experience with 100 cases. Neurosurgery. 2010:67. (Suppl 3 Operative)

59. Wong G.K., Zhu C.X., Ahuja A.T., Poon W.S. Craniotomy and clipping of intracranial aneurysm in a stereoscopic virtual reality environment. Neurosurgery. 2007;61(3):564-568. discussion 568–569

60. González Sánchez J.J., Enseñat N.J., Candela Canto S., et al. New stereoscopic virtual reality system application to cranial nerve microvascular decompression. Acta Neurochir (Wien). 2010;152(2):355-360.

61. Wong G.K., Zhu C.X., Ahuja A.T., Poon W.S. Stereoscopic virtual reality simulation for microsurgical excision of cerebral arteriovenous malformation: case illustrations. Surg Neurol. 2009;72(1):69-72. discussion 72–73

62. Stadie A.T., Kockro R.A., Reisch R., et al. Virtual reality system for planning minimally invasive neurosurgery. Technical note. J Neurosurg. 2008;108(2):382-394.