Self-Study and External Review Process
The self-study and external review is a holistic analysis of program quality and effectiveness. Programs reflect on and assess their contributions to student learning, scholarship, and the College’s mission; they also plan for the future.
A department or program self-study and external review usually occurs every five to eight years. It includes a self-study by the department, followed by a visit from three external reviewers. Planning for the review begins about one year before the external review, when the department chair/program coordinator meets with the associate dean for curriculum and the College’s Accreditation Liaison Officer (ALO). The process of selecting the outside reviewers also begins at this time in order to able to schedule qualified reviewers. Approximately one month after the external review, the reviewers submit their report to the dean, who then forwards it to the department chair/program coordinator and meets with the department/program to discuss the contents of the report. One year later, the department chair/program coordinator makes a brief follow-up report to the dean, outlining how the department/program has responded to the external reviewers’ recommendations, and discusses with the dean any further actions.
Selecting the Outside Reviewers
The chair/coordinator sends a list to the Associate Dean with the names, titles, institutions and email addresses of six to eight potential outside reviewers, ranked in order of preference and grouped according to their specific niches. These names need to be discussed and approved by all continuing members of the department before being submitted. The Associate Dean, in consultation with the Dean, selects three external reviewers from this list. The Dean and Associate Dean may decide to select an individual not on the list, but will discuss this with the department or program before doing so. The three external reviewers will normally include at least one person from a comparable liberal arts college and at least one person from a research university that offers PhDs in the pertinent discipline. The latter is able to provide feedback on how well we are preparing our students for further study; the former to appreciate the unique character of liberal arts colleges. The three reviewers should also include at least one person who is or has been a department chair.
The department/program will indicate the dates it would prefer the outside reviewers to visit campus. The Associate Dean will ascertain the availability of the Dean and the President on the proposed dates and contact the reviewers to determine their willingness to serve on these dates. Once the reviewers have accepted, the department/program is responsible for arranging travel and housing for the reviewers and arranges the on-campus scheduling for the two-day visit. Please make airfare reservations through University/Claremont Travel (909) 799-8500 and lodging arrangements at the Claremont DoubleTree (909) 626-2411.
The Self-Study Document
The department/program creates a report that it will give to the president, the dean, the associate dean, and the external reviewers no later than two weeks before the external review. Generally, the chair/coordinator is responsible for overall organization, but is not the sole author of the self-study; the writing of the self-study is a shared enterprise among department members. The chair is encouraged to consult with the ALO and the Office of Institutional Research about gathering and interpreting data relating to the department. Early in the process, the department/program will set aside time for intensive discussion of the self-study issues, either as a one- or two-day retreat or over a series of meetings. To facilitate discussion, the chair/coordinator may want to distribute a written set of possible topics or issues for the self-study to all faculty before the initial meeting.
Core Information in a Department/Program Self-Study Document
- A history of the department/program, including changes in faculty, facilities; how the department/program has responded to results and recommendations of previous self-studies.
- A statement of the department/program learning objectives and how they relate to the institutional learning goals of the college.
- An assessment of student learning in the major in light of the department/program learning objectives (i.e., a review of the department’s recent annual assessments of student learning in the major). Departments may also wish to assess or consider their contributions to student learning across the curriculum.
- An explanation of how the department/program determines that learning goals are being met with its current curriculum and what kinds of evidence are used.
- A discussion of how the department/program uses this evidence to evaluate and improve its curriculum.
- Demographic data on enrollments and majors, obtained in consultation with the Office of Institutional Research.
- An assessment of the department's efforts to incorporate inclusive pedagogy and support a diverse student body.
- An evaluation of any striking ethnic, racial, or gender disparities among majors or non-majors taking classes in the department/program, including plans to address them.
- Feedback from and profiles of current students and alumni obtained from surveys taken early in the self-study process.
- Comparative data from departments or programs at similar colleges.
- Faculty profiles, such as CVs or biographies, including teaching, research, and service.
- The department’s tenure and promotion standards.
- Catalog copy and course syllabi.
- A history of recent financial support for faculty and students, including grants received for research, travel, and senior projects.
Sample Issues or Questions for Self-Studies
The following questions may spark further discussion among colleagues in your department/program. They are only suggestions, not requirements.
Teaching and Learning
- What sorts of active or experiential learning opportunities does the department/program offer students?
- What sorts of faculty/student collaboration does the department/program support? How effective is this collaboration?
- How appropriate is the senior exercise, given the department/program goals? How does it help students integrate the information, concepts, and skills that they have learned?
- How well-prepared are majors for graduate study? How successful are majors in getting into graduate school or finding employment? What kinds of post-graduate occupations do the majors pursue?
- How do department/program offerings help all students lead satisfying, productive lives? Does the curriculum offer courses that provide transferable skills and knowledge for students who will take only one or two courses?
- What courses outside of the department/program do faculty advisors encourage students to take?
- How fully does the major take advantage of courses at the other Claremont Colleges?
- To what extent do professors find their teaching at Pomona College satisfying? How can the department/program help faculty members continue to improve their pedagogy or develop new areas of teaching expertise?
- How appropriate is the faculty staffing given the curricular goals and enrollments? To what degree are students taught by regular and continuing members of the faculty? Are resources available at the other Claremont Colleges that can help the department/program achieve its curricular goals?
- How are the department/program goals hampered or facilitated by its physical facilities?
- In what ways does the department/program facilitate research productivity among faculty members?
- How well is the department/program functioning? Is there shared governance, or do a minority of faculty or even just the chair make most decisions? Are there written guidelines for department/program governance?
- How does the department distribute or delegate responsibilities among individual faculty members? How is leadership encouraged and developed across the department/program?
- How does the department distribute resources among individual faculty members?
- How are junior faculty members mentored with respect to their teaching, scholarship, and service? Are information and expectations communicated effectively?
- Are there sufficient opportunities for the department/program faculty to interact with one another and share experiences (through both formal meetings and informal interactions)? Is there potential for better interdepartmental and intercollegiate cooperation and complementarity?
- What are administrative or technical staff needs within the department/program and how well are they being met?
Resources for Self-Studies
- National studies of general curricular issues for liberal arts colleges in general.
- Studies by national organizations in your discipline or field.
- Self-studies conducted at Pomona by other departments (permission is required from the department to view the self-study document).
- The Office of Institutional Research can offer advice on strategies for data collection, provide technical support for web-based surveys (of alumni and students) and supply existing data from institutional surveys to inform the review where appropriate. The Senior Survey and the Enrolled Student Survey cover many topics relevant to departmental self-studies.
The External Review
Selecting the Outside Reviewers
The chair/coordinator sends a list to the associate dean with the names, titles, institutions, and email addresses of six to eight potential outside reviewers, ranked in order of preference and grouped according to their specific niches. These names need to be discussed and approved by the members of the department before being submitted. The associate dean, in consultation with the dean, selects three external reviewers from this list. The dean and associate dean may decide to select an individual not on the list but will discuss the matter with the department or program before doing so. The three external reviewers will normally include at least one person from a comparable liberal arts college and at least one person from a research university that offers PhDs in the pertinent discipline. The former should appreciate the unique character of a liberal arts college; the latter is able to provide feedback on how well we are preparing our students for further study; the three reviewers should also include at least one person who is or has been a department chair.
Scheduling and Conducting the Review
The department/program will indicate the dates it would prefer the outside reviewers to visit campus. The associate dean will ascertain the availability of the dean and the president on the proposed dates and contact the reviewers to determine their willingness to serve on these dates. Once the reviewers have accepted, the department/program is responsible for arranging travel and housing for the reviewers and arranges the on-campus scheduling for the two-day visit, keeping in mind that the visit should begin with a meeting with the dean of the College at 9 a.m. on the first day and conclude with a meeting with the dean, associate dean, and president at 4 p.m. on the second day.
Reviewers will spend a minimum of two days at Pomona, normally either a Monday-Tuesday or a Thursday-Friday, arriving the evening before the first day of the review. The review team meets with the dean and the associate dean at the beginning of the first day of their visit and meets with the president and dean for an exit interview in the late afternoon on the second day. After this exit interview, the reviewers should have time to discuss their written report (and have no further contact with department members).
Over the two-day visit, the reviewers should meet with all continuing department/program faculty members, with visiting faculty members, support staff, and individuals in joint or related departments or programs – including those at the other colleges – so they can get the fullest possible picture of the department/program being reviewed. Some departments may wish to have the reviewers meet with the associate dean who oversees research support. The reviewers should meet with students, and they may visit one or more classes and have the opportunity to evaluate any significant academic resources, such as laboratories, libraries, or centers. Reviewers should have time to read or view student work, such as senior exercises or class projects. Many departments/programs find it helpful to have a reception or dinner for the reviewers and the entire department/program on the evening of the first day of the visit. The chair/coordinator is responsible for putting together the two-day schedule of the reviewers’ visit, in consultation with the associate dean.
The budget for each self-study should be determined at the outset of the review in consultation with the Dean’s Office. Self-study budgets can be used to cover travel expenses, honoraria for outside reviewers, photocopying, postage, meals, and space rental for a retreat. Honoraria will be issued by the Dean’s Office; individual departments/programs are responsible for budget management, travel arrangements, and other logistics.
After reading and discussing the reviewers’ report, the department/program meets with the dean and associate dean to review the report and explore next steps. The chair/coordinator should contact the Dean’s Office to arrange this meeting, normally within a month of receiving the report. A year after the external review, the department/program submits a brief follow-up report to the dean, with a copy to the associate dean. The report outlines which recommendations have been implemented and why, which have not been implemented and why, what impact the changes have had, and what plans the department/program has made for the future. The report can also provide an opportunity to remind the administration of any steps it should be taking. The chair/coordinator meets with dean and associate dean to discuss the follow-up report, helping ensure a productive outcome to the self-study.