February 1989: Planning is begun for a formal evaluation of the Library's bibliographic instruction program.
Six phases of the evaluation process are identified:
March-May 1989: Steps 1-3 are completed.
On May 11, 1989, final revisions of the PURPOSE of evaluating our program, our program's GOALS and OBJECTIVES, and the CRITERIA for the evaluation are completed.
May-June 1989: Steps 4-5 are begun.
A pretest to be administered to all new students (excluding transfers and foreign students) in August 1989 is designed. Both library skill-related questions and attitudinal questions are included on the test.
June 1989: To check its validity and reliability, the pretest, labeled "Hutchins Library Inventory," is administered to 43 student library workers. As a result of this pre-testing, one question is rewritten (the only one not answered correctly by a majority).
August 31, 1989: The "Hutchins Library Inventory" is administered to approximately 400 new students through the College's Office of Institutional Research and Testing in conjunction with the Office's questionnaire, "1989 Student Information Form."
A. Two sets of data from the "Hutchins Library Inventory" will be collected:
A.The faculty will be surveyed using Larry Hardesty's "A Scale to Measure the Attitudes of Classroom Instructors Toward the Role of the Academic Library in Undergraduate Education."
B.Scoring and summarizing the data from the library inventories (August 1989 & November 1989) will begin.
A.Scoring of data and entry of data from library inventories (Aug. 1989 & Nov. 1989) into Statview is completed.
B.Collation is begun on Faculty survey data.
A.Process of matching Social Security Numbers for pre-test/post-test student participants is finished. This assures any analysis of data and random sample that will be drawn will include only those individuals who participated in both tests. Those who have worked in the library at any time will not be considered for sample inclusion due to potential bias.
B.Collation is finished on Faculty survey data.
C.Data for section III.C. questions tallied and analyzed.
A.Raw data from faculty survey is being entered into Statview format to allow statistical analysis.
B.Discussion held with Institutional Testing to shape questionnaire and interview sections of evaluation, and to discuss other phases of evaluation.
C.Questions and script developed for Focus Group Interviews. Sample group for interviews selected and student interviewers chosen.
D.Comments from faculty survey collated.
E.Compilation and analysis of pre-test/post-test completion questions finished.
A.Student interviewers trained through mock interviews. Script revised as necessary.
B. Focus Group Interviews conducted.
A. Tape transcription begins.
B.Discussion held regarding process to be used in evaluation of bibliographies from papers.
A. Institutional Testing consulted for summary process to be used with tape transcripts. Transcription process continues.
B. Senior Requirement papers obtained.
A. Tape transcripts of focus group interviews are summarized, both question by question and student by student.
B. Reference Department staff, Library Director, and Head of Institutional Research meet to analyze interview summaries.
C. Assessment tool developed for evaluation of paper bibliographies. Reading and assessment completed.
A. Final analysis and summary of each segment finished.
B. Final summary report and final indepth report completed.
Susan_Henthorn@berea.edu
mroyse@utk.edu