A Conceptual Framework for the Holistic Measurement and Cumulative Evaluation of Library Services

Nicholson, Scott (2004) A Conceptual Framework for the Holistic Measurement and Cumulative Evaluation of Library Services.

Full text available as:
PDF - Requires Adobe Acrobat Reader or other PDF viewer.

Abstract

This conceptual piece presents a framework to aid libraries in gaining a more thorough and holistic understanding of their users and services. Through a presentation of the history of library evaluation, a measurement matrix is developed that demonstrates the relationship between the topics and perspectives of measurement. These measurements are then combined through evaluation criteria, and then different participants in the library system view those criteria for decision-making. By implementing this framework for holistic measurement and cumulative evaluation, library evaluators can gain a more holistic knowledge of the library system and library administrators can be better informed for their decision-making processes.

EPrint Type:	Preprint
Keywords:	Libraries, Measurement, Library Frameworks, Library science, Systems theory, User studies
Subjects:	Evaluation Digital Libraries
ID Code:	724
Deposited On:	08 February 2005
Alternative Locations:	http://bibliomining.com/nicholson/nicholsonpdfs/holistic.pdf
Eprint Statistics:	View statistics for this eprint
Tell A Colleague:	Tell a colleague about it.

Ackoff, R. (1993). A Theory of a System for Educators and Managers. The Deming Library, Vol. 21. Silver Springs, MD :; CC-M Productions. Retreived July 2, 2003 from http://www.managementwisdom.com/abdrrusac.html

Baker, S. & Lancaster, F. W. (1991). The Measurement and Evaluation of Library Services (2nd ed.). Arlington, VA: Information Resources Press.

Bawden, D. (1990) User-Oriented Evaluation of Information Systems and Services, Aldershot, England: Gower.

Belkin, N. & Kwasnik, B. (1986). Using structural representations of Anomalous States of Knowledge for choosing document retrieval strategies. In F. Rabitti (ed.), ACM/SIGIR Conference Proceedings. Pisa: Pisa University. 11-22.

Bertalanffy, L. von (1962). General system theory: A critical review. General Systems 7, 1-20.

Bertot, J., McClure, C. & Ryan, J. (2000). Statistics and Performance Measures for Public Library Networked Services. Chicago: American Library Association.

Brophy, P. & Coulling, K. (1996). Quality Management for Information and Library Managers. London: Aslib Gower.

Buckland, M. (2003). Five grand challenges for library research. Library Trends 51(4). 675-686.

Cronin, B. (1982). Taking the measure of service. ASLIB Proceedings 34(6/7), 273-294.

Cullen, Rowena. (1998). Measure for measure: A post modern critique of performance measurement in libraries and information services. Victoria University of Wellington New Zealand, School of Communications and Information Management. Available: ERIC: ED434664.

Dervin, B. (1992). From the mind’s eye of the user: The Sense-Making qualitative-quantitative methodology. In J. D. Glazier & R. R. Powell (Eds.), Qualitative research in information management (pp. 61-84). Englewood, CO: Libraries Unlimited.

Dervin, B. & Nilan, M. (1986). Information needs and uses. In Williams, M. E. (Ed.) Annual Review of Information Science and Technology (21). Washington, DC: American Society for Information Science, 3-33.

Erdelez, S. (1997). Information encountering: A conceptual framework for accidental information discovery. In P. Vakkari, R. Savolainen, & B. Dervin (Eds.), Information Seeking in Context. Proceedings of An International Conference on Research in Information Needs, Seeking and Use in Different Contexts (pp. 412-421). London: Taylor Graham.

Goodall, D. (1988). Performance measurement: A historical perspective. Journal of Librarianship 20(2), 129-144.

Griffiths, J. and King, D. (1993). Special Libraries: Increasing the Information Edge. Washington, DC: Special Libraries Association.

Hernon, P., & McClure, C. (1990). Evaluation and Library Decision Making. Norwood, NJ: Ablex Publishing Corporation.

Hernon, P., and McClure, C. R. (1986). Unobtrusive reference testing: the 55 percent rule. Library Journal, 111(April 15)37-41.

Kania, Antoinette M. (1988). Performance measures for academic libraries: A twenty year retrospective. Available: ERIC: ED293540.

Kaplan, A. (2002). The Conduct of Inquiry: Methodology for Behavioral Science (2nd printing, Rev. ed.). New Brunswick, New Jersey: Transaction Publishers.

Kwasnik, B. (1992). A descriptive study of the functional components of browsing. In Engineering for Human-Computer Interaction, ed. J. Larson and C. Unger, 191 – 202.

Amsterdam: Elsevier Science Publishers.

Kuhlthau, C. (1991). Inside the search process: Information seeking from the users perspective. Journal of the American Society for Information Science 42(5). 361-71.

Lancaster, F. W. (1978). The Cost-Effectiveness Analysis of Information Retrieval and Dissemination Systems. In King, D. (Ed.). Key Papers in the Design and Evaluation of Information Systems (pp. 23-38). White Plains, NY: Knowledge Industry Publications, Inc. (Reprinted from Journal of the American Society for Information Science, Jan-Feb. 1971, 13-27).

McClure, C. (1994, Spring). User-based data collection techniques and strategies for evaluating networked information services. Library Trends, 42 (4), 591-607

Nicholson, S. & Stanton, J. (2003). Gaining strategic advantage through bibliomining: Data mining for management decisions in corporate, special, digital, and traditional libraries. In Nemati, H. & Barko, C. (Eds.). Organizational data mining: Leveraging enterprise data resources for optimal performance. Hershey, PA: Idea Group Publishing.

Peters, T. (1993). The history and development of transaction log analysis. Library Hi-Tech 42(11). 41-66.

Pike, K. (1982). Linguistic Concepts: An Introduction to Tagmemics. Lincoln: University of Nebraska Press.

Orr, R.H. (1973). Measuring the goodness of library services: A general framework for considering quantitative measures. Journal of Documentation 29(3). 315-332.

Orr, R.H., Pings, V., Pizer, I., & Olson, E. (1968). Development of methodology tools for planning and monaging library services: I. Project goals and approach. Bulletin of the Medical Library Association 56(3). 235-240.

Saracevic, T. (2000). Digital library evaluation: Toward an evolution of concepts. Library Trends 49(3), 350-369.

Saracevic, T. & Kantor, P. (1997). Studying the value of library and information services: Part 1, Establishing a theoretical framework. Journal of the American Society for Information Science. 48(6), 527-542.

Schamber, L. (1994). Relevance and information behavior. In Williams, M. E. (Ed.), Annual Review of Information Science and Technology,29. Medford, NJ: Learned Information, Inc. 3-48.

Scriven, M. (1991). Evaluation Thesaurus (4th edition). Newbury Park: Sage Publications.

Spasser, M. (n.d.). Realist Activity Theory for Digital Library Evaluation: Conceptual Framework and Case Study. Retrieved April 22, 2003 from http://…

Swanson, D. (1965). The evidence underlying the Cranfield results. Library Quarterly 35(1), 1-20.

Taylor, R. (1986). Value-Added Processes in Information Systems. Norwood, NJ: Ablex Publishing Corporation.

Tenopir, C. (2003). Use and users of electronic library resources: An overview and analysis of recent research studies. Washington, D.C.: Council on Library and Information Resources.

Van House, N., Weil, B., & McClure, C. (1990). Measuring academic library performance: A practical approach. CITE PUBLISHER.

Vrana, R. (2002). Digital Libraries - Creating Information Space Excellence: Is It Already Time for Benchmarking?. Paper presented at the 2002 CARNet Users Conference. Retrieved April 20, 2003 from http://public.srce.hr/~rvrana/cuc2002_vrana.pdf

Wilbur, C. (n.d.). Holistic Method. Retrieved August 19, 2003 from http://www.nd.edu/~cwilber/pub/recent/edpehol.html