Judgment of information quality and cognitive authority in the web

Rieh, Soo Young (2002) Judgment of information quality and cognitive authority in the web. Journal of the American Society for Information Science and Technology 53(2):pp. 145-161.

Full text available as:
PDF - Requires Adobe Acrobat Reader or other PDF viewer.

Abstract

This is a preprint of an article published in the Journal of the American Society for Information Science and Technology, 53, 145-161. This study examines the problem of the judgment of information quality and cognitive authority by observing people’s searching behavior in the Web. Its purpose is to understand the various factors that influence people’s judgment of quality and authority in the Web, and the effects of those judgments on selection behaviors. It was found that the subjects made two distinct kinds of judgment: predictive judgment and evaluative judgment. The factors influencing each judgment of quality and authority were identified in terms of characteristics of information objects, characteristics of sources, knowledge, situation, ranking in search output, and general assumption.

EPrint Type:	Journal (Paginated)
Keywords:	Information quality, Evaluation of web information, cognitive authority, credibility, web searching behavior
Subjects:	Information Seeking Behaviors
ID Code:	1167
Deposited On:	09 June 2006
Alternative Locations:	http://www3.interscience.wiley.com/cgi-bin/abstract/88512951/ABSTRACT
Eprint Statistics:	View statistics for this eprint
Tell A Colleague:	Tell a colleague about it.

Amento, B., Terveen, L., & Hill, W. (2000). Does “authority” mean quality? predicting expert quality ratings of Web documents. Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 296-303.

Barry, C. L. (1994). User-defined relevance criteria: An exploratory study. Journal of the American Society for Information Science, 45(3), 149-159.

Barry, C., & Schamber, L. (1998). Users’ criteria for relevance evaluation: A cross-situational comparison. Information Processing and Management, 34(2/3), 219-236.

Bateman, J. (1999). Modeling the importance of end-user relevance criteria. Proceedings of the 62nd ASIS Annual Meeting, 36, 396-406.

Belkin, N. J. (1993). Interaction with texts: information retrieval as information seeking behavior. Information Retrieval ‘93: Von der Modellierung zur Anwendung. Proceedings of the First Conference of the Gesselschaft für Infomatik Fachgruppe Information Retrieval, Regensburg. Konstanz: Universitätsverlag Konstanz, 55-66.

Belkin, N. J. (1996). Intelligent information retrieval: Whose intelligence? Proceedings of the Fifth International Symposium for Information Science, Konstanz: Universitätsverlag Konstanz, 25-31.

Cooke, A. (1999). Authoritative guide to evaluating information on the Internet. New York: Neal-Schuman.

Cool, C., Belkin, N. J., Frieder, O., & Kantor, P. (1993). Characteristics of texts affecting relevance judgments. Proceedings of the 14th National Online Meeting, 77-84.

Fidel, R. et al. (1999). A visit to the information mall: Web searching behavior of high school students. Journal of the American Society for Information Science, 50(1), 24-37.

Fontana, A., & Frey, J. H. (1994). Interviewing: The art of science. In N. K. Denzin, & Y. S. Lincoln (Eds.), Handbook of qualitative research (pp. 361-376). Thousand Oaks, CA: Sage.

Fritch, J. W., & Cromwell, R. L. (2001). Evaluating Internet resources: Identity, affiliation, and cognitive authority in a networked world. Journal of the American Society for Information Science and Technology, 52(6), 499-507.

Hogarth, R. M. (1987). Judgment and choice: The psychology of decision. 2nd Ed. New York: John Wiley & Sons.

Holsti, O. R. (1969). Content analysis for the social sciences and humanities. Reading, MA: Addison-Wesley.

Huber, O. (1989). Information-processing operators in decision making. In H. Montgomery & O. Svenson (Eds.), Process and structure in human decision making (pp. 3-21). New York: John Wiley & Sons.

Janes, J. W., & Rosenfeld, L. B. (1996). Networked information retrieval and organization: Issues and questions. Journal of the American Society for Information Science, 47(9), 711-715.

Jansen, B. J., Spink, A., & Saracevic, T. (2000). Real life, real users, and real needs: A study and analysis of user queries on the web. Information Process and Management, 36, 207-227.

Jeong, M. (1998). Measurement of information quality on lodging websites: An experimental study with eight hypothetical lodging websites. Unpublished doctoral dissertation, The Pennsylvania State University.

Kjartansdóttir, A., & Widenius, M. (1995). The quality of business information on the Internet: Evaluation criteria applicable to Internet resources. Swedish Library Research, 3-4, 43-50.

Kleinberg, J. M. (1999). Authoritative sources in a hyperlinked environment. Journal of the Association for Computing Machinery, 46(5), 604-632.

Klobas, J. E. (1995). Beyond information quality: Fitness for purpose and electronic information resource use. Journal of Information Science, 21(2), 95-114.

Krippendorf, K. (1980). Content analysis: An introduction to its methodology. Beverly Hills, CA: Sage.

Marchand, D. (1990). Managing information quality. In I. Wormell (Ed.), Information quality: Definitions and dimensions (pp. 7-17). Los Angeles: Taylor Graham.

Nilan, M. S., Peek, R. P., & Snyder, H. W. (1988). A methodology for tapping user evaluation behaviors: An explorations of users’ strategy, source and information evaluating. Proceedings of the 51st ASIS Annual Meeting, 25, 152-159.

Olaisen, J. (1990). Information quality factors and the cognitive authority of electronic information. In I. Wormell (Ed.), Information quality: Definitions and dimensions (pp. 99-120). Los Angeles: Taylor Graham.

Park, T. K. (1993). The nature of relevance in information retrieval: An empirical study. Library Quarterly, 63(3), 318-351.

Pharo, N. (1999). Web information search strategies: A model for classifying web interaction? In T. Aparac, T. Saracevic, P. Ingwersen, & P. Vakkari (Eds.), Digital Libraries: Interdisciplinary concepts, challenges and opportunities, Proceedings of the 3rd International Conference on the Conceptions of the Library and Information Science (CoLIS3) (pp. 207-218). Lokve, Croatia: Benja Publishing.

Price, S. L., & Hersh, W. R. (1999). Filtering web pages for quality indicators: An empirical approach to finding high quality consumer health information on the World Wide Web. Proceedings of the 1999 Annual Symposium of the American Medical Informatics Association, 911-915.

Rachlin, H. (1989). Judgment, decision, and choice: A cognitive/behavioral synthesis. New York: W. J. Freeman and Company.

Rieh, S. Y., & Belkin, N. J. (2000). Interaction on the Web: Scholars’ judgment of information quality and cognitive authority. Proceedings of the 63rd ASIS Annual Meeting, 37, 25-38.

Rieh, S. Y., & Belkin, N. J. (1998). Understanding judgment of information quality and cognitive authority in the WWW. Proceedings of the 61st ASIS Annual Meeting, 35, 279-289.

Saracevic, T. (1997). The stratified model of information retrieval interaction: Extension and applications. Proceedings of the 60th ASIS Annual Meeting, 34, 313-327.

Saracevic, T., & Kantor, P. (1997). Studying the value of library and information services. Part I: Establishing a theoretical framework. Journal of the American Society for Information Science, 48(6), 527-542.

Schamber, L. (1991). Users’ criteria for evaluation in a multimedia environment. Proceedings of the 54th ASIS Annual Meeting, 28, 126-133.

Smith, A. G. (1997). Testing the Surf: Criteria for evaluating Internet information resources. The Public-Access Computer Systems Review [On-line], 8(3). Available: http://info.lib.uh.edu/pr/v8/n3/smit8n3.html

Spink, A., & Greisdorf, H. (2001). Regions and levels: Measuring and mapping users’ relevance judgments. Journal of the American Society for Information Science and Technology, 52(2), 161-173.

Strauss, A., & Corbin, J. (1994). Grounded theory methodology: An overview. In N. K. Denzin and Y. S. Lincoln (Eds.), Handbook of qualitative research (pp. 273-285). Thousand Oaks, CA: Sage.

Tate, M., & Alexander, J. (1996). Teaching critical evaluation skills for World Wide Web resources, Computers in Libraries, 16(10), 49-55.

Taylor, R. S. (1986). Value-added processes in information systems. Norwood, NJ: Ablex Publishing.

Wang , P. (1997). The design of document retrieval systems for academic users: Implications of studies on users’ relevance criteria. Proceedings of the 60th ASIS Annual Meeting, 34, 162-173.

Wang, P., Hawk, W. B., & Tenopir, C. (2000). Users’ interaction with World Wide Web resources: An exploratory study using a holistic approach. Information Processing and Management, 36, 229-251.

Wang, P., & Soergel, D. (1999). A cognitive model of document use during a research project. Study II: Decision at the reading and citing stages. Journal of the American Society for Information Science, 50(2), 98-114.

Wang, P., & Soergel, D. (1998). A cognitive model of document use during a research project. Study I. Document selection. Journal of the American Society for Information Science, 49(2), 115-133.

Wilson, P. (1983). Second-hand knowledge: An inquiry into cognitive authority. Westport, CT: Greenwood Press.

Zhu, X., & Gauch. S. (2000). Incorporating quality metrics in centralized/distributed information retrieval on the World Wide Web. Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 288-295.