Usability evaluation of the South London and Maudsley NHS Trust Library web site

Ebenezer, Catherine (2001) Usability evaluation of the South London and Maudsley NHS Trust Library web site . M.Sc. project, School of Library and Information Studies (SLAIS), University College, London.

Full text available as:
Microsoft Word Document (.doc) - Requires Microsoft Word

Abstract

A usability evaluation was carried out of the recently-launched South London and Maudsley NHS Trust library web site using a variety of standard methodologies: content and design evaluation of selected comparable sites, focus groups, a questionnaire survey of library and web development staff, heuristic evaluation, observation testing, card sorting/cluster analysis, and label intuitiveness/category membership testing. All test participants were staff of or providers of services to the trust. Demographic information was recorded for each participant. Unsuccessful attempts were made to evaluate user feedback, and to compare usability test results with usage statistics. Test participants’ overall responses to the site were enthusiastic and favourable, indicating the scope and content of the site to be broadly appropriate to the user group. Numerous suggestions for new content areas were made by testers. Usability problems were discovered in two main areas: in the organisation of the site, and in the terminology used to refer to information services and sources. On the basis of test results, proposals for a revised menu structure, improved accessibility, and changes to the terminology used within the site are presented.

EPrint Type:	Thesis
Keywords:	library web sites, web site usability, clinician information seeking, health libraries
Subjects:	Libraries Web Metrics Information Seeking Behaviors
ID Code:	518
Deposited On:	20 September 2004
Eprint Statistics:	View statistics for this eprint
Tell A Colleague:	Tell a colleague about it.

Aitchison, John and Miller, Caroline (2001)

Favourite web sites of UK GPs

At http://www.inpharm.com/netfocus/trends/articles_010.html [27/07/01]

Alderman, Charlotte (2000)

Net results. Nursing Standard 14(42) 27, 29-30

Anderson, Eric S (2001)

How to manage the library web site. At http://www.wiredlibrarian.com/htmlw/htmlfront.htm [05/08/01]

Anthony, Danielle and Formidoni, Bryan. (2001).

Deploying usability testing: simple steps to make sure visitors return to your site. Unix Insider, January 2001. At www.unixinsider.com/unixinsideronline/swol-01-2001/swol-0112-webmaster-af.html [05/02/01]

Anthony, Denis (1997)

The value of computer networks in nursing.

Professional Nurse 12(12) 865-568

Anthony, Denis (1998)

A qualitative analysis of computer networks in the British National Health Service. Nursing Standard 12(43).

At http://www.nursing-standard.co.uk/archives/vol12-43/ol-art.htm [28/06/01]

Anthony, Denis (2000)

The Internet “haves” and “have nots” in nursing. Presentation given at Healthcare Computing Conference, Harrogate, March 20-22 2000

Armstrong, C J et al. (2001)

A study of the use of electronic information systems by higher education students in the UK. Program 35(3) 241-262

Armstrong, C J et al. (2000)

JISC Usage Surveys: Trends in Electronic Information Services:

Strand A: A general survey of end users of all electronic information services:

Strand C: A general survey of electronic information services provision:

final report - 1999/2000 cycle.

At http://www.dil.aber.ac.uk/dils/research/justeis/cyc1rep0.htm [26/08/01]

Barak, A (1999)

Psychological applications on the Internet: a discipline on the threshold of a new millennium. Applied and Preventive Psychology 8 231-246. At http://construct.haifa.ac.il/~azy/app-r.htm [28/06/01]

Bawden, David and Robinson, Kay (1997)

Information behaviour in nursing specialities: a case study of midwifery

Journal of Information Science 23(6) 407-421

Benjes, Candice and Brown, Janis F (1998)

How usable is your web site? Usability tasks

http://www.usc.edu/hsc/nml/lis/staff/usable/questions.PDF [18/06/01]

Bernstein, Mark (2000)

Judging web sites: usability or criticism?

At http://www.eastgate.com/HypertextNow/archives/Merit.html [03/02/01]

Bremer, Jennifer and Bersein, Eugene V (2000)

Computers in psychiatry today

Academic Psychiatry 24(3) 168ff.

Campbell, Nicole et al. (1999)

Discovering the user: a practical glance at usability testing

Electronic Library 17(5) 307-311

Campbell et al. (2001)

Usability assessment methodologies. In Designing for the user: how to test for usability. At http://www.vancouver.wsu.edu/fac/diller/usability/contents.htm [03/02/01]

Cardwell, Catherine and Hunker, Stefanie Dennis (2000)

Necessary steps in library web site revision: previewing and beta-testing. In IOLS 2000 proceedings: New York, May 17-18th, 2000. Medford: Information Today, 2000; pp. 23-33

CAST: Center for Applied Special Technology (2000)

Bobby. At http://www.cast.org/bobby/ [08/01/01]

Chen, Hsinchun (1994)

Collaborative systems: solving the vocabulary problem

Computer 27(5) 58-66

Christiansen, Tom (2000)

Diversity compliance in Web design.

At http://language.perl.com/misc/div-www.html [[10/09/01]

Church, R D et al. (1999)

Using the Internet for postgraduate medical education

Hospital Medicine 60(5) 370-371

Clairmont, Michelle et al. (1998)

Testing for usability in the design of a new information gateway. Paper presented at Living the Future 2, Tucson, Arizona, April 1998. At http://dizzy.library.arizona.edu/library/teams/access9798/lftpaper.htm

[03/03/01]

Clyde, Laurel A (1996)

The library as information provider: the home page

Electronic Library 14(6) 549-558

Clyde, Laurel A (2000)

A strategic planning approach to Web site management

Electronic Library 18(2) 2000 97-108

Cohen, Laura B and Still, Julie M (1999)

A comparison of research university and two-year college library web sites: content, functionality and form

College and Research Libraries 60(3) 275-289

Cottrell, Janet and Eisenberg, Michael B (1997)

Web site design for information problem-solving: maximizing value for users

Computers in Libraries May 1997 17(5) 52-57

D’Angelo, John and Little, Sherry (1998)

Successful web pages: what are they and do they exist?

Information Technology and Libraries 18(4) 210-213

Davis, Francie C (2000)

Successful web page design: neither accident nor frill

At http://www.dowling.edu/library/papers/CIL/design/design.htm [04/08/01]

Davis, Linda M (2000)

Effect of systematic usability testing on web site development and facilitation. At http://web.missouri.edu/~Imd9f6/ResearchUsability.html [03/02/01]

Dean et al. (1998)

Report of the ELAC user survey task force on the electronic library menus

At http://www.wisc.edu/libraries/News/study.htm [10/08/01]

Dean et al. (1999)

UW-Madison library web site redesign: old and new web site designs.

At http://www.wisc.edu/libraries/News/study.htm [10/08/01]

Degener, Jutta (nd)

Dangerous words.

At http://kbs.cs.tu-berlin.de/~jutta/ht/writing/words.html [07/07/01]

Dewey, Barbara I (1999)

In search of services: findability of links on CIC university libraries’ web pages

Information Technology and Libraries 18(4) 210-213

Department of Health (1998)

Information for Health: an information strategy for the modern NHS

1998-2005: a national strategy for local implementation

London: DoH, 1998. Available on the Web at http://www.nhsia.nhs.uk/def/pages/info4health/contents.asp [28/07/01]

Department of Health (2000)

NHS identity guidelines: web sites

At http://www.doh.gov.uk/nhsidentity/websites.htm [11/10/00]

Detlefsen, Ellen Gay (1998)

The information behaviors of life and health scientists and health care providers: characteristics of the research literature

Bulletin of the Medical Library Association 86(3) 385-390

Dewey, Barbara I (1999)

In search of services: analysing the findability of links on CIC university libraries’ web pages

Information Technology and Libraries 18(4) December 210-213

Diaz, Karen (1998)

The role of the library web site: a step beyond deli sandwiches

Reference and User Services Quarterly 38(1) 41-43

Dickstein, R and Mills V (2000)

Usability testing at the University of Arizona library:

how to let the users in on the design

Information Technology and Libraries 19(3)

At http://www.lita.org/ital/1903_mills.html [09/06/01]

Diller, K et al. (1999)

Usability testing web page. At http://www.vancouver.wsu.edu/fac/diller/usability/contents.htm [03/02/01]

Disability Discrimination Act 1995. Chapter 50.

London: HMSO. At http://www.legislation.hmso.gov.uk/acts/acts1995.htm [24/08/01]

Dong, Jianming et al. (2000)

A user input and analysis tool for information architecture

At http://www-3.ibm.com/ibm/easy [27/07/01]

Drezner, Jeffrey L (1998)

A study of Internet use by physician treating HIV patients.

Medscape HIV/AIDS 4(3).

At http://www.medscape.com/medscape/HIV/journal/1998/v.04.n.03/ [04/08/01]

Eskins, Richard (2000)

Surfing the sludge: tips on good web page design

Free Pint issue 66. At http://www.freepint.co.uk/issues/060700.htm#feature [01/11/00]

Eysenbach, G and Diepgen, T L (1998)

Towards quality management of medical information on the Internet: evaluation, labelling and filtering of information.

BMJ 317 1496-1502

Fakhoury, Walid F H and Wright, Donna (2000)

Communication and information needs of a random sample of community psychiatric nurses in the United Kingdom

Journal of Advanced Nursing 32(4) 871-880

Farkas, David K and Farkas, Jean B (2000)

Guidelines for developing web navigation

Technical Communication 47(3) 341-358

Farmer, Jane et al. (1997)

Improving access to information for nursing staff in remote areas: the potential of the Internet and other networked information resources: executive summary. At http://www.rgu.ac.uk~sim/research/irn/irn.htm [25/08/01]

Farmer, Jane and Richardson, Amanda (1997)

Information for trained nurses in remote areas: do electronically networked resources provide an answer?

Health Libraries Review 14 97-103

Fleck, Evelyn and Levy, Sharon (2000)

Internet support for nurses and midwives

Professional Nurse 14(4) 280-282

Fichter, Darlene (2000)

Head start: usability testing up front

Online 25(1) 2000 79-81

Fourie, Ina (1999)

Creating Web sites in a library and information service environment:

some basic guidelines

Mousaion 17(2) 93-113.

Fowler, Susan (1998).

Appendix B: usability tests. In GUI design handbook. New York: McGraw-Hill. At http://www.fast-consulting.com/appb.htm [06/02/01]

France, Robert K et al. (1998)

Use and usability in a digital library search system.

At http://opac3.cc.vt.edu/Papers/Use_usability.html [25/01/00]

Frederickson-Mele et al. (1998)

Evaluating web site structure: a set of techniques

At http://stats.bls.gov/ore/htm%5Fpapers/st970070.htm [09/06/01]

Fuccella, Jeannette and Pizzolato, Jack (1998)

Creating Web site designs based on user expectations and feedback. Internetworking 1:1.

At http://www.internettg.org/newsletter/june98/web_design.html [10/08/01]

Gaffney, Gerry (2000)

Usability techniques: card sorting. At http://www.infodesign.au [2707/01]

Gawande, Atul and Bates, David W (2000)

The use of information technology in improving medical performance: part II physician support tools. Medscape General Medicine February 14. At http://www.medscape.com/Medscape/GeneralMedicine/journal/2000/v02.n01/ [04/08/01]

Glitz, Beryl (1997)

The focus group technique in library research: an introduction.

Bulletin of the Medical Library Association, 85:4 385-90

Graber, Mark A et al. (1999)

Using the World Wide Web to answer clinical questions: how efficient are different methods of information retrieval?

Journal of Family Practice 48(7) 520ff.

Guenther, Kim (1999)

Customized data delivery through Web portals: a case study

Online 23(6) 51-56

Gullikson, Shelley et al. (1999)

The impact of information architecture on academic web site usability

Electronic Library 17(5) 293-304

Halub, Lisa Parker (1999)

The value of Web-based library services at Cedars-Sinai Health System

Bulletin of the Medical Library Association 87(3) 256-259

Harrison, Joy et al. (2001)

The impact of access to the World Wide Web on evidence based practice (of nurses and professions allied to medicine).

At http://www.shef.ac.uk/uni/projects/impact/ [04/09/01]

Head, Alison J (1999)

Web redemption and the promise of usability

Online 23(6) 21-32

Head, Alison J (2000)

Demystifying intranet design: five guidelines for building usable sites

Online 24(4) 36-42

Hennig, Nicole et al. (2001a)

MIT Libraries’ web advisory group web redesign February 1999-June 2001.

At http://macfadden.mit.edu:9500/webgroup/project.html [10/08/01]

Hennig, Nicole (2001b)

Card sorting usability tests of the MIT Libraries' web site: categories from the users' point of view. In Usability Assessment of Library-Related Web Sites: Methods and Case Studies: LITA Guide 7, edited by Nicole Campbell, Chicago: LITA; p. 88-99

Hersh, William R (1998)

Applicability and quality of information for answering clinical questions

on the Web. JAMA 280(15) 1307-1308

Hester, Nolan (1999)

FrontPage for Windows 2000 visual quickstart guide

Berkeley, CA: Peachpit Press.

Hobson, Geoff (2000)

HTML notes: Workshop 2.4 Horizontal lines,

icons and other graphical images.

At http://mercury.tvu.ac.uk~geoff/html/www2/wwww24.htm [24/08/01]

Holden G, Rosenberg G, and Meenaghan T (2000)

Information for social work practice: observations regarding the role of the World Wide Web. Social Work in Health Care 32(1) 1-8

Houghton, David (2000).

Building an academic library website: experiences at De Montfort University. Program 34(3) 269-269

Huang, Milton P and Alessi, Norman E (1996)

The Internet and psychiatry

American Journal of Psychiatry 153(7) 861-869

Huang, Milton P and Alessi, Norman E (1999)

Clinical computing: challenges of the World Wide Web

Psychiatric Services 50 483-491

IBM (2001)

IBM ease of use guidelines: text.

At http://www-3.ibm.comibm/easy/eou_ext.nsf/EasyPrint/601 [24/08/01]

Instone, Keith

Usable Web. At http://usableweb.com

Instone, Keith (1997a)

Usability engineering for the Web. World Wide Web Journal 2(1)

At http://www.w3j.com/5/s3.instone.html [18/06/01]

Instone, Keith (1997b)

Site usability heuristics for the Web. WebReview October 10th. At http://www.webreview.com/1997/04_25/strategists/10_10_97_2.shtml [09/08/01]

Instone, Keith (1997c)

User test your web site. WebReview April 25th. At http://www.webreview.com/1997/04_25/strategists/04_25_97_1.shtml [09/08/01]

Instone, Keith (1997d)

Site usability evaluation. WebReview October 10th. At

http://www.webreview.com/1997/strategists/10_10_97_1.html [09/08/01]

Jadad, Alejandro and Gagliardi, Anna (1998)

Rating health information on the Internet: navigating to knowledge or Babel?

JAMA 279(8) 611-614

Jadad, Alejandro (1999)

Promoting partnerships: challenges for the internet age.

BMJ 319 761-764

Jadad, Alejandro et al. (2000)

The Internet and evidence-based decision making: a needed synergy for efficient knowledge management in health care

Canadian Medical Association Journal 162(3) 362-365

de Jong, Menno and van der Geest, Thea (2000)

Characterising web heuristics

Technical Communication 47(3) 311-326

Jordaan, Marieke and Jones, Richard (1999)

Adoption of Internet technology by UK postgraduate medical centres

Health Libraries Review 16 166-173

Kaiser, Jean (2001)

Criteria for web site evaluation. At http://webdesign.about.com/library/weekly/aa071801a.htm [08/08/01]

Kalbach, James (2000)

Designing for information foragers: a behavioural model for information seeking on the World Wide Web

Internetworking 3(3). At http://www.internettg.org/newsletter/dec00/article_information_foragers.html [14/08/01]

Kelly, Brian (2000b)

Performance indicators for web sites. Exploit Interactive 5 January 2001.

At http://www.exploit-lib.org/issue5/indicators/ [20/01/01]

Kelly, Brian (2000a) Software in use: externally-hosted web statistics services. Exploit Interactive, 5, April 2000. At http://www.exploit-lib.org/issue5/software-used/ [06/02/01]

Klein, Leo Robert (2000)

Web design and sin

Library Journal Summer 2000. At http://www.libraryjourna/com/klein.asp [24/10/00]

Kramer, Thomas and Kennedy, Robert (1998)

Useful websites for psychiatrists

Academic Psychiatry 22(2) 141f.

Lambeth, Southwark and Lewisham HA (2000)

Full local implementation strategy (LIS). At

http://www.doh.gov.uk/nhsexipu/implemen/flis/lambethslflisv11.pdf [08/08/01]

Laszig, Parfen (2000)

Psychoanalysis goes online—psychoanalytic resources on the Internet

Social Science Computer Review 18(2) 160-165

Lee, Alfred T (1998)

Web usability: a brief review of the research. At

http://pw1.netcom.com/~atlee/webusabreview.html [11/06/01]

Levi, Michael D and Conrad, Frederick G (1998). Usability testing of World Wide Web sites. At http://stats.bls.org/ore/htm_papers/st960150.htm [03/02/01]

Lim, Russell F (1996)

The Internet: applications for mental health clinicians in clinical settings, training and research

Psychiatric Services 47(6) 597-599

McCauley, Kym (2001)

Information architecture: building to have clients, or having clients to build?

LASIE 32(1) 7-18

McCready, Kate (1997)

Designing and redesigning: Marquette libraries’ web site

Library Hi Tech 15(3/4) 83-89

McGillis, Louise and Toms, Elaine G (2001)

Usability of the academic library web site: implications for design

College and Research Libraries 62 355-367

McKnight, M and Peet, M (2000)

Health care providers' information seeking: recent research

Medical Reference Services Quarterly 19(2) 27-50

McMullen, Susan (2000).

Usability testing and library web site redesign at Roger Williams University.

At http://gamma.rwu.edu/users/smcmullen/usable.html [03/02/01]

McMullen, Susan (2001)

Usability testing in a library web site redesign project

Reference Services Review 29 (1): 7-22