The Evaluation of Research and the Evolution of Science Indicators. Current Science, 89(9), 2005, 1510-1517.

Leydesdorff, Loet (2005) The Evaluation of Research and the Evolution of Science Indicators. Current Science, 89(9), 2005, 1510-1517..

Full text available as:
HTM
PDF - Requires Adobe Acrobat Reader or other PDF viewer.

Abstract

Research evaluation is based on a representation of the research. Improving the quality of the representations cannot prevent the indicators from being provided with meaning by a receiving discourse different from the research system(s) under study. Since policy decisions affect the systems under study, this configuration generates a tension that has been driving the further development of science indicators since World War II. The article discusses historically the emergence of science indicators and some of the methodological problems involved. More recent developments have been induced by the emergence of the European Union as a supra-national level of policy coordination and by the Internet as a global medium of communication. As science, technology, and innovation policies develop increasingly at various levels and with different objectives, the evaluative discourses can be expected to differentiate with reference to the discourses in which they are enrolled.

EPrint Type:	Preprint
Subjects:	Science Technology Studies
ID Code:	1570
Deposited On:	25 October 2006
Alternative Locations:	http://www.leydesdorff.net/currsci/index.htm
Eprint Statistics:	View statistics for this eprint
Tell A Colleague:	Tell a colleague about it.

Abramowitz, M. 1956. Resource and Output Trends in the United States since 1870, American Economic Review, 46: 5-23.

Braun, T. (ed.). 1998. Topical Discussion Issue on Theories of Citation, Scientometrics 43: 3-148.

Braun, T., W. Glänzel, and A. Schubert . 1985. Scientometric Indicators. A 32-Country Comparative Evaluation of Publishing Performance and Citation Impact. Singapore/Philadelphia: World Scientific Publications.

Braun, T., W. Glänzel, and A. Schubert. 1989. Assessing Assessments of British Science. Some Facts and Figures to Accept or Decline, Scientometrics, 15: 165‑70.

Burt, R. S. 1982. Toward a Structural Theory of Action. New York, etc.: Academic Press.

Bush, V. 1945. The Endless Frontier: A Report to the President. Reprinted New York: Arno Press, 1980.

Callon, M., and B. Latour. 1981. Unscrewing the big Leviathan: how actors macro-structure reality and how sociologists help them to do so. In Advances in Social Theory and Methodology.Toward an Integration of Micro- and Macro-Sociologies, edited by K. D. Knorr-Cetina and A. V. Cicourel. London: Routledge & Kegan Paul, 277-303.

Callon, M., J.-P. Courtial, W. A. Turner, and S. Bauin. 1983. From Translation to Problematic Networks: An Introduction to Co-Word Analysis, Social Science Information, 22: 191-235.

Callon, M., J. Law, and A. Rip. 1986. Mapping the Dynamics of Science and Technology. London: Macmillan.

Carpenter, M. P., and F. Narin. 1973. Clustering of Scientific Journals, Journal of the American Society for Information Science, 24(6): 425-436.

Carlsson, B. (Ed.). 2002. New Technological Systems in the Bio Industries -- an International Study. Boston/Dordrecht/London: Kluwer Academic Publishers.

Casti, J. 1989. Alternate Realities. New York, etc.: Wiley.

Collins, H. M. 1985. The Possibilities of Science Policy, Social Studies of Science 15: 554-558.

Edwards, P. 1996. The Closed World, Computers and the Politics of Discourses in Cold War America, Cambridge, MA: MIT Press.

Elkana, Y., J. Lederberg, R. K. Merton, A. Thackray, and H. Zuckerman. 1978. Toward a Metric of Science: The advent of science indicators. New York, etc.: Wiley.

Etzkowitz, H., and L. Leydesdorff . 2000. The Dynamics of Innovation: From National Systems and ‘Mode 2’ to a Triple Helix of University‑Industry‑Government Relations, Research Policy, 29(2): 109-123.

Freeman, C. 2002. Continental, national and sub-national innovation systems—complementarity and economic growth, Research Policy 31: 191-211.

Garfield, E. 1979. Citation Indexing. Philadelphia, PA: ISI.

Gibbons, M., C. Limoges, H. Nowotny, S. Schwartzman, P. Scott, and M. Trow. 1994. The new production of knowledge: the dynamics of science and research in contemporary societies. London: Sage.

Giddens, A. 1976. New Rules of Sociological Method. London: Hutchinson.

Giddens, A. 1984. The Constitution of Society. Cambridge: Polity Press.

Glänzel, W., and U. Schöpflin. 1994. Little Scientometrics, Big Scientometrics.... and Beyond, Scientometrics, 30(2-3): 375-384.

Hicks, D., & J. S. Katz. 1996. Science Policy for a Highly Collaborative Science System. Science and Public Policy, 23, 39-44.

Irvine, J., B. Martin, T. Peacock, R. Turner. 1985. Charting the decline of British science, Nature 316: 587-90.

Kobayashi, S.-i. 2000. Applying Audition Systems from the Performing Arts to R&D Funding Mechanisms: Quality Control in Collaboration among the Academic, Public, and Private Sectors in Japan. Research Policy, 29(2), 181-192.

Latour, B.. 1987. Science in Action. Milton Keynes: Open University Press.

Lazarsfeld, P. F., and N. W. Henry. 1968. Latent structure analysis. New York: Houghton Mifflin.

Lewison, G., and P. Cunningham. 1991. Bibliometric Studies for the Evaluation of Trans-National Research, Scientometrics, 21: 223-244.

Leydesdorff, L. 1987. Various methods for the Mapping of Science, Scientometrics, 11: 291‑320.

Leydesdorff, L. 1988. Problems with the measurement of national scientific performance, Science and Public Policy, 15: 149-52.

Leydesdorff, L. 1992. A Validation Study of ‘LEXIMAPPE’, Scientometrics, 25: 295-312.

Leydesdorff, L. 1995. The Challenge of Scientometrics: The development, measurement, and self-organization of scientific communications. Leiden: DSWO Press, Leiden University; at http://www.upublish.com/books/leydesdorff-sci.htm .

Leydesdorff, L. 1997. Why Words and Co-Words Cannot Map the Development of the Sciences, Journal of the American Society for Information Science 48(5): 418-27.

Leydesdorff, L. 2001a. Indicators of Innovation in a Knowledge-based Economy, Cybermetrics, 5, Issue 1, Paper 2, at http://www.cindoc.csic.es/cybermetrics/articles/v5i1p2.html

Leydesdorff, L. 2001b. A Sociological Theory of Communication: The Self-Organization of the Knowledge-Based Society. Parkland, FL: Universal Publishers; at http://www.upublish.com/books/leydesdorff.htm .

Leydesdorff, L. 2005. Can Scientific Journals be Classified in terms of Aggregated Journal-Journal Citation Relations using the Journal Citation Reports? Journal of the American Society for Information Science and Technology (forthcoming).

Leydesdorff, L., and P. van den Besselaar. eds.. 1994. Evolutionary Economics and Chaos Theory: New directions in technology studies. London: Pinter.

Leydesdorff, L., and P. van den Besselaar. 1997. Scientometrics and Communication Theory: Towards Theoretically Informed Indicators, Scientometrics 38: 155-74.

Leydesdorff, L., and H. Etzkowitz. 1998. The Triple Helix as a model for innovation studies, Science and Public Policy, 25(3): 195-203.

Leydesdorff, L., and P. Wouters. 1999. Between Texts and Contexts: Advances in Theories of Citation? Scientometrics, 44: 169-182.

Luhmann, N. 1984. Soziale Systeme. Grundriß Einer Allgemeinen Theorie. Frankfurt a. M.: Suhrkamp.

Luhmann, N. 1990. Die Wissenschaft Der Gesellschaft. Frankfurt a.M.: Suhrkamp.

Lundvall, B.-Å. (ed.). 1992. National Systems of Innovation. London: Pinter.

Martin, B. R.. 1991. The Bibliometric Assessment of UK Scientific Performance. A Reply to Braun, Glänzel and Schubert, Scientometrics 20: 333-357.

Martin, B., and J. Irvine. 1983. Assessing Basic Research: Some Partial Indicators of Scientific Progress in Radio Astronomy, Research Policy 12: 61-90.

Marx, K. 1848. The Communist Manifesto. Paris.. Translated by Samuel Moore in 1888. Harmondsworth: Penguin, 1967.

Moed, H. F., W. J. M. Burger, J. G. Frankfort, and A. F. J. Van Raan. 1985. The Use of Bibliometric Data for the Measurement of University Research Performance, Research Policy, 14: 131-49.

Mulkay, M. J. 1976. The mediating role of the scientific elite, Social Studies of Science, 6: 445-470.

Narin, F. 1976. Evaluative Bibliometrics: The Use of Publication and Citation Analysis in the Evaluation of Scientific Activity, Washington, DC: National Science Foundation.

Narin, F., and E., Noma. 1985. Is Technology Becoming Science? Scientometrics, 7: 369-381.

Nederhof, A. J.. 1988. Changes in publication patterns of biotechnologists: An evaluation of the impact of government stimulation programs in six industrial nations, Scientometrics, 14: 475-485.

Nelson, Richard R. (ed.). 1993. National Innovation Systems: A comparative study. Oxford and New York: Oxford University Press.

NSF (2000). Science and Technology Then and Now. NSF Fact Sheet at http://www.nsf.gov/od/lpa/news/media/2000/bckgrdrst.htm (last visited Sep. 8, 2003).

Nowotny, H., P. Scott, and M. Gibbons. 2001. Re-Thinking Science: Knowledge and the Public in an Age of Uncertainty. Cambridge: Polity Press.

OECD. 1963, 31976. The Measurement of Scientific and Technical Activities: ‘Frascati Manual’. Paris: OECD.

OECD. 1964. The Residual Factor and Economic Growth. Paris: OECD.

Pavitt, K. 1984. Sectoral patterns of technical change: towards a theory and a taxonomy, Research Policy, 13: 343-73.

Persson, O., W. Glänzel, & R. Danell. (2003). Inflationary Bibliometric Values: The Role of Scientific Collaboration and the Need for Relative Indicators in Evaluative Studies. Paper presented at the 9th International Conference on Scientometrics and Informetrics, Beijing.

Pinski, G., and F. Narin. 1976. Citation Influence for Journal Aggregates of Scientific Publications: Theory, with Application to the Literature of Physics, Information Processing and Management, 12(5): 297-312.

Price, D. de Solla. 1963. Little Science, Big Science. New York: Columbia University Press.

Price, D. de Solla. 1970. Citation measures of hard science, soft science, technology and non-science. In: Communication among Scientists and Engineers, edited by C. E. Nelson & D. K. Pollock. Lexington, MA: D. C. Heath & Co, pp. 3-22.

Price, D. de Solla. 1978. Editorial statement, Scientometrics, 1: 7-8.

Rip, A. 1997. Qualitative Conditions for Scientometrics: The New Challenges, Scientometrics, 38(1): 7-26.

Rosenberg, N. 1976. Perspectives on Technology. Cambridge: Cambridge University Press.

Rousseau, R. 1997. Sitations: An exploratory study, Cybermetrics 1:1, at http://www.cindoc.csic.es/cybermetrics/articles/v1i1p1.html

Schubert, A., and T. Braun. 1993. Standards for Citation Based Assessments, Scientometrics 26: 21-35.

Skolnikoff, E. B. 1993. The Elusive Transformation. Princeton, NJ: Princeton University Press.

Small, H. 1973. Co-citation in the scientific literature: a new measure of the relationship between two documents, Journal of the American Society for Information Science, 24: 265-269.

Small, H., E. Sweeney, and E. Greenlee. 1985. Clustering the Science Citation Index Using Co-Citations II. Mapping Science, Scientometrics, 8: 321-340.

Studer, K. E., and D. E. Chubin. 1982. The Cancer Mission. Social Contexts of Biomedical Research. Beverly Hills, etc.: Sage.

Van den Daele, W., W. Krohn, and P. Weingart (eds.). 1979. Geplante Forschung. Frankfurt a.M.: Suhrkamp.

Wagner, C. S., & L. Leydesdorff. (2003). Mapping Global Science Using International Co-Authorships: A Comparison of 1990 and 2000. Paper presented at the 9th International Conference on Scientometrics and Informetrics, Beijing.

Weingart, P. (ed.). 1991. Die Wissenschaft in osteuropäischen Ländern im internationalen Vergleich—eine quantitative Analyse auf der Grundlage wissenschaftsmetrischer Indikatoren. Bielefeld: Kleine Verlag.

Whitley, R. R. 1984. The Intellectual and Social Organization of the Sciences. Oxford: Oxford University Press.

Wouters, P. 1999. The Citation Culture. Unpublished Ph.D. Thesis, University of Amsterdam.

Wouters, P., and L. Leydesdorff. 1994. Has Prices Dream Come True: Is Scientometrics a Hard Science? Scientometrics, 31: 193-222.

York, H. F.. 1970. Race to Oblivion: A Participants View of the Arms Race, New York: Simon and Schuster; at http://www.learnworld.com/ZNW/LWText.York.Race.Access.html