Citation Analysis of
Undergraduate Biology Department Honors Papers at the University of Denver
By
Joseph Kraus and Patricia Fisher
Abstract
The
librarians at the University of Denver have been interested in gathering usage
statistics of the libraries collections for many years. We have undertaken this
research to see how use of the library has changed over the last several
years. We were particularly interested
in seeing if students were citing Internet resources, or if they were solely
using traditional book and journal resources.
We wanted to see if students were using more journal sources now that
the library has so many electronic index/abstract/
full
text databases. We were also interested
in seeing if students were using more recent materials than in previous years.
What we researched
At
the end of the academic year, undergraduate honors students can present
research at a program called the
“Undergraduate Research Symposium.”
Many of the biology students take advantage of this research and
presentation opportunity. Over the
years, the Biology Department office has kept a copy of those papers. We photocopied the bibliographies of 51
biology papers from the most recent three years of the symposium – from 1997,
1998, and 1999. There were a total of
878 citations. We then put data into a
spreadsheet and evaluated the data.
Before we began this research, we had a certain set of expected results.
Expected Results
·
There
would be two to three times as many citations to journal articles as there are
to books or chapters.
·
About
10% of the citations would be to miscellaneous sources of information.
·
The
average age of a cited book or chapter would be about twice as old as a cited
journal article.
·
There
would be an increasing number of cited websites from 1997 to 1999.
·
The
older websites would have a greater chance of being more difficult to
find. About half of the websites would
have been cited incorrectly, changed URLs, changed servers, or simply vanished.
·
There
would be a small but significant number of citations to traditional sources of
information that would be counted as “unknown reports”. (In other words, there would be a small
number of bad citations.)
Actual Results
·
There
is about two and a half as many citations to journal articles as there are to
book or chapters. (67% to journal
articles, and 25% to books or book chapters.)
·
About
7% of the citations are to miscellaneous sources of information.
·
The
average age of a cited book or chapter is only slightly older than the average
cited journal article. (Average age for
a cited book is 10.2 years old, and the average age for a cited journal article
is 9.26 years old.)
·
There
was only one cited website in 1997, and there were four cited websites in each
of 1998 and 1999. This is much smaller
than we expected.
·
The
older websites were actually easier to find.
Four of the nine cited websites had been cited incorrectly, changed
URLs, changed servers, or simply vanished.
·
Of
the 878 citations, there were only four marked as “unknown reports”. Three of those four were bad citations, the
fourth was specifically listed as an “unknown report”.)
Conclusions and Findings
·
The
faculty members that advise the students have quite a bit of influence in the
sources that they use for their research.
·
The
advisors may be preparing their students for graduate level research. Thus, they want their students to be using
traditional print resources.
·
We
suspect that students use citation tracking to finder older sources of
information. For example, the faculty
adviser may give them a paper to read, and the student will use the older
sources cited in the paper for further information.
·
Citation
tracking may be used more often than electronic databases to find relevant
research.
·
Biology
students find older research to be just as useful as recently published
research. This is regardless of whether
it is a journal article or book resource.
Here
are some of the basic statistics.
|
Total Citations |
Books |
Journals |
Misc |
Web |
|
878 |
218 |
592 |
59 |
9 |
|
|
|
|
|
|
|
Percentage of total |
25% |
67% |
7% |
1% |
|
Total Number of Papers |
51 |
|
|
Years
|
|
Average age of book/chapter citation |
10.20 |
|
Average age of Journal article
citation |
9.26 |
|
Average age of miscellaneous citation |
4.69 |
Web Citations
1997
http://ulysses.atmos.colostate.edu/sum_form.html
URL works
1998
http://fonsg3.let.uva.nl:8001/Service/Statistics/Correlation_coefficient.html
URL works
http://fonsg3.let.uva.nl:8001/Service/Statistics/RankCorrelation_coefficient.html
URL works
http://www.epa.gov/OGWDW/wot/appa.html
URL works
http://h20-nwisw.er.usgs.gov/nwis-w/CO – Unable to
locate server – no redirect
Searched through USGS website to find – http://waterdata.usgs.gov/nwis-w/CO/
1999
http://www.stanford.edu/group/Urchins/gametes.html
File not found – Could not find while looking through Stanford’s
servers and group pages.
Emailed the cited author to see where it is.
2 typos in the URL – should be http://www.stanford.edu/group/Urchin/gametes.htm
http://nadp.sws.uiuc.edu/nadpata/depoRep
File not found – typo in the URL, missing a middle “d” in
“nadpdata”.
I am not sure what the “depoRep” file is. Emailed their administrator. Annual data can
be found here: http://nadp.sws.uiuc.edu/nadpdata/annualReq.asp?site=Custom156
http://www.dna.affrc.go.jp/nakamura-bin/showcodon.cgi?species=Chlamydomonas+reinhardtii+[gbpln]
File not found – when looking around www.dna.affrc.go.jp,
I find pointers to:
http://bank.dna.affrc.go.jp/~qxnakamr/CUTG.html
http://www.kazusa.or.jp/codon/ – Can do a search
to find:
http://www.kazusa.or.jp/codon/cgi-bin/showcodon.cgi?species=Chlamydomonas+reinhardtii+[gbpln]
http://www.nps.gov/cany/home.htm
URL works
(NOTE:
Blue URL’s indicate the URL given in the citation – Red URL’s indicate where
the URL can now be found if the original URL contained errors.)
References
Magrill, Rose Mary
and Gloriana St. Clair, “Undergraduate Term Paper Citation Patterns by
Disciplines and Level in Course,” Collection
Management 12(3/4), 1990, p. 25-56
McGrath, William E.,
“Relationships Between Hard/Soft, Pure/Applied, and Life/Nonlife Disciplines
and Subject Book Use in a University Library,” Information Processing and Management 14(1), 1978, p. 17-28
Schmidt, Diane,
Elisabeth B. Davis and Ruby Jahr, “Biology Journal Use at an Academic Library:
a Comparison of Use Studies,” Serials
Review 20(2), Summer, 1994, p. 45-64
St. Clair, Gloriana
and Rose Mary Magrill, “Undergraduate Term Paper Citations,” College & Research Libraries News,
51(1), January 1990, p. 25-28
St. Clair, Gloriana
and Rose Mary Magrill, “Undergraduate Use of Four Library Collections: Format
and Age of Materials,” Collection
Building 11(4), 1992,
p. 2-15
Appendix (Source data)
|
TITLE |
# of Citations |
#Books |
#Journals |
#Misc |
#E-res |
AgeBooksTotal |
AgeBooksAvg |
AgeJsTotal |
AgeJsAvg |
AgeMiscTotal |
AgeMiscAvg |
|
1997 |
|
|
|
|
|
|
|
|
|
|
|
|
An immunohistochemical
analysis of POMC related peptides in the pituitary of the cutthroat trout
(Oncorhynchus Clarki); an examination of the hormonal responses to stress. |
22 |
4 |
17 |
1 |
0 |
35 |
8.75 |
189 |
11.12 |
2 |
2.00 |
|
Inhibition of
p53-mediated apoptosis by sulfated glycoprotein-2 and B-cell
leukemia/lymphoma-2 |
48 |
9 |
39 |
0 |
0 |
61 |
6.78 |
354 |
9.08 |
|
#DIV/0! |
|
Effects of
Phosphodiesterase on IGF-1 induced maturation of Xenopus laevis Oocytes |
7 |
1 |
6 |
0 |
0 |
7 |
7.00 |
85 |
14.17 |
|
#DIV/0! |
|
Isolation and
phylogenetic analysis of Prolactin in Bufo marinus, the Marine Toad |
9 |
4 |
5 |
|
|
22 |
5.50 |
50 |
10.00 |
|
#DIV/0! |
|
Evaluation of
wortmannin inhibition of progesterone and IGF-1 stimulated xenopus laevis
oocyte maturation |
5 |
0 |
5 |
0 |
0 |
|
#DIV/0! |
12 |
2.40 |
|
#DIV/0! |
|
Water relations of
engelmann spruce saplings during winter 1996-1997: effects of snowcover and
decapitation from roots |
8 |
2 |
4 |
2 |
0 |
23 |
11.50 |
22 |
5.50 |
6 |
3.00 |
|
Biogeographic
distribution of mitochondria haplotypes among populations of the small-bodied
sage grouse |
13 |
1 |
8 |
4 |
0 |
8 |
8.00 |
69 |
8.63 |
6 |
1.50 |
|
A novel approach to
mtDNA separation from total genomic DNA using agarose gel electrophoresis |
12 |
7 |
5 |
0 |
0 |
43 |
6.14 |
78 |
15.60 |
|
#DIV/0! |
|
The effects of
cytochalasin J on microfilaments, microtubules, and vinculin, a protein
marker for adhesion plaques in PtK1 cells |
20 |
1 |
19 |
0 |
0 |
3 |
3.00 |
129 |
6.79 |
|
#DIV/0! |
|
Corticotrope
distribution and ACTH levels in the pituitary of the atlantic salmon |
10 |
2 |
4 |
4 |
0 |
7 |
3.50 |
40 |
10.00 |
2 |
0.50 |
|
The striking effects
of land use practices and Bromus tectorum invasion on phosphorus cycling
thorugh cryptobiotic crusts in a desert ecosystem of the Colorado Plateau |
26 |
9 |
14 |
3 |
0 |
53 |
5.89 |
174 |
12.43 |
20 |
6.67 |
|
Using differential
fluorescent staining to investiage apoptosis and differentiation in tadpole
tails |
11 |
7 |
2 |
2 |
0 |
11 |
1.57 |
8 |
4.00 |
7 |
3.50 |
|
Using WINWAT to
model shoot water contents in high-elevation Picea engelmannii and Abies
lasiocarpa during winter |
28 |
11 |
16 |
0 |
1 |
139 |
12.64 |
271 |
16.94 |
|
#DIV/0! |
|
The role of
microfilaments in the marginal band of avian erythrocytes |
18 |
5 |
13 |
0 |
0 |
78 |
15.60 |
95 |
7.31 |
|
#DIV/0! |
|
Computer-aided
quantification of cell proliferation in Halvacitate induced liver tumors |
5 |
0 |
4 |
1 |
0 |
|
#DIV/0! |
23 |
5.75 |
0 |
0.00 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1998 |
|
|
|
|
|
|
|
|
|
|
|
|
Identification of a
novel insect P450 with homology to mammaliam nifedipine oxidase |
15 |
4 |
11 |
|
|
12 |
3.00 |
76 |
6.91 |
|
#DIV/0! |
|
Characterization of
a cross hybridizing region of the avian sex chromosomes |
22 |
1 |
21 |
|
|
9 |
9.00 |
145 |
6.90 |
|
#DIV/0! |
|
Analyzing rapid
changes in gene sequences: cloning of a POMC cDNA from the pituitary of the
neoteleost fish, Oreochromis mossambicus |
9 |
1 |
8 |
|
|
4 |
4.00 |
77 |
9.63 |
|
#DIV/0! |
|
Avian species
richness in urban cattail wetlands: effects of wetland size, shape and
hydrology |
10 |
3 |
6 |
1 |
|
20 |
6.67 |
76 |
12.67 |
1 |
1.00 |
|
Scientific thinking
skills in science majors and non-science majors at the university of denver |
7 |
5 |
2 |
|
|
74 |
14.80 |
19 |
9.50 |
|
#DIV/0! |
|
The theory of
tensegrity in relation to the architecture of the cell and mitosis |
10 |
1 |
9 |
|
|
0 |
0.00 |
71 |
7.89 |
|
#DIV/0! |
|
Effects of the
fertilization envelope on early locomotory development |
10 |
3 |
1 |
6 |
|
87 |
29.00 |
27 |
27.00 |
41 |
6.83 |
|
Winter
photosynthesis of bristlecone pine |
11 |
3 |
7 |
|
1 |
21 |
7.00 |
85 |
12.14 |
|
#DIV/0! |
|
The isolation of
female specific avian DNA |
12 |
1 |
9 |
2 |
|
11 |
11.00 |
55 |
6.11 |
4 |
2.00 |
|
An analysis of
plant communities on Mt. Goliath, Colorado using fuzzy set ordination |
12 |
7 |
4 |
0 |
1 |
81 |
11.57 |
43 |
10.75 |
|
#DIV/0! |
|
Expression of
mitochondrial cytochrome P450 12B1 during the developmental stages of Drosophila
acanthoptera |
46 |
11 |
35 |
|
|
93 |
8.45 |
266 |
7.60 |
|
#DIV/0! |
|
Exploring the value
and potential of phylogenetic trees constructed from prolactin amino acid
sequences |
11 |
7 |
4 |
|
|
62 |
8.86 |
22 |
5.50 |
|
#DIV/0! |
|
Interactions of
cytoskeletal filaments |
14 |
5 |
8 |
1 |
|
26 |
5.20 |
46 |
5.75 |
0 |
0.00 |
|
An investigation of
the effects of pituitary hormone priming on the mRNA in Xenopus laevis
oocytes |
6 |
0 |
6 |
|
|
|
#DIV/0! |
55 |
9.17 |
|
#DIV/0! |
|
A comparison of
first-year wellness house residents and first-year residence hall residence
using techniques in exercise physiology |
18 |
8 |
8 |
2 |
|
63 |
7.88 |
146 |
18.25 |
2 |
1.00 |
|
Mobile tree islands
effects on soil nutrients in alpine ecosystems |
32 |
15 |
16 |
1 |
|
147 |
9.80 |
188 |
11.75 |
18 |
18.00 |
|
Effects of mining
pollution on the breeding distribution and density of the american dipper,
Cinclus mexicanus |
24 |
6 |
10 |
6 |
2 |
59 |
9.83 |
72 |
7.20 |
72 |
12.00 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1999 |
|
|
|
|
|
|
|
|
|
|
|
|
Ecology of sea
urchin early development: oxygen dependence |
20 |
11 |
4 |
5 |
|
176 |
16.00 |
44 |
11.00 |
15 |
3.75 |
|
Cytochalasin J
reduces anti-Dynein staining in PtK1 cells |
30 |
2 |
28 |
|
|
15 |
7.50 |
173 |
6.18 |
|
#DIV/0! |
|
Cloning of a 3'RACE
product of Polypterus senegalis |
28 |
2 |
26 |
|
|
23 |
11.50 |
313 |
12.04 |
|
#DIV/0! |
|
Can polypeptide
hormone sequences be used for phylogenetic studies: an analysis of the growth
hormone/prolactin/somatolactin gene family |
26 |
3 |
23 |
|
|
50 |
16.67 |
118 |
5.13 |
|
#DIV/0! |
|
Characterization of
a proenkephalin gene duplication : a model for neuropeptide evolution |
14 |
3 |
11 |
|
|
49 |
16.33 |
145 |
13.18 |
|
#DIV/0! |
|
Co-localization of
serotonin-like immunoreactivity with synaptic proteins in taste buds of the
rat |
23 |
2 |
20 |
1 |
|
40 |
20.00 |
122 |
6.10 |
0 |
0 |
|
Science reasoning
skills and attitudes about science in univeristy of denver faculty |
9 |
5 |
3 |
1 |
|
44 |
8.80 |
35 |
11.67 |
1 |
1 |
|
The isolation and
characterization of a novel cytochrome P450 |
34 |
6 |
28 |
|
|
73 |
12.17 |
258 |
9.21 |
|
#DIV/0! |
|
Krummholz
vegetation and nutrient composition are spatially distributed: results from
two alpine sites in Colorado |
19 |
4 |
13 |
2 |
|
42 |
10.50 |
106 |
8.15 |
20 |
10 |
|
Marine bacteriology
and the role of the fertilization envelope as a physical barrier to
contamination in Strongylocentrotus purpuratus |
14 |
6 |
|
7 |
1 |
91 |
15.17 |
|
#DIV/0! |
17 |
2.428571 |
|
Proenkephalin cDNA
in the brain of the ray-finned fish Polypterus senegalus |
10 |
3 |
7 |
|
|
44 |
14.67 |
94 |
13.43 |
|
#DIV/0! |
|
Analysis of the
phosphodiesterase mRNA levels in responsive and nonresponsive Xenopus laevis
oocytes |
7 |
0 |
7 |
|
|
|
#DIV/0! |
58 |
8.29 |
|
#DIV/0! |
|
The effects of
varying nitrogen levels on cryptobiotic soil crusts |
18 |
4 |
10 |
3 |
1 |
52 |
13.00 |
118 |
11.80 |
13 |
4.333333 |
|
The allometric relationships
of Stipa comata and Hilaria jamesii and their relevance to non-destructive
sampling in Canyonlands National Park |
8 |
2 |
6 |
|
|
16 |
8.00 |
45 |
7.50 |
|
#DIV/0! |
|
A PCR-based cloning
of Chlamydomonas reinhardtii Hydrogenase: biotechnology for the future of
energy production |
21 |
3 |
17 |
|
1 |
134 |
44.67 |
211 |
12.41 |
|
#DIV/0! |
|
Optimizing
expression of an insect cytochrome P450 gene in Escherichia coli |
29 |
5 |
24 |
|
|
27 |
5.40 |
267 |
11.13 |
|
#DIV/0! |
|
Effects of
nocodazole and taxol on cytoskeletal filaments |
29 |
6 |
22 |
1 |
|
31 |
5.17 |
173 |
7.86 |
|
0 |
|
Potassium as a
limiting nutrient for germination and production of cheatgrass (Bromus tectorum)
in the Canyonlands National Park, Utah |
15 |
6 |
5 |
3 |
1 |
48 |
8.00 |
84 |
16.80 |
30 |
10 |
|
Effects of retinoic
acid on Axolotl taste bud development from oropharyngeal endoderm |
13 |
1 |
12 |
|
|
10 |
10.00 |
48 |
4.00 |
|
#REF! |
|
Total Numbers |
878 |
218 |
592 |
59 |
9 |
2224 |
10.20 |
5480 |
9.26 |
277 |
4.69 |
|
Total Percentages |
|
24.83% |
67.43% |
6.72% |
1.03% |
|
|
|
|
|
|
|
|
|
books |
journals |
misc |
web |
|
|
|
|
|
|