Here are the contest results!
To identify the most cited ecology paper published in the last 10 years, on July 19 I searched Web of Science on the topic “ecology” for the years 2002-2012 and sorted the results by number of citations. I was just going to go with that, but then a guess by one of the contestants revealed that that search procedure unaccountably misses a few very highly cited ecology papers. So I redid the search, also including papers published in every leading ecology journal (and many not-so-leading ones). I can’t promise that I haven’t missed something, but I’ve done the best I can. As always, you get the background research you pay for on this blog. ๐ (UPDATE #2: my background research stinks; see below)
The most cited ecology paper published in the last 10 years is*…[drumroll]…wait for it!…
1. Milo, R. et al. 2002. Network motifs: simple building blocks of complex networks. Science 298:824-827. Cited 1544 times.
I remember this paper well. Milo et al. examine the relative frequencies of different “network motifs” in real-world networks of all sorts. A network motif is a small number of nodes and links arranged in a particular way. For instance, a “linear chain”, like website A links to site B, which links to site C; or species A eats B, which eats C. Milo et al. show that the relative frequencies of different motifs vary systematically across networks of different types, in ways that can be understood in terms of what the networks are designed (or in the case of food webs, not designed) to do. “Networks” have been a hot topic for about the last decade, both within and outside ecology, so Milo et al. is widely-cited in multiple fields. Also, it was published 10 years ago, so it’s had the maximum amount of time to accumulate citations.
Surprisingly, Milo et al. is an original research paper, not a review, a “perspectives” piece (which is really a sort of review), or a methods paper. But most of the remaining papers on the list do fall into one of those categories. The rest of the papers in the top 20 also tend to fall in certain topic areas: climate change, causes and consequences of biodiversity loss, and (to my surprise) modeling species’ geographic ranges. Only one on biodiversity and ecosystem function, to my mild surprise. Nothing on neutral theory, not to my surprise. Interest in that topic was kicked off before 2002, and kicked off by Hubbell’s book**, not by a highly-cited paper. The papers below also come mostly from certain journals: Science (want to publish a highly cited ecology paper? publish a review or perspectives piece in Science!), Ecology, Ecology Letters,ย AREES, and TREE (but not Natureย or PNAS, surprisingly…). And a surprisingly large fraction of them (well, surprising to me) only have one or a small number of authors. By no means are they all from big working groups.
UPDATE: List numbering corrected
UPDATE #2. Dadgummit, my revised search procedure still missed at least two massively-cited ecology papers. Curse you, Web of Science topic fields! As a commenter points out, Walther et al. 2002 Nature (a review of ecological responses to recent climate change) has been cited 2238 times (not sure if that’s the WoS or Google Scholar number). So that’s actually the #1 paper. The real #2 is Thomas et al. 2004 Nature (a research paper estimating extinction risks from climate change), cited 1710 times. The commenter also suggests that Venter et al. 2004 Science (shotgun sequencing of the Sargasso Sea prokaryote fauna) should count, but I don’t consider that enough of an ecology paper to list. Well, at least these additions don’t change the contest winner. The addition of Walther et al. and Thomas et al. to the top of the list certainly reinforces the dominance of the list by papers on climate change and biodiversity loss. And Thomas et al. replaces Milo et al. as the number one original research paper on the list.
2. Hooper, D. U. et al. 2005. Effects of biodiversity on ecosystem functioning: a consensus of current knowledge. Ecological Monographs 75:3-35. Cited 1324 times. A major review of biodiversity and ecosystem function, written by a bunch of famous people, published in a leading journal. Probably the only surprise is that it’s not #1!
3. Eckburg, P.B. et al. 2005. Diversity of the human intestinal microbial flora. Science 308:1635-1638. Cited 1256 times. An ecology paper, but also a microbiology and genomics paper, so like Milo et al. highly cited in part because it’s cited in multiple fields. Also the only other paper on the list besides Milo et al. that’s not a review, perspectives, or methods paper.
4. Elith et al. 2006. Novel methods improve prediction of species’ distributions from occurrence data. Ecography 29:129-151. 1213 citations.
5. Post, D.M. 2002. Using stable isotopes to estimate trophic position: Models, methods, and assumptions. Ecology 83:703-718. 1154 citations.
6. Parmesan, C. 2006. Ecological and evolutionary responses to recent climate change. Ann. Rev. Ecol. Evol. Syst. 37:637-669. 1134 citations.
7. Fahrig, L. 2003. Effects of habitat fragmentation on biodiversity. Ann. Rev. Ecol. Evol. Syst. 34:487-515.
8. Phillips. S.J. et al. 2006. Maximum entropy modeling of species geographic distributions. Ecological Modelling 190:231-259. 1028 citations.
9. Brown, J.H. et al. 2004. Toward a metabolic theory of ecology. Ecology 85:1771-1789. 953 citations.
10. Guisan, A. and Thuiller, W. 2005. Predicting species distribution: offering more than simple habitat models. Ecology Letters 8:993-1009. 944 citations.
11. Johnson, J.B. and Omland, K.S. 2004. Model selection in ecology and evolution. Trends in Ecology and Evolution 19:101-108. 857 citations.
12. Pearson, R.G. and Dawson, T.P. 2003. Predicting the impacts of climate change on the distribution of species: are bioclimate envelope models useful? Global Ecology and Biogeography 12:361-371. 758 citations.
13. Zane, L. et al. 2002. Strategies for microsatellite isolation: a review. Molecular Ecology 11:1-16. 722 citations. A methods paper, but one widely cited outside ecology as well as within ecology.
14. Worm, B. et al. 2006. Impacts of biodiversity loss on ocean ecosystem services. Science 314:787-790. 713 citations.
15. Leibold, M.A. et al. 2004. The metacommunity concept: a framework for multi-scale community ecology. Ecology Letters 7:601-613. Cited 649 times. This was my guess for #1. Given that I haven’t even heard of many of the papers on this list, I’m pretty pleased with myself for managing to guess a paper in the top 20.
16. Sitch, S. et al. 2003. Evaluation of ecosystem dynamics, plant geography and terrestrial carbon cycling in the LPJ dynamic global vegetation model. Global Change Biology 9:161-185. 645 citations.
17. Pimentel, D. et al. 2005. Update on the environmental and economic costs associated with alien-invasive species in the United States. Ecological Economics 52:273-288. 629 citations.
18. Hoegh-Guldberg, O. et al. 2007. Coral reefs under rapid climate change and ocean acidification. Science 318:1737-1742. 617 citations. The most recent paper in the top 20.
19. MacKenzie, D.I. et al. 2002. Estimating site occupancy rates when detection probabilities are less than one. Ecology 83: 2248-2255. 614 citations.
20. Harvell, C.D. et al. 2002. Climate warming and disease risks for terrestrial and marine biota. Science 296:2158-2162. 609 citations.
So how did our contestants do?
butterflyskip: Tilman 2004 PNAS was cited 332 times through July 19, 2012. It’s a measure of how long the tail of the citation distribution is that a paper like this, by a famous guy, on a hot topic, published 8 years ago in one of the world’s most prominent venues, could be so highly cited and yet not even come close to making the top 20. Good guess though!
Jarrett Byrnes: Worm et al. 2006. Excellent guess, #14 on the list.
Gregor: Brown et al. 2004. Also an excellent guess, #9 on the list.
Dale Nimmo: Elith et al. 2006. Great guess, #4 on the list. A good enough to guess to win, if only it had come in sooner!
Similarly, Florian Schneider intended a guess that would’ve won if only our winner hadn’t guessed it first. So Florian guessed Finke and Denno 2004. A good guess, but as you’ve seen, original research papers needed to be more interdisciplinary than Finke and Denno (cited 177 times) to make this list.
Eric Pedersen wins for guessing Hooper et al. 2005! Great guess, #2 on the list. In retrospect, I’m actually kicking myself for not guessing this, I’m very familiar with this paper, not sure why I went with Leibold et al. instead. This is the guess that revealed to me that my original search procedure was flawed. I went to check how well our contestants did, discovered Hooper et al. had been cited over 1300 times but was not considered an “ecology” paper by WoS, and said a naughty word. ๐
For being the first to guess a paper in the top 5, Eric wins a beer from me at the ESA meeting. Thanks for playing everyone!
*Actually, according to Web of Science, the most cited “ecology” paper of the last 10 years is Stamatakis, A. 2006. RAxML-VI-HPC: Maximum likelihood-based phylogenetic analyses with thousands of taxa and mixed models. Bioinformatics 22:2688-2690, cited 1984 times. But I decided that this is really an evolution paper, not an “ecology” paper, so I omitted it from the list, along with a few other papers I judged not to be “ecology” papers. Obviously, if you’re really into phylogenetic approaches to ecology you could argue with me on the omission of this paper.
**By the way, younger readers may not be aware that Hubbell’s Princeton Monograph is not where he first proposed his neutral theory. He first proposed it in a paper in Coral Reefs in 1997.
you have two #9’s btw.
Thanks! Fixed.
There are three other huge papers missing from the list!
Walther et al. Nature 2002. (2,238 citations)
Thomas et al. Nature 2004. (1,710 citations)
Venter et al., Science 2004. (1,725 citations)
Ok, Walther et al. and Thomas et al. are big misses (curse you Web of Science definition of “ecology”!). I would question whether the Venter et al. counts as an ecology paper, but one could argue either way. I’ll update the post.
Worth noting that adding Walther et al. and Thomas et al. increases the proportion of papers about climate change and biodiversity loss on the list.
Ha. Excellent.
I was so very wrong. My guess was definitely playing the wrong league. That should probably tell me something about my narrow focus: “Every paper (I read) cites that one!”; or that I do not value the importance of papers by their number of citations. Should I?
Anyhow, Milo et al. 2002: Very impressive. But I wonder how much it is cited by other ecology papers. One could argue that it is not really an ecology paper, as well, because food webs are only one of many networks that the authors compared. It definitely is excellent interdisciplinay research and it was very important for the developments in food web theory.
Milo et al. certainly is interdisciplinary, but it’s been cited enough by “pure” ecology papers on food web structure that I can’t imagine not counting it. Plus, having Milo et al. as #1 made the guessing game much harder. ๐ (though of course it turns out Milo et al. isn’t actually #1…)
Having said that, if you were to only count citations by “pure” ecology papers, Milo et al. wouldn’t be in the top 20.
Never would have guessed it was Milo et al. However, looking at citation rates (rather than raw numbers) tends to shake things up quite a lot amongst the top ten papers (citation # scaled by n.5 years), except the top 2.
1. Walther et al (2002) = 213.14 citations yr-1
2. Thomas et al (2004) = 201.18
3. Elith et al (2006) = 186.62
4. Hooper et al (2005) = 176.53
5. Parmesan (2006) = 174.46
6. Eckburg et al (2005) = 167.47
7. Phillips et al (2006) = 158.15
8. Milo et al (2002) = 147.05
9. Fahrig et al (2003) = 110.84*
10. Post (2002) = 109.9
This is a quick and dirty follow-up analysis; there may be papers ranked 11 – 22 (or 9 to 20 given their original ranks) that would appear in the top 10 of citation rates, or papers published in Jan 20xy vs Dec 20xy. Or others that weren’t even in the top 22 given their recent publication date and numerically lower number of citations [Really? No important ecology papers have been published since 2007? ;)].
The whole exercise also highlights an interesting phenomenon: ‘popular’ papers are cited for vastly different reasons. Brown et al (2004) is an interesting example, as it’s arguably been cited so frequently because many people believe it is wrong, or at least highly controversial. IIRC (part of) a special issue of Ecology was devoted to rebuttals and discussion of this paper – that already generated more citations and publicity for the original paper.
* Citation number not present in original post. Rate calculation based on the average of Parmesan & Phillips papers.
In terms of reasons why things are cited, I didn’t even get into that because that’s a huge can of worms. And I’ll posit that no one has the first clue what to do about it. There’s no such thing as a semantic altmetric, an altmetric based on the meanings of citations, and no prospect of one.
If I had to guess, I’d bet that several of the top-cited climate change and biodiversity loss papers are highly cited because everybody who says “Climate change is a big problem” in the first paragraph of their Introduction cites one of those papers. Does that make those papers highly “influential” or “high impact” or “important” or whatever it is that citation indices are supposed to capture? Maybe. I don’t really know. I just wanted to have a bit of fun with one readily-available number. ๐
By the way, if you just want to look at citations/year, without regard to when an article was published, you’ll have to look at the entire history of ecology to identify the top articles. Connell 1978 (the paper coining the term “intermediate disturbance hypothesis”) has been cited about 200 times/year for the last five years, and I’m sure it’s not the only classic paper with a very high citation rate.
It would be a lot of work, but also possibly fun, to figure out what were the most cited papers in, say, 1982, and go back and read them. Also look at how often they’re still cited today. Anthony Lane, the New Yorker writer, has a couple of great essays along these lines. He went back and read the top 10 books on the NY Times bestseller list from decades previously, to see what people were reading back then and how those books held up today.
50 shades of grey? We’re gonna look so bad in the future…
Pingback: Contest! Guess the most-cited ecology papers from the 70s, 80s, and 90s | Dynamic Ecology
Pingback: Happy Birthday to us! | Dynamic Ecology
Pingback: What are the most cited neuroscience papers in the last 10 years? | neuroecology
Pingback: Natural history, synthesis papers and the academic caste system | Small Pond Science
Hey Jeremy!
Just came across your top paper competition. I didn’t guess any in your top 20. How many papers did your search cover? I am looking for data on the total number of ecology papers published every year, but can’t find anyone who already has the data to save me the effort. Might be a good guessing competition (like how many candies in a jar)…..
Best wishes
Roger Cousens
Sorry Roger, I don’t have data on total number of ecology papers published each year. It’s not easy to estimate.
I know, which is why I hoped someone else had done it! Thought it was worth asking…..
Thanks
Roger