Senior Oikos editors Dustin Marshall and Dries Bonte have a great piece on why they reject most proposed Forum articles. If you don’t know, Forum articles are opinion and perspective-type pieces, often used by Oikos authors to try to influence the direction of ecology. Turns out many proposed Forum articles share some common flaws. Below are some musings on the broader issues raised by Marshall & Bronte’s piece, including a grouchy rant about “conceptual models”.
Their paraphrased advice, with some choice quotes to encourage you to click through:
- DO slay zombie ideas. “[A] single feature unites the best [Forum papers]: the author felt compelled to write it. The most effective Forum pieces are those that the author felt just had to be written, that the field was limping along under a misguided principle, that key principles were misunderstood, or despite what the field thought it knew, it actually didn’t.”
- DON’T just tell readers that your new framework/approach will work–show that it does work, empirically. “[T]here are lots of approaches/frameworks/
model systems out there, an overwhelming number actually…[W]e see the appeal of writing a Forum piece to catalyse the uptake of some great new thing. The problem is, we rarely see such an approach succeed. At the very least, ecologists are likely to be wary of a new thing until they see the proponents of the thing successfully tackle a range of problems themselves.”
- DON’T try to use a Forum paper to respond to someone who said something about your work that you didn’t like. “We do not publish such exchanges in OIKOS as we have not seen much evidence that they are productive.”
Re: #1, I’m glad to know Dustin and Dries would’ve approved of Fox (2013), because that’s exactly how I felt when writing it.* 🙂
Re: #1 and 2, there’s something of a tension between them. There aren’t many papers that show serious problems with existing ideas (#1), and replace them with new ideas, and show empirically that those new ideas work (#2). That’s just a lot to do in one paper.
Re: #2, for better or worse (and it is some of both), Marshall & Bronte are right. Ecologists mostly won’t give up on an established approach, no matter how flawed, unless there’s a direct replacement, because basically nobody ever considers “go work on something else instead” as a “replacement”. I disagree with this attitude, but that’s the way it is, and in fairness it’s not unreasonable. Similarly, in order to adopt some new approach, ecologists usually need to be convinced, with data, that it’s an improvement on existing approaches to the same problem. And in order to adopt some new conceptual framework, research direction, etc., ecologists usually need to be convinced with data that it’s worth pursuing (and ideally, that pursuing it would be an easy route to a quick, high profile paper). There are exceptions, of course. For instance, Leibold et al. 2004 Ecol. Lett. kicked off the metacommunity bandwagon without any new data, new analyses of existing data, or even new theory. But the exceptions are rare. My own personal experience backs this up. One reason among others that Fox (2013) hasn’t had much impact is that I only talked about how not to study disturbance-diversity relationships, without showing, or even telling, how to do it (in my defense, I was up against the length limit). And my proposal for using the Price equation to study biodiversity-ecosystem function relationships (Fox 2006 Ecology) was rejected after review by Nature because I didn’t include any empirical examples. I added in several empirical examples and got good reviews at Ecology. And even then nobody else took up the approach; showing that your new approach works with real data is necessary, not sufficient, to get others to take it up. That may be changing–Winfree et al. 2015** is an empirical application of my Price equation approach that seems to have made a bit of a splash and shows signs of catalyzing wider take up of the approach. As another example, think of Peter Chesson’s work on coexistence theory, widespread interest in which is finally taking off in large part because a critical mass of people have started applying it to data.
Re: #2, specifically the “there are lots of approaches/frameworks/model systems out there” bit, I’m going to be blunter than Marshall & Bronte. “Perspectives”, “approaches” and (verbal) “conceptual frameworks” are a dime a dozen.*** Everybody with a Ph.D. already has their own perspective on the world, their own verbal conceptual framework, and their own toolkit of preferred approaches, thank you very much. So when you propose new ones, you’re not filling a need. Nobody wants to read an advertisement for your own verbal conceptual framework or preferred approach, dressed up with made up figures. This is true for anything that could be broadly classified as arm waving: verbal “frameworks”, new “perspectives”, verbal and conceptual “models”, “new research directions”, “syntheses” that comprise speculation about possible links between topics X and Y****, (pseudo) hypotheses that basically amount to “X somehow affects Y”, big “questions” that are way too vague to actually be answerable…all that stuff is cheap and easy. The progress of ecology is not limited by lack of any of that stuff. The world would be a better place if everyone stopped trying to get a paper out of the first five minutes of their job talk, the first page of their working group proposal, or that conversation they had in the bar at the last conference they attended. But don’t just take my word for it. DiRienzo and Montiglio (2015) is a fine critique of the value of verbal conceptual frameworks and related flotsam in the context of behavioral ecology. And here’s Charley Krebs calling out pseudo-hypotheses in the context of biodiversity-ecosystem function research.*****
Another thought: except in exceptional cases, influencing the direction of your field isn’t something you can do with a single paper. It ordinarily requires you to use all the tools at your disposal. A whole series of papers on your idea. Giving lots of talks on your idea. Organizing symposia on your idea. Organizing working groups on your idea. Training grad students and postdocs who go on to have success further pursuing your idea. Etc. Which is why I continue to wonder about the influence of this blog. Is blogging a good way to be influential, because the form lends itself to revisiting topics and repeating yourself? Is it a good way to be influential because you can reach a lot of people repeatedly, so that the little intellectual nudges you give your readers collectively add up to a lot of cumulative influence over time? Or is blogging a poor way to be influential, at least on its own, just because no one tool is very influential on its own? Or a poor way to be influential because blog posts are too transitory? Like how repeatedly tossing pebbles into a lake repeatedly creates ripples on the water’s surface, but doesn’t have any lasting effect on the lake once you stop tossing?****** I of course have a (tentative) answer in mind, but I’m curious to hear what others think.
Finally, re: #3, I think Brian has a draft post in the works on best practice in writing and responding to comments on published papers.
*Although ironically, I originally submitted Fox (2013) to Oikos as a Forum paper. It was rejected. But it was a totally different paper then–literally just my original zombie ideas blog post. As I recall, the editor and (especially) one of the referees weren’t comfortable with the tone and rhetoric. I respectfully disagreed at the time, but looking back I think the editor did me a favor by rejecting it. The published version is a much better paper, and I now agree that the sort of writing that works on a blog isn’t always a good fit in a paper (not that papers always need to be written in a dry style of course). A reminder, if one was needed, that rejection can really improve your papers. And that rhetoric in scientific writing is a topic on which there’s lots of scope for reasonable disagreement.
**As always, I’m using examples from my own work not for purposes of tooting my own horn, but because those are the examples most familiar to me.
***I haven’t been this blunt on the blog in a long time. I’ve intentionally dialed back on my feistiness in the last year or two, in an effort to present the best side of myself rather than the worst side. But the feisty side of me isn’t all bad, and lately I’ve been wondering if my writing has been playing it too safe. So welcome back, 2011 me! Try not to upset too many people. 🙂
****How come you never see anyone argue that topics X and Y are unlinked? Or at least, that the connections between X and Y are sufficiently weak/indirect/idiosyncratic as to not be worth studying?
*****I actually think Krebs is unfair in places in this piece. But he’s got a point.
******Well, unless you toss in enough pebbles to fill the lake basin. That snapping sound you just heard was the sound of my blogging-as-pebble-tossing analogy being stretched past the breaking point. 🙂