More on the Damage Done in P2P Review

My latest Peer to Peer Review column in LJ looks at Big Deal Serial Purchasing: Tracking the Damage, by Walt Crawford:

http://lj.libraryjournal.com/2014/08/opinion/peer-to-peer-review/more-on-the-damage-done-peer-to-peer-review/

The evidence is getting harder to ignore.

On Tenure, Publishing, and Such

I’ve been thinking about this topic in response to a couple of things I’ve read lately. One is this blog post by Meredith Farkas giving her thoughts about tenure after leaving the tenure track (along with numerous comments) and the other is a discussion on an ACRL listserv about whether College & Research Libraries should try to include more than the empirical research studies that seem to be the norm. Since I started drafting this post, Barbara Fister has also responded to Meredith.

In the interest of disclosure, I should note that I am not now nor have I ever been on a tenure track as such. The librarians at Princeton don’t have faculty status, although we do report to the Dean of the Faculty and we do have a three-tiered promotion structure and a tenure-like status called “continuing appointment.” However, while that process does reward publication, it does not require it. My previous professional librarian job had no faculty status, no promotional structure, and no tenure-like status. Not only have I never been on the tenure track, when starting out I deliberately avoided jobs where the librarians had faculty status and tenure requirements. I’d have taken one of those jobs in a pinch, but I definitely didn’t want one.

Meredith and others are debating the merits of having tenure and faculty status, and I’ve heard a few librarians over the years tell me I’d be better off with faculty status. Campus governance, respect from the faculty, etc. That’s possibly true, but I seem to have done okay without it. Also, I don’t think I’ve ever lacked the respect of the faculty members that I’ve come into contact with, even as a lowly librarian interacting with relative academic superstars. I can’t imagine the Princeton faculty members ever considering the librarians as equals to them professionally, but they do seem to consider us as capable professionals in our own right and I’ve yet to have an unpleasant or demeaning experience with any professor here.

For me, this is a sign that the librarian tenure debate might be affected by place. Perhaps there are institutions where a lack of faculty status would mean a lack of respect, or that a lack of participation in governance would harm the library or the librarians. There’s a lot to be said for faculty status, but I have found no reason to agree with the more diehard proponents that faculty status is always necessary for professional well being. There are a lot of librarians at good universities who don’t have it and don’t miss it. However, I also disagree with those who think tenure is always restrictive rather than liberating. That might also depend on place. While I didn’t write much prior to being granted continuing appointment, I didn’t hesitate to speak my mind or take risks at work if I thought the cause worthwhile. The prospect of being up or out in six years didn’t silence me, but I understand there might be institutions where librarians might feel they had to remain silent to keep their jobs.

I avoided such jobs mostly because of the publishing requirement. I don’t think it’s too immodest to say that writing and publishing themselves weren’t obstacles. While there are a lot of librarians who struggle with both, I haven’t been one of them. However, I knew the sort of empirical research studies that seem expected in jobs like that would be a struggle. I’m not trained to do them. I don’t want to be trained to do them. And I have no interest in writing and usually very little interest in reading them. In the C&RL discussion, someone mentioned librarians writing articles based on critical inquiry who feared for their tenure chances because they hadn’t cranked out social science studies. That was not going to be me. While a lack of tenure wouldn’t silence me, a requirement to publish social science research articles would have harmed me, either by forcing me to write stuff I didn’t like or by keeping me from publishing at all.

It’s a pity, because there are librarians out there writing some good stuff that doesn’t fit in with the empirical, quantitative social science model that seems to be the norm. I’ve seen historical, philosophical, or political writing about libraries and librarianship that’s pretty good, and often much more readable than most LIS writing, and if the tenure process serves to stymie such writing, then the library literature is better off without tenure. For that matter, the literature of most scholarly fields would probably improve if tenure wasn’t a publish-or-perish process.

The great thing about not being a faculty librarian on the tenure track and not having my work judged by empirical research ideologues is that I can publish whatever I want, and there are always places to publish. I once had a practical ethics article rejected from a conference proceeding because the reviewer claimed that such an “opinion piece” wasn’t appropriate for this scholarly book. That reviewer seemed not to know or care that there are scholarly genres other than the empirical research study, or that a lack of quantitative data doesn’t reduce arguments to “opinions.” The only thing that irked me at the time is that I’d been asked by the editor to take a brief conference presentation and write it up as an article. That was just as well, since I then published it in an open access journal where it would actually be read. I didn’t need the publication, but there’s no reason to waste a piece of decent writing.

I don’t think there’s much doubt that the social scientific empirical research study is considered the gold standard of library scholarly publishing. My question is, why? At least from practicing librarians, many of them are terrible. Even I, committed humanist that I am, can often spot the flaws in such research. Librarians typically don’t have the time or training to do these things well, and yet they’re expected to and probably wouldn’t publish so many if they weren’t. The average results speak for themselves.

The reason is possibly because that’s what LIS professors usually publish. As an academic enterprise, LIS professors seem long ago to have decided that library science is a social science and that social scientific research methods were the appropriate methods. Creating that norm makes it easier to unify a field of study and to evaluate research from other LIS professors. Because this is what they do, and these are the people who have the time and training to publish the most rigorous stuff, the publishing model has become the norm, with librarians trailing along behind trying to keep up while working 12-month contracts and usually not having PhDs in LIS or social science disciplines.

I, on the other hand, resist this ideology, because I believe that the “science” in library science doesn’t necessarily mean the same thing as the “science” in social science. The science of library science depends upon an older 19th century meaning of science, something like an organized body of knowledge about a field. In that sense of science, library science is definitely a science, and a fairly well developed one. Thus, while there’s nothing wrong with engaging in social science research related to libraries, there’s also no reason why such research should define what sort of scholarly work about libraries is appropriate. Library Science might be a social science, but being a librarian is an art. There’s absolutely no reason that libraries can’t be approached in a humanistic manner. It’s just that most LIS professors aren’t humanists.

That seems to me to be a big divide in the profession. LIS professors are social scientists, but most people going to library school to be librarians are humanists. Plant someone like me in a job where I’m expected to publish social science research and it’s going to be pretty bad, plus I’m going to hate writing it. That’s a recipe for garbage research and misery that I wanted to avoid. Let me approach the profession rhetorically, philosophically, or even historically, and the results, although perhaps not outstanding, at least won’t be embarrassing.

Thus, in retrospect, I avoided faculty status and the tenure track not because I was afraid of research, or that I couldn’t write, but that so much LIS research is unnecessarily narrow, and the expectations for research are equally narrow. When LIS is unjustifiably defined as only a social science, when most LIS professors are social scientists, and when most of the leading journals in the field expect that sort of writing, that tells humanists like me that whatever scholarship I might produce is unwelcome, unvalued, and sometimes just plain misunderstood. The clear message for me as a library school student and then a new professional was that mainstream LIS scholarship was something I wanted nothing to do with and that wanted nothing to do with me.That was fine, because my experience, and I suspect I’m not alone here, is that most of that social science LIS research is largely irrelevant to my work or to my professional interests.

I have no problem with faculty status or tenure for librarians, but I also don’t consider it a necessity at every institution. The value might differ depending on circumstances. However, I am glad that there were good academic libraries where someone like me could write and publish what I wanted, rather than being constricted by the social science expectations of mainstream LIS publishing. If faculty status and tenure for librarians with expectations to publish social science research were universal, I’d probably be in another profession, which would be too bad for me because I’m pretty happy doing what I do.

PhilPapers et al.

I’d promised some librarians that I would write up a comparison between PhilPapers (PP) and the Philosopher’s Index (PI), because choosing between the two of them might be a budgetary necessity for librarians who wanted to subscribe to PhilPapers under the new terms. This has been delayed somewhat because I knew PhilPapers was planning to announce some important changes, and until then a comparison would be premature. The changes are on the website now, so I feel comfortable writing. The big news is that PhilPapers will be merging with the Philosophy Research Index (PRI). This will still be a comparison, but the incorporation of the the PRI into PP is something of a game changer. But first, some comparisons.

If we’re going by sheer number of entries, PP is ahead. As of July 21, there were 1,104,558 entries from 1,032 journals. According to the Philosopher’s Index website, PI “has a total of over 540,000 journal article and book citations from over 1600 journals collected from 139 countries in 37 languages.” This is qualified somewhat in that only about half of the PP entries are classified according to the categories of its philosophy bibliography. That makes the number of controlled indexed entries about the same. However, PP is, according to David Bourget, “categorizing hundreds, sometimes thousands a day,” and will soon be improving the categorization process. Thus, in the not too distant future, most if not all of PP’s entries will be categorized, making them even more accessible than they are now. In addition, about 700,000 of the entries have categories or associated keywords, and I’ve been told by PP that the most prominent method for accessing entries is search, not browsing via the bibliography. So most of the entries are available to search. In addition, PRI is larger than both PP and PI, with more than 1.3 million bibliographic records. It also covers 800 journals in 30 languages. Once PP incorporates PRI, PP will definitely be by far the largest philosophy literature index. The coverage will also go back to the beginnings of many library journals, instead of just back to 1940 as with PI, and the addition of more foreign language coverage will broaden the scope considerably.

The PP/PRI merger also means that PP will incorporate the Philosopher’s Index Thesaurus. For those unfamiliar with the history of PI and the Philosophy Documentation Center (PDC), a little background might be worthwhile. PDC and PI were both founded in the 1960s at Bowling Green State University, and until 1995 PDC published PI. In 1995 the editor of PI left BGSU and took PI with him. PI is now published by the Philosopher’s Information Center. However, the PDC still owns the Philosopher’s Index Thesaurus, which is the thesaurus PI still uses, and which PRI has been using to build up its own index. The thesaurus is available in print from the PDC, which explains why it cannot be accessed from within PI, comparable to thesauri from other indexes. Thus, when PP incorporates PRI, PP will have both its robust and developing bibliography of philosophy and the thesaurus that PI also uses, plus more extensive coverage of the philosophical literature.

There’s also a difference in how the entries in PP and PI are classified. PI uses the Philosopher’s Index Thesaurus. I couldn’t find any information on the website by whom the indexing is done, but presumably it’s a by a team of indexers with some knowledge of philosophy (if anyone has more complete information, please let me know). PP entries are classified according to the entries of the philosophy bibliography either by the authors themselves or appointed editors, all of whom are professional academic philosophers. I haven’t noticed any problems with either classification process, so I’m not sure the comparison would help anyone make a choice. If others disagree or have found issues, please leave a comment.

One problem I had early on was using SFX from PP. I was getting incomplete results. The problem could be solved only by creating an account with PP and going through a relatively simple process of choosing a link resolver (very simple if anyone from your institution had ever done it before). The accounts can be completely private if you choose, but I disliked the extra steps someone might have to take to get to articles that PP doesn’t have OA but which a library might subscribe to. However, PP is improving OpenURL and SFX linking, and subscribing institutions shouldn’t have a problem. It should work as seamlessly as PI when everything is done.

The final comparison is platform and price. PI is a proprietary index available through Ebsco, Ovid, and ProQuest. Princeton uses the Ebsco interface, which I happen to find very user-friendly. The PP website is also very user-friendly in my opinion. On whatever platform, the cost will vary among institutions because of differences in FTEs or consortial agreements or whatever. Princeton pays a few thousand, and the PP expectation from Princeton is $1200 because Princeton is a philosophy PhD granting university. That makes PP cheaper than PI for my library. I don’t plan to cease subscribing to PI yet, because I’m awaiting further PP developments and I want to have a conversation about it with the Philosophy Department, but I imagine that will matter for a lot of libraries. However, with the incorporation of PRI into PP, I will be canceling the subscription to PRI if it continues to exist as a standalone database, and that money will go to PP instead.

And then there’s the open access of PP. PI is available only to subscribing institutions, while PP is available to everyone in the world. As those of you reading in the spring might remember, my major objections to the PP subscription drive were the unmanageable budgetary timing (asking to subscribe by June 1 or face penalties) and the list of institutions expected to pay (basically every institution in the world from which anyone had ever accessed PP). I thought the first pointlessly hasty and the second unjust. Both those objections were met soon after. The announcement of the PP/PRI merger says, “The service will continue to be available on the model where non-institutional use is free and only institutions located in high-GDP countries and that offer degrees in philosophy are asked to subscribe.” Although I still would have preferred the Stanford Encyclopedia of Philosophy (SEP) endowment method, those are the same kinds of institutions that SEP targeted and the kind that should be subsidizing this sort of open access project if possible.

Of course, PP is more than just a competitor to PI. In addition to the growing index and the structured bibliography, it has the huge OA archive of philosophy articles. It also has announcements for philosophy events and job, and generally serves as a community portal for professional philosophers and philosophy grad students around the world to share work and stay informed. I’m not aware of anything quite like this for other academic disciplines. If PP can gather enough subscriptions to continue to develop, it will remain an important resource for anyone interested in philosophy. And when PP is used in combination with the SEP, philosophy has perhaps the most robust OA reference support of any academic discipline.