Rethinking Peer Review in the Age of Digital Humanities

Version of Record: Risam, Roopika (2014). Rethinking Peer Review in the Age of Digital Humanities. Ada: A Journal of Gender, New Media, and Technology, No.4. doi:10.7264/N3WQ0220

1 Leave a comment on paragraph 1 0 Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License

1 Leave a comment on paragraph 1 0 Roopika Risam
Assistant Professor of English
Salem State University

2 Leave a comment on paragraph 2 0  

3 Leave a comment on paragraph 3 0 For academics, double-blind peer review processes remain the gold standard for validating scholarly work. The value accrued by scholarship has traditionally flowed mono-directionally from peer review. In the hierarchies that govern academic hiring and tenure and promotion practices, the single-authored monograph from the distinguished scholarly press sent out for review upon completion occupies a position of prominence. Among shorter forms, the prestigious academic journal provides readily legible markers of academic quality. Yet, for scholars working in digital formats or within digital humanities, conventions governing the gatekeeping of “scholarly” work feel increasingly mismatched to the digital milieu. Therefore, digital scholarship requires consideration of the factors distinguishing it from print scholarship, along with a new approach to validating scholarship that emerges from and respects the specificities of digital work.

4 Leave a comment on paragraph 4 1 Rethinking peer review in the age of digital academe is a task that goes beyond the question of medium or platform to a question of epistemology. That which we call “digital scholarship” is not simply print scholarship gone digital but raises questions of genre and gives rises to its own conventions. One of the first significant interventions of digital platforms for academic work was the rise of “e-journals,” born-digital academic journals. E-journals brought with them a host of responses, from skepticism to excitement,[1] accompanied by concern that recourse to the digital would decrease scholarly merit – as though there were little distinction between an academic journal online, with a review board and review process, and a blog. Yet, scholarly publishing has responded to the affordances of the digital: we have seen greater interest in open access and a boom in new journals that use digital platforms to distribute articles ahead of the publication lags that accompany born-print journals. Yet, many e-journals reproduce the hierarchies and values of print knowledge, relying on traditional notions of what academic working looks like.

5 Leave a comment on paragraph 5 0 On the other hand, “digital scholarship” is its own animal, a chimera that defies the conventions of print scholarship. Three principle differences between digital and print scholarship in the humanities require a radical revision to how we review and assess scholarly production and to how scholarly work accrues value: digital scholarship is often collaborative, digital scholarship is rarely finished, and digital scholarship is frequently “public.” Each of these qualities of digital work invites particular concerns for review, rendering digital scholarship not readily legible to tenure and promotion or hiring committees.

6 Leave a comment on paragraph 6 0  

7 Leave a comment on paragraph 7 0 1) Digital scholarship is often collaborative.

8 Leave a comment on paragraph 8 1 Whereas creation and distribution of print knowledge in the humanities is usually a solitary task, digital scholarship is often collaborative and challenges the familiar image of the print academic in her hermitage, toiling in obscurity. The relatively greater frequency of collaboration in digital scholarship is a function of platform. Producing digital scholarship requires us to draw not only on the interpretive skills in which we were trained but a range of skills we may not possess, particularly as they pertain to the use and development of digital components of scholarship. Moreover, digital scholarship requires perhaps the most valuable of commodities for academics: time. Currently, I co-direct Digitizing Chinese Englishmen with Adeline Koh of Richard Stockton College. Koh initiated the project, which addresses colonial silences in 19th-century digital humanities scholarship by making available the Straits Chinese Magazine, a colonial English-language magazine published in Singapore from 1897-1907. Working alone, Koh found the project moving slowly. Given the nature of digital scholarship and its questionable value for tenure and promotion, those of us who work in the digital milieu often find we must steal time from tenure and promotion-worthy work to advance our projects. These challenges are even more acute for those of us who work outside of universities with very high research activity, with higher teaching loads and few institutional resources to support our research. In light of these challenges, Koh invited me to co-direct the project with her. I brought to the project not only my time and labor, but also my own skill set, which includes working in TEI markup language. Despite the efficiency of combining skills and human capital, collaboration, while expected in scientific or social science fields, raises concerns within the humanities, particularly over how to evaluate individual contributions to collaborative projects for tenure and promotion.

9 Leave a comment on paragraph 9 0  

10 Leave a comment on paragraph 10 0 2) Digital scholarship is rarely finished.

11 Leave a comment on paragraph 11 2 The adage for born-print scholarship is that it is never finished – one simply finds an acceptable stopping point. While this is true of digital scholarship as well, digital projects may exist in phases, may be perpetually in-progress, and may never have an acceptable stopping point. The end point for digital scholarship is frequently a moving target, and there is often no single event in the process of creating digital scholarship that is comparable to the act of submitting a manuscript for review. Therefore, digital projects require new approaches to linear conventions of scholarly time. For example, completion of a phase of a digital project may be an appropriate moment for evaluation. Yet, such assessments will unlikely be the conferral of a mark of scholarly validation on the project but the source of additional information and feedback that might, in turn, be folded into the next phase of the project. Further, digital projects are difficult for search committees or tenure and promotion committees to compare to print scholarship because a CV line identifying a digital project cannot adequately communicate the amount of intellectual labor the project represents and digital projects may require ongoing efforts for sustainability and preservation, whereas books and articles are presumed to be finished.

12 Leave a comment on paragraph 12 0  

13 Leave a comment on paragraph 13 0 3) Digital scholarship is frequently public.

14 Leave a comment on paragraph 14 0 Although more academics have taken to blogging and social media to share, promote, and collaborate on their work, scholarship in the humanities relies largely on private labor taking place behind the closed office doors. Public components of print scholarship are prescribed by academic ritual: invited talks, symposia, conference panels. The “public” nature of these acts of scholarship have been subject to question as well, with academics arguing that a conference talk is not, in fact, “public.” [2] Conversely, digital scholarship, particularly projects engaging web-based infrastructure, often become public early in development. This is in part because of the affordances of a web presence for digital work, the orientation of digital humanities work towards praxis, and the fact that many tools and platforms are web-based. Whereas a scholar producing a print article can delay making the work public for as long as she wishes, there is often relatively less agency for the digital scholar. Differentials of privacy and publicness for print and digital scholarship cleave to the levels of status and prestige they accrue. Print scholarship, usually not open access, lives within academic spaces, behind gatekeepers like paywalls, databases, and library archives. Its privacy is guaranteed by barriers that accrue capital for distributors. Conversely, digital scholarship may be relatively more easily available, without the mediating force of transactional capital preventing access. The monetary barriers to accessing print scholarship accord it quantifiable financial value – albeit one that provides returns for the gatekeeper rather than the author – and with financial value print scholarship accrues intellectual value. Thus the “publicness” of digital scholarship grants it relatively less value in the academic machine.

15 Leave a comment on paragraph 15 3 Based on these descriptors, digital scholarship threatens to displace a benign sort of academic who does not trouble the value and status of print knowledge and who reproduces the fetishism of print that undergirds academic disciplines. The digital scholar, then, is a radical actor, part of a growing trend in academic discourse prevalent enough to require rethinking of the production of academic value. There are, in fact, ways to make the value of digital scholarship legible to tenure and promotion committees and to search committees.[3] For example, tracking citations, grants, and usage statistics demonstrates engagement with digital projects in a way that is not necessarily available for print scholarship. On the DHCommons editorial board, we are working to develop a review journal for digital projects that takes into account the specificities of digital scholarship. Anvil Academic, a partnership between CLIR and NITLE, is pioneering a platform for digital publishing that would be an indicator of peer review for digital projects. Efforts continue to define evaluation for digital work. Perhaps the most important insight when encountering digital scholarship, however, is to attend to the particulars of the digital – the possibilities for collaboration, new approaches to completion, and their public nature – viewing these not as limitations but affordances.

16 Leave a comment on paragraph 16 0 [1] Howard, J. 2010, Wed. April 7. “Scholars Increasingly Embrace Some, but Not All, Digital Media.” The Chronicle of Higher Education. http://chronicle.com/article/Scholars-Increasingly-Embrace/64982/

18 Leave a comment on paragraph 18 0 [3] Modern Language Association. 2012. “Guidelines for Evaluating Work in Digital Humanities and Digital Media. Modern Language Association. https://www.mla.org/guidelines_evaluation_digital

Page 68

Source: http://adareview.fembotcollective.org/ada-issue-4-publication-and-its-discontents/rethinking-peer-review-in-the-age-of-digital-humanities/