Mapping the Scottish Reformation: Website Update v.1.1

We’re very pleased to be able to share the news that the first update of our website is now live at maps.mappingthescottishreformation.org. Thanks to the generous feedback of our users across the world, the updated Mapping the Scottish Reformation site includes a number of improvements, bug fixes, and new features that should make it more useful and easier to use.

While we wanted version 1.1 to be an opportunity to respond to feedback and crush some bugs, we have also added a few features that were not quite ready for version 1.0. Chief among these features was the ability to download search results. Each map now includes a ‘Download results’ button that will export the data on the map into a JSON file.

Our new download function on the Tenures map

In version 1.1, the Education map is more powerful: allowing users to search for approximate graduation dates, and the amount of time between graduation and a minister’s first appointment. To give you a deeper insight into this data, we have added some new aggregations to the bottom of the search bar: showing the years in which most ministers graduated, the average time between graduation and entering the ministry, and even the average distance travelled between a minister’s university and his first parish in kilometres.

The new features on our Education map show the approximate year when a minister graduated and the distance travelled between university and first parish posting

We’ve also added a range of usability enhancements: from making the lines on the Journeys and Education maps thicker, adding manual Zoom controls to each map, to organising lists of names by last name, rather than first name.

It’s the little things: All lists of names are now ordered by last name, rather than first name. And there are manual zoom controls on each map for extra precision.

Version 1.1 of Mapping the Scottish Reformation is the culmination of Stages 1 and 2 of the project, funded by the National Endowment for the Humanities and the Strathmartine Trust, respectively. We have parsed over ten thousand pages of manuscript material, and tracked the careers of 654 ministers and over 400 of their wives in the region of Lothian and Tweeddale. Our website has attracted over sixteen hundred unique visitors since launching in December 2020.

As Stage 3 beckons, here is a full list of the changes we’ve made to v.1.1 of our website:

– Added an introductory message and guide video for first-time visitors, narrated by our friend and fellow Scottish historian, the inimitable Jamie Reid Baxter

– Added a guide video to the ‘About’ page

– Increased weight for lines in the Journeys and Education maps

– Rearranged all lists of names: now organised by last name

– Added a data download function to each map

– All new search options in the Education map

– All-new calculations in the Education tab: graduations, distances, appointment

– Fixed some data errors in the Education map

– Fixed some data errors in the Journeys map

– Default map tile changed from ‘Historic’ to ‘Modern’

– Map attribution has been moved and is no longer obscured by the search bar

– Added zoom control buttons to each map

Thank you for all of your suggestions and support. We are particularly grateful to our Advisory Board, the Interactive Content team at the University of Edinburgh, and Chris Fleet, maps curator at National Library Scotland, for their essential feedback on version 1.0 of the site.

Check our blog and on Twitter for more updates on the project’s development. If there’s anything you think we should be adding to the website, please get in touch at MappingScotsRef@gmail.com.

Mapping Scotland’s Synods, 1560-1689

As we step up our preparations for Stage 3 — venturing out from Lothian and Tweeddale and into the rest of Scotland — we are busy scoping out the extent of the work before us (spoiler: there is a lot). We have already entered Presbytery data to Wikidata. Now we turn our attentions to Scotland’s provincial synods.

Arrowsmith’s ecclesiastical map of Scotland (1825)

Many of our readers will know about Aaron Arrowsmith’s 1825 ecclesiastical map of Scotland. A scanned version is available on the National Library of Scotland website here. I’ve spent a lot of time looking at this map, but there are two problems with it, at least from our perspective: it shows the shape of the nineteenth-century Kirk of Scotland and, unlike so many of the terrific maps on the NLS website, it is not georeferenced.

Fortunately, NLS have adopted the International Image Interoperability Framework (IIIF) on all of its scanned map images. This means that the image can be exported to various different software viewers (ARCGIS, CanvasPanel, Mirador, Recogito, etc). Using the free website georeferencer.com, we imported Arrowsmith’s map and started the georeferencing process.

Georeferencer.com tied Arrowsmith’s map to modern map data

By using georeferencer.com, we were able to overlay Arrowsmith’s representation onto a modern map, pinpoint known places and features, and allow the website to adjust the nineteenth-century map to accord with modern-day cartography.

Georeferencer has an extra trick up its sleeve: the georeferenced map can be taken directly to MapTiler, a service that allows users to create vector shapes on top of georeferenced maps. Translation: we could now trace the boundaries of provincial synods shown on Arrowsmith’s map and use them in modern projects.

Tracking the Aberdeenshire coast on MapTiler

This is fiddly work: you start with a pretty generalised polygon and have to edit it, by hand, to accord with coastal features and the like. There is the added complication that Arrowsmith’s knowledge of certain parts of Scotland was less-than-stellar: thankfully, MapTiler allows users to alter the opacity of each layer so one can see how the modern and historical maps compare. Of course, there are editorial judgements to be made here, especially in areas where Arrowsmith’s map lacked key detail.

We’re using Arrowsmith’s nineteenth-century map here and our project covers the period 1560 to 1689. Unsurprisingly, a number of features had changed between the end of the period covered by our project and the moment of Arrowsmith’s composition. The Synod of Ross, for example, was established in 1707, so was shown on Arrowsmith’s map, but would not have been recognised in the period covered by our project. Similarly, the Synod of Glenelg appears on Arrowsmith’s map, but was not established until 1724. Such challenges meant that it would be remarkably difficult for us to represent the area covered by the Synod of Argyll, in particular, in a single shape file. Then there are changes within the period covered by our project: the Synod of Lothian and Tweeddale includes the region covered by Biggar Presbytery, an area disjoined from the Synod of Glasgow and Ayr in 1644. To capture the complexity of these changes, we would have to create new shape files for each significant revision to the Kirk’s ecclesiastical boundaries. Our shapefiles are no-less an interpretation of provincial synod boundaries than Arrowsmith’s nineteenth century work. Nevertheless, they offer a useful indication of ecclesiastical structures.

Synod boundaries as geoJSON

Once complete, each shape file can be edited further, exported as a GeoJSON (and then possibly converted into other shape file formats) and imported into any mapping platform. Using the workflow we detailed here, we took these datafiles and created a map in Leaflet showing most of Scotland’s provincial synods between 1560 and 1689. For the reasons stated above, we felt it best to not map the Synods of Argyll and Caithness and Sutherland before obtaining further details on their precise extent in the period 1560 to 1689.

Click the thumbnail to see the shapefiles in action

For those interested in making use of these rough shapefiles for their own projects, each file can be found at one of the following links on GitHub:

Aberdeen

Angus and Mearns

Dumfries

Fife

Galloway

Glasgow and Ayr

Lothian and Tweeddale

Merse and Teviotdale

Moray

Perth and Stirling

These shapefiles are far from perfect — a result of Arrowsmith’s inaccuracies and less-than-perfect drawing on my part — but they represent a start in visually understanding the organisation of the Church of Scotland. And while this represents only a snapshot in time — a more fluid picture would require multiple shapefiles of each synod (especially in Argyll) — such an overview of Scotland’s provincial synods, 1560-1689, shows how scanned images can be georeferenced and then opened up in such a way as to make them machine readable. Tools like Mapping the Scottish Reformation will offer more ways to interpret this messy data.

Chris R. Langley

Editor’s Note: Several months after the writing of this post, we uploaded these shapefiles to Wikimedia Commons (July 2021). To find out more, read this blog post.

NEH White Paper: Mapping the Scottish Reformation

What follows is our official “White Paper” for the NEH HCRR Grant. It represents our final public facing progress report for the grant and the culmination of the pilot phase of Mapping the Scottish Reformation.

Objectives, Accomplishments, and Challenges

Mapping the Scottish Reformation (MSR) is a database of the Scottish clergy that allows users to explore and visualize clerical careers between the Reformation Parliament of 1560 and the Revolution in 1689. Built with data from manuscripts held at National Records of Scotland (NRS), this is the first project to comprehensively chart the growth, movement, and networks of the Scottish clergy during and after the Reformation. By extracting data from thousands of pages of ecclesiastical court records, MSR tracks where ministers were educated, how they moved between parishes, their age, their families, their disciplinary history, and more. This early modern data drives a powerful mapping engine that allows users to build their own searches to trace clerical careers over time and space. As such, MSR provides crucial framing for scholarly inquiries into religious beliefs, political conflicts, and institutional change, as well as unprecedented information on critical figures for genealogical research.

The NEH HCRR Foundations grant funded the pilot phase of this project, which focused on the clergy from the Synod of Lothian and Tweeddale, a large and important region including modern day Edinburgh. Our goals for this phase of the project were threefold: first, we wanted to gather the pertinent data on the clergy from this region using the rich and voluminous records of Scotland’s ecclesiastical courts, with an eye to building our pilot user interface once this data was complete. Second, we wanted to identify challenges and inconsistencies in this data that could be used to develop editorial guidelines for the project. Last, we aimed to expand interest in and access to Scottish history in North America, as well foster transatlantic collaboration in the fields of Scottish history, the digital humanities, and genealogy. All of these objectives amounted to what we have thought of as the “proof-of-concept” phase for the project: if we could demonstrate the success of our methods for one part of Scotland, we could then seek to expand our remit to the whole of the country. 

Thanks to the support of the NEH as well as colleagues from a range of fields, we are delighted to report that we not only met but exceeded our goals for this phase of Mapping the Scottish Reformation. In early summer 2020, we completed our dataset for the Synod of Lothian and Tweeddale. Ultimately, we went through over 10,000 pages of manuscript material and gathered data on nearly 900 clerical journeys across 116 Scottish parishes, the “significant events” of 500 ministers (depositions, suspensions), information on more than 200 clerical wives, and the alma maters of over 400 clerics. As part of this work, we formulated internal editorial guidelines about how to categorize and record key parts of the clerical career. 

Thanks to the extension of the NEH grant due to COVID as well as a grant from the Strathmartine Trust, we successfully identified and implemented technologies to record and visualize our data. We entered our data from NRS manuscripts into Wikidata, thanks to the bulk upload tool QuickStatements, and ultimately, we were able to build and launch our pilot website: maps.mappingthescottishreformation.org. Since its launch in December 2020, we have had well over 1,000 users in places ranging from the US to France to Japan.

This site allows users to trace the careers of the Scottish clergy across time and space using 5 different map views: Tenures (where users can learn about the length of ministerial tenures in a given parish), Journeys (where users can trace the movements of the clergy), Education (where users can see the influence of different universities on particular parishes), wives (where users can learn more about clerical spouses, a key but understudied group), and Events (where users can learn about things like rates of depositions and suspensions during moments of political turmoil). We worked closely with the Interactive Content team at the University of Edinburgh in fall 2020 to build this site, and we are already in talks about ways to grow and rearchitect it as we expand our dataset. 

From the outset, we also wanted to prioritize open communication with the public—from historians to digital humanists to genealogists and beyond—about our project and the methods we are using. We often refer to this as “pulling back the curtain,” and to that end, we did a number of presentations to academic and family historian groups over the course of the grant period, including: the Center for Data, Culture, and Society at the University of Edinburgh, the Washington and Lee digital humanities cohort, the Scottish Indexes Society, and the Aberdeen and North East Scotland Family History Society. We also posted regular updates on our blog and on our Twitter account, @mappingscotsref. We also had two meetings with our Advisory Board and were in very regular communication with those members about our ongoing work. 

Our final objective for the pilot phase of MSR was to plan for the future of the project, and this work has begun in earnest. Moving forward, we will expand our dataset to encompass information on clerical careers across all of Scotland. Using feedback from a wide range of parties—from the scholars on our Advisory Board to internationally-based genealogists to the general public engaged with our social media accounts—we have also made tweaks to our current website, and we will be launching version 1.1 in March.

Over the course of this work we have come to appreciate the immense complexity and richness of clerical careers, which were far less straightforward then often presented in the current literature. As such, one of our challenges remains how to capture essential, machine “readable” data while remaining sensitive to messiness and intricacies of clerical experiences. To put this differently, we have been thinking through how to tell stories with our data. A more basic challenge, especially in Fall 2020 during the extension period, was building in time to work on MSR while also teaching during a pandemic. As such, we are very grateful for the support of the NEH.

Project Team and Process 

The co-directors of Mapping the Scottish Reformation are Michelle D. Brock (Washington and Lee University) and Chris R. Langley (Newman University). We have spent the period of the NEH grant gathering and completing the dataset on clerical careers in the Synod of Lothian and Tweeddale using digital images of church court records held at the National Records of Scotland. We initially recorded this data into in Google Sheets, and then uploaded this information to Wikidata, a free and open data storage platform. We then queried the data to generate the JSON files that drive our pilot website. Working with partners at the University of Edinburgh, we built the pilot MSR website, maps.mappingthescottishreformation.org.

Mackenzie Brooks, Digital Humanities Librarian at Washington and Lee University, worked as team member on the project throughout the NEH grant phase. She introduced us to critical digital humanities methods, advised on how to best structure data, and generally provided some much-needed technical insights and encouragement over the course of this work. 

Members of the Mapping the Scottish Reformation Advisory Board include Julian Goodare (University of Edinburgh); Jane Dawson (New College, Edinburgh); Elizabeth Ewan (University of Guelph); Michael Graham (University of Akron); Roger Mason (University of St. Andrews); Tessa Spencer (National Records of Scotland); Paul Youngman (Washington and Lee University). They attended two Advisory meetings and engaged in regular correspondence with the project co-directors to offer invaluable feedback.

Robin Urquhart has been the main project contact at National Records Scotland, working generously to provide us with virtual access to the church court records containing essential data about the Scottish clergy. 

We also collaborated between August 2020 and January 2021 with Stewart Cromar and Hristo Meshinski, both part of the Interactive Content team at the University of Edinburgh, to build the pilot website. Their invaluable work on the project was funded by a grant from the Strathmartine Trust. Ewan McAndrew, Edinburgh’s “Wikimedian in Residence,” has also been an essential collaborator since January 2020, when he introduced us to Wikimedia and the technological side of the project began to take shape. 

Our entire process has been documented on our blog, where we have posted regularly about topics such as the complexities of clerical careers as revealed by the archival documents, how to work with imperfect manuscripts, the benefits of using Wikidata for a project like MSR, and our approach to transatlantic collaboration. This blog has recently been nominated for “best DH blog” the 2020 Digital Humanities Awards.

Findings and Impact 

The pilot phase of Mapping the Scottish Reformation centered on the gathering of manuscript data about clerical careers. It culminated in version 1.0 of our website, which provides quick and reliable information on previously elusive questions at the heart of understanding religious, social, and political change in Scotland. This site represents the first stage of our work, and it is our hope that as we expand the project, MSR can become the first point of reference for scholars seeking information on the Scottish clergy as well a guide to the archival documents that contain this data.

Already, MSR has proven a useful resource for scholars, students, and genealogists. Thanks to the quantitative tools on our site, users can ask a wide range of exciting questions about the men and families at the center of early modern Scottish history. We now know, for example, that the average tenure for a minister appointed in the synod of Lothian and Tweeddale between 1560 and 1689 was 12 years, but that this number was significantly lower—close to 7 years—in the first generation of clergy after the Reformation, when challenges in staffing and training persisted, and similarly brief for those appointed amid the ecclesiastical upheavals of the post-Restoration period. We also know that there were 9 ministers in this region whose careers were longer that 50 years. All of these long-serving men first took up their posts between 1560 and 1620, suggesting that career stability—and perhaps personal longevity—was more attainable for those with appointments made before chaos of war and revolution mid-seventeenth century. Expanding our dataset beyond this single synod region will test whether these tentative patterns hold for other areas of Scotland. 

More generally, our work to date has revealed that despite common assumptions about the rigidity and consistency of the Church of Scotland’s structure, there was in fact tremendous diversity over time and space in the career paths of the post-Reformation clergy. In these volatile years, ecclesiastical policy was hotly debated; parishes were created, dissolved, or united with each other; and ministers’ roles changed, from mere exhorter to preacher of God’s word. As such, our records reflect frequent deviation from the typical path from student to expectant to parish minister, and instead suggest greater informality and flexibility in clerical careers than has previously been appreciated by historians. 

In terms of the archival records, our project has provided more detail on the types of data related to clerical careers found in different records. For example, we confirmed our assumption that kirk session records—the local parish ecclesiastical courts charged with moral discipline—are more likely to contain details on clerical families and the deaths of ministers than the minutes of the presbyteries, and we have integrated some data from these records into our website. This is useful knowledge not only for our own project, but for less-specialized historians or genealogists seeking a “starting point” in exploring the voluminous church court records at NRS. 

Last, MSR has contributed to the growing intersections between the field of history and the digital humanities, particularly by helping historians think about how they can use Wikidata to record and query their data while also making this data open to the public. Our aim has been to be transparent, accessible, and collaborative at every phase of our work in order to reach the largest possible audience and provide a model for similarly structured projects (as we ourselves learn from the work of many others!). 

This is just the beginning, as this NEH HCRR Foundation grant has supported the critical first phase of a much larger project. Eventually, Mapping the Scottish Reformation will allow users to explore and visualize data about clerical careers across the entirety of the country. We hope that its importance to the fields of Scottish history, Reformation studies, and the Digital Humanities, as well as the genealogical community, will continue to grow along with the scale of our work. 

Mikki Brock

css.php