1st STACK Network meeting report, Dec 2022

The STACK Professionals Network was established during the summer of 2022 to bring together professionals, across various institutions, who spend a significant amount of their time authoring STACK questions.

Between Dec 2019 and Dec 2022, the 3 pandemic years, the need to create more online resourses expanded significantly and many universities created staff posts for people whose main role is to author STACK questions. These posts also support a large and growing community of STACK users in their institutions. The Network will bring these people together and contribute to the knowledge sharing among them.

The 1st STACK Network meeting took place on the 9th of December 2022 in the School of Mathematics at the University of Edinburgh. The purpose of the meeting was to bring together the people of the Network and set some initial goals for the Network. The topics that were discussed during the meeting can be divided into two categories: (i) how the members can contribute to the STACK project and (ii) how the Network will support its members.

How the Network will support its members

Using STACK to automate mathematics and STEM assessments requires specialist skills, and the people who do this job typically work in isolation in their institutions. In many cases there is only one person in the department/university doing this job, so they don't have much local help for STACK-related issues that they may encounter. The Network will help the STACK professionals to solve various authoring difficulties and also make it easier to share existing questions/quizzes amongst themselves. Mathematics curriculum, especially topics like algebra, calculus, or differential equations, are very similar around the globe, so many existing STACK questions can be easily shared and reused with minor edits. Example questions can help a question author get started in a new topic area. While some colleagues are reluctant to freely post whole courses, most are very willing to share examples especially with colleagues with whom they already have a professional relationship.

The Network can provide training to colleagues who are new to STACK and support them with authoring, testing and maintaining their questions. Members of the Network can also support the development of the pedagogy associated with using STACK questions effectively.

Another goal of the Network is to provide visibility to this specialist, technical work, so that the work of the STACK professionals will acquire better recognition. Most of the content created by the STACK professionals is behind passwords, and intellectual property belongs to institutions rather than individuals, so the authors of the questions don't have a long-term track record of their work. Not all professionals contribute towards research, they don't necessarily publish papers, so all this work can easily be unnoticed.

How the members will contribute to the STACK project

The members of the Network are highly encouraged to contribute by improving the documentation, with a particular focus on sharing expertise and "know-how" of system features for specific subjects. Other ways that the members can contribute are:

  1. Sharing and organising demo questions
  2. Sharing sample questions and question banks
  3. Creating templates questions
  4. Testing and maintaining questions
  5. Helping to set priorities for developing the STACK system, with their views having stronger weight than typical end-users

Since STACK has become widely used in many countries the Network can help with translating the system and various sample materials to different languages. Members can certainly help translators understand how the various language strings are used within the software, something not immediately obvious to some translators.

Participants of the Network meeting
Figure: Participants of the Network meeting

The technical notes of the meeting can be found here (end of the page): https://github.com/maths/moodle-qtype_stack/blob/dev/doc/en/Developer/Future_plans.md.

List of participants:

In-person:

  • Chris Sangwin - University of Edinburgh, UK
  • Ian Jones - Loughborough University, UK
  • Curtis Hooper - Loughborough University, UK
  • George-Ionut Ionita - ETH Zürich, Switzerland
  • Andreas Steiger - ETH Zürich, Switzerland
  • Kinga Sipos - Bern University, Switzerland
  • Sam Fearn - Durham University, UK
  • Maciej Matuszewski - Durham University, UK
  • George Kinnear - University of Edinburgh, UK
  • Konstantina Zerva - University of Edinburgh, UK

Online:

  • Santiago Borio - IDEMS International, UK
  • Tim Lowe - The Open University, UK
  • Andrey Chesnokov - NTNU, Norway

Anyone who spends a significant proportion of their professional work writing STACK questions, and who is interested in joining the Network should contact Chris Sangwin or Konstantina Zerva at the University of Edinburgh.

The full list of STACK professionals can be found here: https://stack-assessment.org/Community/