STACKDiagnostics Testing With STACK
University of Technology, Hamburg
Helena Barbas
https://orcid.org/0000-0002-2384-8042
Abstract
The MINTFIT Math Test is an online test for high school students, or anyone interested in a university STEM degree programme. It is provided by the MINTFIT project based in the universities HafenCity Universität Hamburg (HCU), Universität Hamburg (UHH), University of Applied Sciences Hamburg (HAW Hamburg), University Medical Center Hamburg-Eppendorf (UKE) and University of Technology Hamburg (TUHH) and funded by the Hamburg Ministry of Science, Research, Equalities and Districts (Behörde für Wissenschaft, Forschung, Gleichstellung und Bezirke Hamburg, BWFGB). The MINTFIT Math Test, as well as the MINTFIT online tests in physics, chemistry and informatics, run on a Moodle system. The STACK plugin offers many benefits to the Math Test, both when used at home and in different university settings.
Introduction
The MINTFIT Math Test is a free diagnostic online test that lets participants check their mathematics skills for a successful start to a STEM degree programme. It is part of the MINTFIT tests and courses programme on the subjects mathematics, physics, chemistry and informatics, accessible on the MINTFIT platform https://www.mintfit.hamburg/. Participants get instant feedback on their results after finishing the Math Test. They can then use two online mathematics bridging courses (OMB+ and viaMINT) to fill the gaps in their mathematics knowledge as identified by the test. The MINTFIT Math Test is available in German and in English. For more information see [1].
STACK offers many advantages in the setting of diagnostics testing for both participants and organisers.
A STACK question's potential response tree helps diagnose the errors committed by the participants, as it is possible to compare the entered solution with incorrect solutions that arise from known common mistakes. It is also possible to provide partial credit for partially correct answers, or for errors carried forward.
Additionally, it is possible to generate many random variants of a question. If for example, the question is to find the derivative of a polynomial, the system can randomly draw its coefficients from a specified set. Variants that are either too difficult or too easy can then be deleted by hand. At the universities in Hamburg, the MINTFIT Math Test is used in exam-like situations as a part of university entrance tests, a module requirement or as an opportunity to collect bonus points for the first term exams. The possibility to generate different questions of the same difficulty level is invaluable here.
Execution
The STACK questions in the MINTFIT Math Test were written by a scientific assistant (the author) and a student helper in 2014/2015, supported by an IT assistant. New STACK questions were easily generated by for example copying an existing question with a similar structure and looking up the coding structure of Maxima. This way, with just a small starting set of exemplary questions, it was possible to quickly get comfortable with STACK without any help from other sources or training.
The questions in the MINTFIT Math Test can be done by mental arithmetic or by calculating using pen and paper – a calculator is not necessary and should not be used (neither at home nor in exam-like situations). However, since the general approach of MINTFIT and the Math Test particularly is the voluntariness of its users, participants are not controlled (with the exception of some settings, like the university entrance test, where they are seated in an exam room). However, they are informed before starting the test that their results are representative for their math skills only if they complete it without using a calculator or looking the answers up on a webpage like Wolfram Alpha.
About 50 questions in the question pool of the Math Test are implemented with STACK. The MINTFIT Math Test has been accessible since June 2015.
Results
It is difficult to measure the precise impact of the MINTFIT Math Test on students' study skills. Nonetheless, there is student feedback from a form offered after the test. Of all those who answered the question: "Do you think that the test is helpful for you or freshmen in general?", 66% answered with a clear "yes". Answers were given in a range from 1 ("yes") to 5 ("absolutely not"), with a mean response of 1.5. Of all those who answered the question "Do you feel fairly rated?", 61% answered "yes". With possible answers as in the previous question, this one had a mean answer of 1.62.
Challenges
The main challenges of using STACK were of technical nature. Keeping up with the updates of Moodle and STACK means you have to keep a close eye on the appearance of the test. Moodle itself offers many possibilities, so one needs time to make the optimal adjustments there.
Enablers
MINTFIT is a project by the universities HafenCity Universität Hamburg (HCU), Universität Hamburg (UHH), University of Applied Sciences Hamburg (HAW Hamburg), University Medical Center Hamburg-Eppendorf (UKE) and the University of Technology Hamburg (TUHH) in Hamburg, Germany. It is funded by the Hamburg Ministry of Science, Research, Equalities and Districts (Behörde für Wissenschaft, Forschung, Gleichstellung und Bezirke Hamburg, BWFGB).
What's Next?
The MINTFIT test and courses programme will be completed with regard to the content by the end of 2020. From 2021 on, the service is going to be maintained for current and future applications, and tests and courses will be refined and enhanced.
References
[1] Barbas, H.; Schramm, T.: The Hamburg Online Math Test MINTFIT for prospective Students of STEM Degree Programs. MSOR Connections, S. 43-51, 2018.