PITCH-Project Innovating examinations, creating transfer and promoting equal opportunities in organic chemistry

As part of the PITCH project, many participating departments at the University of Duisburg-Essen are taking a step towards a new – namely digital – examination culture (overview of participating departments). This project is funded by the Stiftung Innovationen in der Hochschullehre.

In the field of organic chemistry, there is currently a lack of suitable possibilities for digitally implementing typical task formats in teaching and examinations. A key part of organic chemistry is examining complex organic molecules, which are depicted in the form of structural formulae (see example in Fig. 1). In current teaching and examination practice, this is done with pencil and paper or with chalk on a board.

​​​

​​

Figure 1: Structural formula of a citric acid molecule

Various programmes requiring a licence are available for digital depiction of such molecules. These are aimed at experts, however, and are designed for professional use. There are two main reasons why it is tricky to use them in teaching and examinations: (1) These programmes presuppose expertise among users and do not allow certain representations and classic beginner’s mistakes that are made in the course of learning processes. Learners therefore cannot depict molecules (incorrectly) in the way they would using pencil and paper; that means these mistakes cannot form part of the learning and assessable performance in the examination.

 

​
​

Figure 2: Representation of a citric acid molecule with a digital drawing programme

(2) The implementation of these professional programmes in learning platforms like Moodle is not provided for due to their target groups. Even if, as is the case at the University of Duisburg-Essen, there is a campus licence for such a programme, the possibilities for designing tasks with the help of these programmes are limited and, aside from the pure digitisation of the drawing, do not offer any added value in the sense of an integration of didactic support measures as required by innovative learning offerings. Rather, there is a risk that a cumbersome embedding in learning platforms like Moodle will lead to unnecessary cognitive load due to their operation, and that this impacts negatively on students’ learning success (extraneous processing, for an overview, see Mayer, 2009; Paas & Sweller, 2014).

Desirable support measures that represent an innovation and an additional learning opportunity compared to the current pencil-and-paper-based, in-person learning could take the form of additional digital learning solutions with immediate individual, error-specific or rule-based feedback (for an overview, see Johnson & Priest, 2014; Narciss, 2006, Shute 2008). With these, students can receive immediate feedback on their current skill level and can tackle further exercises flexibly as required. The immediate feedback on the task tackled is considered more favourable in motivational terms than, say, feedback received in person several days later. In addition, an in-person event does not generally permit individual feedback for all students on all their assignments.

For teachers, this kind of digital learning offering provides relief, because it saves them from correcting students’ exercises. In-person events can therefore focus on discussing classic difficulties or errors that occur frequently in tackling tasks and do not have to cover complete exercise sheets step by step in order to offer students a sample solution for comparing their own results.

If a digital learning solution like this functions seamlessly, then it can also be used for the purposes of examinations. Here, it can benefit both students and teachers because students don’t have to wait weeks for exam results and teachers are saved time-consuming correction work.

 

Crucial aspects for the success of a digital learning solution like this are: (1) that the technical implementation succeeds in such a way that the system is easy to use and does not lead to an unnecessary cognitive burden that hampers students’ learning processes – be it through cognitive overload or affective factors (like rejecting the learning offering); (2) the system must save teachers work – which can only be the case if there is automatic task generation and evaluation. If every task and the necessary error or rule-based feedback have to be generated manually, then the added burden will mean teachers will not use the system; and (3) the system must function reliably. If errors occur during use or the system is not available at times, this will lead to rejection on the part of teachers and students, and it will not be possible to use it in exams.

As part of the PITCH project, an editor that enables the display of structural formulae is integrated into the JACK® exercise and examination system. This creates the possibility of offering task formats characteristic of organic chemistry digitally, too. With the help of JACK®, rule-based feedback is provided that gives students hints about their mistakes. As part of the project, this feedback should be automated in such a way that it no longer has to be created individually for single tasks, but rather is available for specific types of tasks. Tasks created will be tested in the Moodle courses of the organic chemistry lectures and evaluated based on their learning effectiveness and their impact on cognitive and affective variables so that they can also be used in examinations once they have been sufficiently tested.

 

Literature

Johnson, Ch. I. & Priest, A. H. (2014). The Feedback Principle in Multimedia Learning (pp.449-463), in: Mayer, R. E. [ed.]. The Cambridge Handbook of Multimedia Learning – Second Edition, Cambridge University Press, New York.

Mayer, R. E. (2009). Multimedia learning (2nd ed.). Cambridge University Press. https://doi.org/10.1017/CBO9780511811678

Narciss, S. (2006). Informatives tutorielles Feedback. Entwicklungs- und Evaluationsprinzipien auf der Basis instruktionspsychologischer Erkenntnisse, Münster / New York / Munich / Berlin, Waxmann Verlag GmbH.

Paas, F., & Sweller, J. (2014). Implications of cognitive load theory for multimedia learning. In R. E. Mayer (ed.), The Cambridge handbook of multimedia learning (pp. 27–42). Cambridge University Press. https://doi.org/10.1017/CBO9781139547369.004

Shute, V. J. (2008). Focus on formative feedback. Review of educational Research, 78(1), 153-189. https://doi.org/10.3102/0034654307313795

​​​

​​

 

 

 

​
​