{"id":1529,"date":"2020-03-23T15:45:29","date_gmt":"2020-03-23T15:45:29","guid":{"rendered":"http:\/\/www.numbas.org.uk\/?p=1529"},"modified":"2020-11-19T16:24:59","modified_gmt":"2020-11-19T16:24:59","slug":"how-numbas-can-help-during-the-covid-19-crisis","status":"publish","type":"post","link":"https:\/\/www.numbas.org.uk\/theme-testing\/blog\/2020\/03\/how-numbas-can-help-during-the-covid-19-crisis\/","title":{"rendered":"How Numbas can help during the COVID-19 crisis"},"content":{"rendered":"\n<p>Now\n that face-to-face teaching in many institutions has been cancelled in \nresponse to the coronavirus crisis, many lecturers are looking for ways \nto move their teaching and assessment online.&nbsp;<\/p>\n\n\n\n<p>We\u2019ve put this page together as a reference to describe how Numbas could be used to help your students and to replace paper-based assessments.\u00a0<\/p>\n\n\n\n<!--more-->\n\n\n\n<h2>What Numbas is&nbsp;<\/h2>\n\n\n\n<p>Numbas is a free, open-source e-assessment system for mathematical subjects.&nbsp;<\/p>\n\n\n\n<p>Key features include:&nbsp;<\/p>\n\n\n\n<ul><li>Numbas exams can run entirely stand-alone, so you can start using Numbas without a contract or any IT support.&nbsp;<\/li><li>Immediate feedback \u2013 every question is marked automatically.&nbsp;<\/li><li>Questions can be randomised, with a sophisticated <a href=\"https:\/\/docs.numbas.org.uk\/en\/latest\/question\/reference.html#variables\" target=\"_blank\" rel=\"noreferrer noopener\">variable generation system<\/a>.&nbsp;<\/li><li><a href=\"https:\/\/docs.numbas.org.uk\/en\/latest\/question\/parts\/reference.html#adaptive-marking\" target=\"_blank\" rel=\"noreferrer noopener\">Adaptive marking<\/a> to allow \u2018error carried forward\u2019 marking.&nbsp;<\/li><li>Plenty of <a href=\"https:\/\/docs.numbas.org.uk\/en\/latest\/question\/parts\/reference.html#part-types\" target=\"_blank\" rel=\"noreferrer noopener\">answer types<\/a>: mathematical expression, number, matrix, quantity with units, multiple choice, and more.&nbsp;<\/li><li>Lots of <a href=\"https:\/\/docs.numbas.org.uk\/en\/latest\/exam\/reference.html#feedback\" target=\"_blank\" rel=\"noreferrer noopener\">settings<\/a> to control how much feedback students get.&nbsp;<\/li><li>Easily <a href=\"https:\/\/docs.numbas.org.uk\/en\/latest\/authoring\/how-do-i.html#images-diagrams-and-other-media\" target=\"_blank\" rel=\"noreferrer noopener\">integrate videos and interactive diagrams<\/a>.&nbsp;<\/li><li>Supports <a href=\"https:\/\/docs.numbas.org.uk\/en\/latest\/custom-part-types\/reference.html\" target=\"_blank\" rel=\"noreferrer noopener\">custom answer types<\/a> and <a href=\"https:\/\/docs.numbas.org.uk\/en\/latest\/marking-algorithm.html\" target=\"_blank\" rel=\"noreferrer noopener\">marking algorithms<\/a> when you want to do something not supported by the built-in types.&nbsp;<\/li><li><a href=\"https:\/\/docs.numbas.org.uk\/en\/latest\/extensions\/index.html\" target=\"_blank\" rel=\"noreferrer noopener\">Extensions<\/a> adding extra functionality.&nbsp;<\/li><\/ul>\n\n\n\n<p>There\u2019s an editor at <a rel=\"noreferrer noopener\" href=\"https:\/\/numbas.mathcentre.ac.uk\/\" target=\"_blank\">numbas.mathcentre.ac.uk<\/a> where you can create your own questions or reuse existing questions.&nbsp;It\u2019s quick to sign up and we have lots of <a rel=\"noreferrer noopener\" href=\"https:\/\/docs.numbas.org.uk\/en\/latest\/\" target=\"_blank\">documentation and tutorials<\/a> to get you started.&nbsp;<\/p>\n\n\n\n<h2>How it works&nbsp;<\/h2>\n\n\n\n<ul><li>Write questions using the Numbas editor.&nbsp;<\/li><li>Collect questions into an exam.&nbsp;<\/li><li>Share the exam with students.&nbsp;<\/li><li>Students attempt the exam. They can pause or leave the exam at any point and return to it later. &nbsp;<\/li><li>Scores are automatically sent back to your VLE\u2019s grade book.&nbsp;<\/li><\/ul>\n\n\n\n<p>Numbas\n exams run entirely on the student\u2019s device, so the student\u2019s experience\n is not affected by a spotty internet connection. Once the exam starts, \nthe only communication with the server is to report scores back (even \nthis is optional \u2013 if you don\u2019t want to track students\u2019 scores, Numbas\n can run entirely standalone). Other systems need constant communication\n back to the server to render mathematical notation or to handle marking\n and navigation.&nbsp;<\/p>\n\n\n\n<p>And if you\u2019re using the Numbas LTI tool, instructors can:&nbsp;<\/p>\n\n\n\n<ul><li>See statistics about the class\u2019s performance.&nbsp;<\/li><li>Review individual students\u2019 attempts exactly as the students saw them.&nbsp;<\/li><li>Download a full breakdown of students\u2019 attempts in CSV format.&nbsp;<\/li><\/ul>\n\n\n\n<h2>What can I use it for?<\/h2>\n\n\n\n<p>Numbas was originally designed for use in our mathematics and statistics programmes.<\/p>\n\n\n\n<p>However, Numbas has also been used for many other subjects, including engineering; chemistry; physics; business studies; psychology; sports science; accounting; and biomedical science.<\/p>\n\n\n\n<p>Even non-mathematical subjects can benefit from Numbas by making use of its several multiple-choice question types.<\/p>\n\n\n\n<h2>Why should I use it?&nbsp;<\/h2>\n\n\n\n<p>Automatic assessment gives students immediate feedback, allowing them to work at their own pace.&nbsp;<\/p>\n\n\n\n<p>Randomised questions are good both for practice and for exams where you don&#8217;t want students to be able to copy off each other.&nbsp;<\/p>\n\n\n\n<p>There&#8217;s a lot of free material available to use under a permissive Creative Commons licence. Use the <a href=\"https:\/\/numbas.mathcentre.ac.uk\/explore\/\" target=\"_blank\" rel=\"noreferrer noopener\">Explore page<\/a> or the search facility to find content.&nbsp;<\/p>\n\n\n\n<h2>How do I get started?&nbsp;<\/h2>\n\n\n\n<p>Follow <a href=\"https:\/\/docs.numbas.org.uk\/en\/latest\/tutorials\/create-an-account.html\" target=\"_blank\" rel=\"noreferrer noopener\">the tutorials at docs.numbas.org.uk<\/a>. They will show you how to browse the question database, write your question, and deliver an exam to your students.&nbsp;<\/p>\n\n\n\n<p>Once you\u2019ve done that, there\u2019s full documentation on every feature of the editor, as well as <a href=\"https:\/\/docs.numbas.org.uk\/en\/latest\/authoring\/how-do-i.html\" target=\"_blank\" rel=\"noreferrer noopener\">\u2018how-to\u2019 instructions for common tasks<\/a>. A good next step is our document on <a href=\"https:\/\/docs.numbas.org.uk\/en\/latest\/authoring\/planning-a-question.html\" target=\"_blank\" rel=\"noreferrer noopener\">effectively planning a Numbas question<\/a>.&nbsp;<\/p>\n\n\n\n<h2>Where can I get help?&nbsp;<\/h2>\n\n\n\n<p>Post your questions to <a href=\"https:\/\/groups.google.com\/forum\/#!forum\/numbas-users\" target=\"_blank\" rel=\"noreferrer noopener\">the numbas-users mailing list<\/a>.&nbsp;<\/p>\n\n\n\n<p>We&#8217;re happy to answer questions emailed to <a rel=\"noreferrer noopener\" href=\"mailto:numbas@ncl.ac.uk\" target=\"_blank\">numbas@ncl.ac.uk<\/a>, but please understand we\u2019re quite busy at the moment!&nbsp;<\/p>\n\n\n\n<h2>Delivering Numbas tests to students&nbsp;<\/h2>\n\n\n\n<p>There\u2019s <a href=\"https:\/\/docs.numbas.org.uk\/en\/latest\/tutorials\/deliver-to-students.html\" target=\"_blank\" rel=\"noreferrer noopener\">more detailed info in the Numbas documentation<\/a>.&nbsp;<\/p>\n\n\n\n<p>For purely formative material, you can just <a href=\"https:\/\/docs.numbas.org.uk\/en\/latest\/tutorials\/deliver-to-students.html#embed-from-the-editor\" target=\"_blank\" rel=\"noreferrer noopener\">share a link to a Numbas exam<\/a>.\n Students can complete the test, but their scores won\u2019t be saved \nanywhere. This is a good solution if you want to quickly provide a bank \nof revision material.&nbsp;<\/p>\n\n\n\n<p>To\n save scores, you need a virtual learning environment that supports \neither SCORM (Moodle and Blackboard do, among others) or LTI (pretty \nmuch everything).&nbsp;<\/p>\n\n\n\n<p>The table below shows which standards are supported by common VLEs.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td><strong>VLE<\/strong>&nbsp;<\/td><td><strong>SCORM<\/strong>&nbsp;<\/td><td><strong>LTI<\/strong>&nbsp;<\/td><\/tr><tr><td>Blackboard&nbsp;<\/td><td>Yes, but don\u2019t rely on it for high-stakes&nbsp;<\/td><td>Yes \u2013 admin must make connection&nbsp;<\/td><\/tr><tr><td>Moodle&nbsp;<\/td><td>Yes&nbsp;<\/td><td>Yes \u2013 teacher can make connection&nbsp;<\/td><\/tr><tr><td>Canvas&nbsp;<\/td><td>No&nbsp;<\/td><td>Yes \u2013 teacher can make connection&nbsp;<\/td><\/tr><tr><td>Desire2learn Brightspace&nbsp;<\/td><td>Yes&nbsp;<\/td><td>Yes&nbsp;  &#8211; admin must make connection&nbsp;<\/td><\/tr><tr><td>ILIAS&nbsp;<\/td><td>Yes&nbsp;<\/td><td>Yes, with a plugin&nbsp;<\/td><\/tr><tr><td>Sakai&nbsp;<\/td><td>Yes, with a plugin&nbsp;<\/td><td>Yes \u2013 teacher can make connection&nbsp;<\/td><\/tr><tr><td>Schoology&nbsp;<\/td><td>Yes&nbsp;<\/td><td>Yes \u2013 teacher can make connection&nbsp;<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>For SCORM, no setup is required: you download the package from the Numbas editor and upload it to your VLE.&nbsp;<\/p>\n\n\n\n<p>For LTI, you might need your VLE administrator to set up a connection. The Numbas LTI software needs to run on your own server. There\u2019s <a rel=\"noreferrer noopener\" href=\"https:\/\/numbas-lti-provider.readthedocs.io\/en\/latest\/getting-started.html\" target=\"_blank\">full documentation about what you need and how to set it up<\/a>.&nbsp;<\/p>\n\n\n\n<h2>Considerations for high-stakes assessment<\/h2>\n\n\n\n<p>If you&#8217;re thinking of using Numbas for a high-stakes assessment, consider the following:<\/p>\n\n\n\n<h3>Robustness<\/h3>\n\n\n\n<p>Do everything you can to avoid losing student data. If using your VLE&#8217;s built-in SCORM player, it is responsible for saving attempt data. <\/p>\n\n\n\n<p><span style=\"text-decoration: underline;\">Blackboard&#8217;s SCORM player can not be relied upon.<\/span> Consistent reports describe Blackboard failing to save data for around 10% of students&#8217; attempts.<\/p>\n\n\n\n<p>We have fixed several bugs in Moodle&#8217;s SCORM player, and are now quite confident that it is reliable.<\/p>\n\n\n\n<p>The Numbas LTI tool has been heavily tested and has several features to ensure no data is lost:<\/p>\n\n\n\n<ul><li>Data is saved to the student&#8217;s local storage as well as the remote server. If the student&#8217;s device crashes, they can resume where they left off after restarting.<\/li><li>After finishing, the student is shown a large warning box until all data has been confirmed to be saved.<\/li><li>Students can be automatically <a href=\"https:\/\/numbas-lti-provider.readthedocs.io\/en\/latest\/instructor\/resources.html#validate-a-receipt-code\">emailed a receipt<\/a> containing a code which the instructor can use to validate their score. <\/li><\/ul>\n\n\n\n<p>Additionally, you can instruct your students to click the &#8220;Print this results summary&#8221; button after they have finished the exam, and print to a PDF file. They could email this to you if there&#8217;s a discrepancy with the score saved in your VLE.<\/p>\n\n\n\n<h3>Security<\/h3>\n\n\n\n<p>Because Numbas exams run in the browser, it&#8217;s possible that students could use their browser&#8217;s developer tools to modify their scores. For high-stakes assessments, we have always recommended using a locked-down browser. <\/p>\n\n\n\n<p><a href=\"https:\/\/safeexambrowser.org\/news_en.html\">Safe Exam Browser<\/a> is an open-source tool which provides a locked-down browser.<\/p>\n\n\n\n<h3>Validity<\/h3>\n\n\n\n<p>Think carefully about what questions you can ask. You might need to think creatively about how to assess questions which would normally be answered with long passages of text. These questions could be reconfigured as multiple-choice, or you might just need to ask different questions.<\/p>\n\n\n\n<h2 id=\"training-sessions\">Training<\/h2>\n\n\n\n<p>We&#8217;re going to run online training sessions, open to all. These will be informal, with a flexible format.<\/p>\n\n\n\n<p>At the moment, we&#8217;ve scheduled the following sessions:<\/p>\n\n\n\n<ul><li>10:00 GMT, Wednesday March 25th.<\/li><li>10:00 GMT, Wednesday April 1st.<\/li><li>10:00 GMT, Wednesday April 8th.<\/li><\/ul>\n\n\n\n<p>We&#8217;ll begin by running through the Numbas <\/p>\n\n\n\n<p>The sessions will run over Zoom. You&#8217;ll need to <a href=\"https:\/\/newcastleuniversity.zoom.us\/meeting\/register\/tJMpc-6prjkvEMKFXb9D8UWQfeqHJ3uWpw\">register in advance, using this link<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Now that face-to-face teaching in many institutions has been cancelled in response to the coronavirus crisis, many lecturers are looking for ways to move their teaching and assessment online.&nbsp; We\u2019ve put this page together as a reference to describe how Numbas could be used to help your students and to replace paper-based assessments.\u00a0<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[36],"tags":[],"_links":{"self":[{"href":"https:\/\/www.numbas.org.uk\/theme-testing\/wp-json\/wp\/v2\/posts\/1529"}],"collection":[{"href":"https:\/\/www.numbas.org.uk\/theme-testing\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.numbas.org.uk\/theme-testing\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.numbas.org.uk\/theme-testing\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.numbas.org.uk\/theme-testing\/wp-json\/wp\/v2\/comments?post=1529"}],"version-history":[{"count":6,"href":"https:\/\/www.numbas.org.uk\/theme-testing\/wp-json\/wp\/v2\/posts\/1529\/revisions"}],"predecessor-version":[{"id":1624,"href":"https:\/\/www.numbas.org.uk\/theme-testing\/wp-json\/wp\/v2\/posts\/1529\/revisions\/1624"}],"wp:attachment":[{"href":"https:\/\/www.numbas.org.uk\/theme-testing\/wp-json\/wp\/v2\/media?parent=1529"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.numbas.org.uk\/theme-testing\/wp-json\/wp\/v2\/categories?post=1529"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.numbas.org.uk\/theme-testing\/wp-json\/wp\/v2\/tags?post=1529"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}