Introduction to Numbas Workshop

Chris Graham and Christian Lawson-Perfect
School of Mathematics, Statistics & Physics, Newcastle University

What is Numbas?

Numbas is an open-source system developed by the e-Learning Unit of Newcastle University's School of Maths and Stats, based on many years of use, experience and research into e-assessment.

It's aimed at numerate disciplines.

Everything runs on the client - no backend server, even for maths.

It creates SCORM-compliant exams which run entirely in the browser, compatible with VLEs such as Blackboard and Moodle.

Design goals

  • Scalable, reliable and accessible to a broad range of users.
  • Good at maths, but usable for other subjects too.
  • Good-looking and easy for students to use.
  • Used by question authors who aren't experts.
  • Emphasis on creating rich formative e-assessment and learning materials.
  • Feedback an important part of the design and implementation.

Why use Numbas?

  • Easy to obtain, use and tailor to your own requirements.
  • You have full control over the creation, use and dissemination of assessment.
  • Customisable everywhere, from appearance down to core functionality.
  • Browser-based so you can include all that the web can offer.
  • Sustainability built in - fully supported by the School of Maths and Stats at Newcastle.

Methods of delivery

  • Stand-alone over the web
  • DVD, USB key, eBook
  • VLE, e.g. Blackboard or Moodle

Compatible devices

All of them!

Formative vs summative use

Computer-aided assessment is great for formative assessment.

Students can try randomised questions over and over until they're happy.

Summative assessment poses problems:

  • How to prevent cheating?
  • Can you ask sufficiently challenging questions?

Use at Newcastle

In the School of Mathematics, Statistics & Physics

  • Diagnostic tests in week 1.
  • Banks of practice material to supplement lecture material.
  • In-course assessment: 2 per semester for core modules
  • In 2016/17 we ran our first final exam using Numbas.

Use At Newcastle

Other use

  • Formative use in a pre-entry course for non-standard applicants.
  • Diagnostic and formative use in Psychology, business studies, engineering, animal science.
  • Revision material on our maths support website.

Use elsewhere

  • 100+ universities in the UK and around the world.
  • Free revision resources on mathcentre.ac.uk.
  • 1,500+ users registered on public editor.
  • 5,000+ exams; 23,000+ questions.

Open access

Compiled Numbas tests are SCORM packages: they're completely self-contained. Perfect for open access resources.

We want to establish a community of authors and users producing quality open-access material.

The mathcentre editor

  • Open to everyone.
  • Over 1,500 questions available to use.
  • Collect ready-made questions into a custom test, or write your own.

numbas.mathcentre.ac.uk

Task 1: Create a test using existing questions.

  1. Register at numbas.mathcentre.ac.uk.
  2. Browse the question bank. Try a few questions.
  3. Add some questions to your "basket", and create an exam using them.
  4. Upload your exam to Blackboard.

Task 2: Intro to writing questions.

  1. Have a look at the Numbas documentation on question writing (bit.ly/numbasdocs).
  2. Think of your own question, and implement it.

Tips

  • Give everything sensible names!
  • Avoid complicated ideas

Collaboration

We're very keen to help others to use Numbas in their courses.

We can do training and provide support, or just help when you get stuck.

Feature requests are also welcome!

Email numbas@ncl.ac.uk.

Thanks!

Website

Contact

Source code