Creating Tests in Ilias

Tabs

On the course/folder page (where the test object will reside), click ‘Add New Item’. Under the Assessment category, click ‘Test’.

You will be presented with three options for adding a test item/object:

Click each panel to learn more.

This option creates a new test from scratch – all settings will need to be set.
  1. To add a new test, enter the Title of the test, followed by a Description (optional). The New Test option is selected by default.
  2. When you have all your information added, click ‘Add test’. Clicking ‘Cancel’ will return you to the root of the Category you are in.
In this option, you will import a test that exists outside of the ILIAS environment – function settings within ILIAS may need to be modified.
  1. To import a test, click ‘Option 2: Import Test’.
  2. Click ‘Choose File’. A window will appear allowing you to browse to the location of the file on your computer. You can only import .ZIP files with a maximum size of 4096.0 MB.
  3. Click the file you want to import and click ‘Open’ or double-click the file.
  4. The name of the file you have selected will appear to the right of the ‘Choose File’ button. Ensure this is the correct file.
  5. Click ‘Import’. Clicking ‘Cancel’ will return you to the root of the Category you are in.
  6. If the file you have selected is too large, or a file type that is not supported, you will receive an error.
This option will copy an existing test that was built within the ILIAS environment – all test content and settings will be copied.
  1. To copy an existing test, click ‘Option 3: Copy Test’.
  2. Type the title (or partial title) of the test you want to copy in the Title field. This action is required.
    1. You can enter any text that is found in the title of the test that you want to copy. ILIAS will search through the Repository and provide you with a list of items to choose from.
  3. Click ‘Continue’.
  4. A list of tests containing the title you entered will be displayed. The list will identify the name of the test, as well as the location of it on ILIAS.
    1. If no matches are found, you will receive a warning.
    2. If the results returned do not include the test that you want to copy, click ‘Back’ to try again.
  5. Click the radio button beside the title of the test you want to copy.
  6. Click ‘Copy Test’ to copy the test to the Category you are in.
  7. The test will be titled “XXXX – Copy” where “XXXX” is the title of the test you selected. Rename the copy to the new test title.
When you have completed the steps for whichever option you chose, click ‘Add Test’ in order to finish. This will take you to the edit mode of the test where you may access different settings of the test.

Testing Settings

Once you have added your test object, you will automatically be taken to the ‘Settings’ tab where you will see a notification stating: ‘Object added’.

The settings for a test are broken down into eight categories:
  • General Settings
  • Availability
  • Information Before Start of Test
  • Administering the Test: Access
  • Administering the Test: Testrun
  • Administering the Test: Behaviour of the Question
  • Administering the Test: Functionality Available to Participants
  • Finishing the Test

General Settings

The General Settings category consists of five areas:
  • Title - This is the title of your test and will be prefilled with the title you provided on creation. Changing the title here will change the title of the test object on the ILIAS page.
  • Description - The description of your test, if you added one when creating the test object, will be prefilled. You can add/edit description text at any time. It is not mandatory to have a description.
  • Use of Question Pools - You have two options here:
    • Questions can be added optionally to a question pool (Default)
    • This option allows the questions you create to be used in other tests (see the Creating Question Pools section for more information)
    • Questions are created directly in the test
    • The questions you create can only be used in this test
  • Selection of Test Questions - You have three options:
    • Fixed Set of Questions (Default)
    • All participants in the test will get the same set of questions.
    • Random Set of Questions
    • Each participant will get a different set of questions. Questions will be randomly selected from question pools.
  • Question Queue – All Questions from a Question pool - Test questions are pulled from one or more pools of questions – Question pools can be used for more than one test. With this option, participants work through all questions from a selected question pool.

Note: Questions cannot be added or edited in a live test without first removing all user data from that test.

If using questions from a Question Pool and modifications are done to the pool, tests that use that pool will need to be re-synced to be updated. Learner data from a live test will need to be removed before you can re-sync to the updated pool.

  • Privacy – Two options:
    • Result with Names
    • Results without Names/Anonymous Test
  • Availability – Under Availability, there are two fields:
    • Online – This must be checked for the course to be visible and available to participants.
    • Limited Availability Period – Selecting this option will allow you to set the period during which participants can access the test, using the following:
      • Start Time is the point in time after which the test can be opened by participants.
      • Finish Time is the point in time at which the test will no longer be available to participants.
      • Always Visible will allow the participants to see the test’s title before and after the test period, but they will only be able to access the test during the defined period (Start Time and Finish Time). If unchecked, learners will not see the test title/object until the Start Time begins.

Both fields (Online and Limited Availability Period) can be selected at the same time.

Note: Availability Period of the test only determines whether its starting page can be opened by participants.

Starting Time and Finishing Time in the Administering the Test: Access section determines the period during which the test can actually be taken by participants.

Information Before Start of Test

The following options are available under Information Before Start of Test:
  • Introductory Message - If selected, you can add text that will appear to participants before the start of the test.
  • Show all Test Properties (Default) - When selected, participants are presented with a complete list of test properties on the Info tab of the test. These properties include information on the scoring and reporting of the test. You can de-select this if desired.

Administering the Test: Testrun

The following options are available under Administering the Test: Testrun:
  • Limit Number of Test Passes - If checked, you can set a maximum number of attempts a participant can take the test before having to be reset/re-enrolled
  • Force Waiting Time between Passes - With this option, additional passes cannot be started until the defined time has passed since the last finished attempt
  • Limit Duration of Test - If selected, participants can only work through the test for a specified amount of time. Time begins when a participant starts the test for the first time. The clock will run regardless of activity.
  • Maximum Duration of the Test - Set the length, in minutes, for how long a participant is granted to take the test
    • Reset duration for every test attempt resets the defined amount of time after each attempt. This setting requires multiple attempts to become effective. (optional)
  • Exam View - This will hide the browser bar, navigation, and all other screen elements that are not part of the test. Participants are prevented from opening any other websites in that same browser.
    • Show Test Title will display the title at the top of the screen
    • Show Name of Participant will display the participants name at the top of the screen
  • Display Testpass ID - If selected, a unique identifier is displayed in the test. A new ID is generated for every attempt.

Administering the Test: Functionality Available to Participants

The following options are available under Administering the Test: Functionality Available to Participants:
  • Use Previous Answer (Default)
    • If selected, this allows participants to be presented with their answers from previous test passes. This option has to be activated by individual participants on the “Info” tab before starting a test attempt.
  • Suspend Test
    • If selected, participants are presented with a button to stop the test and to continue it later.
    • Caution: Suspending the test does not stop the countdown of the maximum duration of the test
  • Unanswered Questions
    • Unanswered Questions Stay in Position
      • Questions that participants skip without answering will stay at their position in the test and remain answerable
  • Unanswered questions will be enqueued
    • Questions that participants skip without answering will be moved to the bottom of the test to be presented again
  • Show List of Questions
    • If selected, participants can switch on a list of test questions. This list will appear to the left of the actual question. Additionally, they are presented with a button List of Questions. When the List of Questions button is clicked, the participant will be shown the overall status of all questions in the test. Options for this are:
      • Show prior to the first question
      • Show before the participant finished the test
      • Include question descriptions
  • Flagging Questions
    • If selected, participants have the option to flag a test question. The flags are shown in the List of Questions provided that option is activated.

Administering the Test: Access

The following options are available in this section:
  • Starting Time (if you want to limit the availability period of the test) - The point in time after which the test can be started by clicking the Start button. Participants can provide answers to questions.
  • Finishing Time (if you want to limit the availability period of the test) - The point in time at which the test will be closed. Participants can no longer answer questions.
  • Test Password - If you define a password, all participants with test access must enter the password to start the test
  • Manually Selected Participants - If checked, only participants manually added in the Participants tab can access the test
  • Limit Number of Concurrent Participants - If checked, ILIAS will monitor the number of participants taking the test at the same time. If more users than defined try to access the test, ILIAS will prevent them from starting the test.
  • Max. Number of Participants (mandatory if Limit Number is selected) - The maximum number of participants allowed to take the test simultaneously
  • Idle Time for Active Users (optional) - Participants that do not click in the test for the indicated amount of time will be categorized as “inactive” and removed from the test

Administering the Test: Behaviour of the Question

The following options are available under Administering the Test: Behaviour of the Question:
  • Show Question Title - There are three options available:
    • Show Question Titles and Available Points (Default)
    • Show Only Question Titles
    • Show Neither Question Titles nor Available Points
  • Automatic saving - Answers are automatically saved in specified intervals (seconds) to avoid data loss – turned on and set to 30 seconds by default – you can turn off or change the interval value
  • Shuffle Questions - Shuffles the sequence of questions for each participant, for each of their attempts. (Do not mistake this option for the random selection of questions.)
  • Hints - Allows participants to request a hint to answer a question. You can configure a hint in a way that its usage triggers a score deduction that has to be defined by you and to be confirmed by the participant.
    • Hint text is added on the Hints tab in Question Edit mode
  • Instant Feedback (feedback presented per question as learner proceeds)
    • Points Attained - If selected, when a participant clicks the Check button, ILIAS will display how many points were attained from answering the question
    • Feedback on Fully Correct Answer - If the answer provided is fully correct, ILIAS will show one type of feedback upon clicking the Check button. If the answer provided is not fully correct, another type of feedback will be displayed. Both types of feedback have to be prepared in the Feedback tab of the respective question.
    • Specific Feedback for Each Answer Provided - When the Check button is clicked, ILIAS will show specific feedback for every answer option selected by the participant. The feedback has to be prepared along with the question. Specific feedback is not supported for all question types.
    • Show Best Possible Answer - When the Check button is clicked, ILIAS will display the best possible answer to the question
  • Lock Answers
    • Do Not Lock Answers - Participants can click Request Feedback to get feedback on their answer as configured in the Instant Feedback option. They may, however, change their answer afterwards.
    • Lock Answers and give Feedback - Participants can click Save Answer, Freeze and Check to lock their answer and get feedback as configured in the Instant Feedback option. Afterwards they can no longer change their answer.
    • Lock Answers and Force Feedback - After participants click 'Save Answer, Freeze and Check' or save the answer when they navigate away from the question, they can no longer change their answer. Participants will be automatically presented with feedback as configured in the Instant Feedback option.
    • Do Not Lock Answers but Force Feedback - After participants click Request Feedback or save the answer when they navigate away from the question, they will be automatically presented with feedback as configured in the Instant Feedback option. They may, however, change their answers afterwards.
  • Compulsory Questions:
    • The test can only be finished if all compulsory questions are answered
    • If checked here, the List View of questions will display a checkbox for each question to select those that are compulsory
    • For participants, the option Show List of Questions should be activated in the Administering the Test: Functionality Available to Participants category to help them identify compulsory questions

Finishing the Test

The following options are available under Finishing the Test:
  • Overview of Answers Given
    • Participants are presented with all questions and the answers they provided in an overview prior to submitting the test. These can be made available via PDF download.
  • Concluding Remarks
    • If selected, you can add text that will appear to participants after the test is submitted
  • Redirect
    • After completion of the test, each participant can be automatically redirected to a defined webpage for which you add the URL. This is only valid if the participants do not have access to their test results.
  • Digitally Sign Test Submissions
    • If this is activated, participants will be requested to digitally sign their test submissions. A signature plugin must be installed and active to use this.
  • Notification
  • This will send an e-mail to the test owner for every user that has completed the test. Options for what will be included in the notification email are:
    • Send username and finish date (sent on test passed)
    • Send complete test result (sent on test passed)
    • Send notification even if a user finishes a test pass (notification sent on click of Finish Test, regardless of test passed or failed)
Once you have selected all your options, click ‘Save’.

Return to Topic Folder

Return to Top of Page