Test Generator

The Test Generator allows users of the Vienna Test System (VTS) to create questionnaires, surveys, knowledge tests or even simple performance tests themselves. Different types of test pages are available for this purpose, offering various options for displaying content and recording the respondents' answers.

Creating a test in the Test Generator involves several steps:

  1. Create a new test, make the necessary settings, add and design the individual test pages (see Design a new test)

  2. Set the scoring (definition of variables, see Set the scoring)

  3. Create a results report to output the results in the VTS (see Create the results report)

The tests created in this way can then be presented in the VTS, provided the necessary licenses are available. To run the tests, you need either "TQ" licenses or SCHUHFRIED Selection licenses in your VTS.

This user guide describes the individual steps for creating tests in the Test Generator. In the individual chapters you will find instructions and examples for designing tests, surveys or questionnaires. Below on this page you can also find a collection of frequently asked questions (FAQ).

Important information / Disclaimer
SCHUHFRIED accepts no liability for the results of tests created with the Test Generator. In addition, the user of the Test Generator is solely responsible for the content of the tests or questionnaires created with the Test Generator.

Please note the conditions for using the Test Generator set out in the General Terms and Conditions of the Vienna Test System.

FAQ

Test creation

Q: What types of tests can I create?

A: The Test Generator is designed to enable the creation of knowledge tests, questionnaires or surveys or even low-complexity ability tests. Various types of test pages are available for this purpose. Each test page is designed to support different types of questions and answers. For example, you can create feedback questionnaires, knowledge tests, personality questionnaires, opinion surveys and questionnaires for assessing the quality of training or clinical evaluations.

Q: Can I use images?

A: Yes, images can be added to the various test pages. The editor menu can be used for this. This appears when text is selected (option: Add image). Images can also be added using drag & drop. Standard image formats like .jpeg, .png, .webp and .gif are supported. Please consider to make the images as small as possible (file size) to maintain a high performance.

Q: Why does the test label of my test have to start with TQ?

A: The tests you create require a special license in order to be used. The "TQ" at the beginning of the test name enables the program to recognize that the test does not originate from SCHUHFRIED and requires this special license for use.

Q: Can I change the name of my test?

A: The name of your test cannot be changed after you have saved it for the first time. If you need to change it, you can duplicate the test and change the name when you create the duplicate.

Q: Why is my test locked?

Q: If you see a lock symbol next to the name of your test, this means that another user is currently editing this test. Although you can open the test in edit mode, you cannot save any changes. If the other user closes the test after editing, you can open the test again in normal edit mode.

Q: Is there a limit to the number of test questions?

A: There is no fixed upper limit, but practical limitations may depend on the scope and length of the test you wish to create. In particular, the reasonableness of the test administration (e.g. duration and strain on the respondent) should be considered.

Q: What are the page name and phase of a test page used for?

A: The page name allows you to give your test pages a name, which helps you to keep track when you Delete test pages or set the scoring.

Settings for the test phase, which is available via a drop-down menu, determine whether the test page is an instruction element or part of the actual test to be scored. Only pages with the "Test" phase are available for scoring. Please note that a newly created test page always adopts the test phase settings of the last test page in your test. Make sure that you check and adjust the phase for each new test page as required to ensure that they are set correctly.

Q: Can I duplicate my test to create a new version?

A: Yes, you can duplicate existing tests to create new versions so that you can easily modify and reuse previous versions of the test. To do this, go to the main page of the Test Generator, on the right side of your test you will see a button next to it, which has the shape of three dots. Click on it, select "Duplicate" and rename the duplicated test. You now have an exact copy of your original test.

Q: Can I add norms to my test?

A: Yes, you can add norms to your test using the norms editor. Go to the main page of the Test Generator. On the right-hand side of your test, you will see a button with three dots. Click on it and select Norms to open the norms editor. Here you can add both simple norms or norms for specific socio-demographic subgroups to your test.

Q: How do I implement the feedback function correctly for a test question?

A: To ensure that the test participant understands how to edit the test correctly, you can add instruction items that provide feedback if, for example, a question is answered incorrectly. Add the text that should be displayed when the condition (incorrect answer or no answer) occurs in the corresponding fields on the pages under Feeback.

When setting up the feedback, make sure to configure the other options correctly so that the question can be answered correctly. For example, if a question has multiple correct answers, select "Multiple Choice" as the answer modality. If you select "Single Choice", the test participant would only be able to select one answer and would not be able to answer the question correctly, which is why the feedback would always be displayed.

You also have the option of displaying feedback if no answer option has been selected and the participant tries to skip the question. This type of feedback can also be used in the test phase to prevent respondents from skipping pages without providing input.

Q: Why is the Save button grayed out?

A: If important Settings are not configured, you will not be able to save your test. Fields and Settings that are not filled in correctly will show red text until they are filled in correctly. Make sure that all these Settings are set or entered correctly to activate the Save button. It is also possible that the entries are in an Incorrect format. In this case, please note the notes shown in red regarding the entries.

Test Scoring

Q: Why do no test pages appear when setting up a variable?

A: Make sure that the phase of the relevant pages is set to "Test" in order to include them in the evaluation and variable evaluation.

If you have created several test pages but these are not displayed for selection in the variable settings, it may be because the phase of the pages is still set to "Instruction". Instruction pages are not taken into account for scoring the test participant's results and therefore cannot be selected for scoring a variable.

Q: What does the option 'Selected pages are selectable as scale when configuring the tests' do?

A: You can use this option to make the test procedure configurable by making certain question groups (scales) selectable. If this option is activated for several variables, you can select which scales (question groups) are to be included in the test procedure when configuring the test.

For example, if you create a questionnaire with three scales on General Information, Drinking Habits and Hereditary Diseases, you can choose which of the three scales to use when configuring the test procedure.

Test result report

Q: Why do all the answers appear red in the test protocol even though I have set some of the questions to have no correct or incorrect answer options?

A: In the results report, the answers are color-coded based on the evaluation criteria defined for each subtest. Currently, the report can distinguish between "Correct and Incorrect" (= green and red) or "Neutral" (= blue) scores on a subtest basis.

Correct/incorrect scoring: If at least one question within a subtest is coded with correct/incorrect answers, this color scheme is automatically applied. Correct answers are displayed in the report as green with a plus sign and incorrect answers as red with a minus sign. Questions for which there is no correct or incorrect answer are displayed in the report as red with a question mark at the end of the answer.

Neutral scoring: If no questions within a subtest are coded as correct or incorrect, this color scheme is applied and all answers for this subtest are displayed in blue with a question mark.

Q: My respondent has completed the test, but no results are displayed in the "Results" tab. What could be the problem?

A: There are two possibilities: Either the relevant test pages have not been set as part of the test phase and are still set as instruction pages, or a results report has not yet been created. Please check the settings of the test pages and make sure that a results report has been created.

Test installation

Q: How do I install my test?

A: To install your test, go to the main page of the Test Generator. On the right-hand side of your test, you will see the "Install" button in the form of a triangle. Press this button to install your test. Please note that once you have installed a test, you can only overwrite it with a newer version, not uninstall it!

Q: Why do I have to install a test before I can use it in VTS Online?

A: When you create and save a test in the Test Generator, you only create the files that the VTS needs for your test to work. Before using, these files must be installed in the VTS so that you can use your test. This is a technical requirement that allows you to make changes to your test without impairing the testing performed with an already installed version.

Q: The test I created with the Test Generator is only executed in demo mode. How can I execute the test without restrictions?

A: To be able to use your test in full, you need a special license (TQ or SFS license). You can purchase this license in the VTS Marketplace or from your SCHUHFRIED sales representative.

Further questions

Q: Is it possible to present the tests on the cell phone / tablet?

A: Yes, the tests generally work on smartphones and tablets. However, it is recommended to check individually whether all content is easy to read and whether the answer options can be selected sufficiently well on a mobile device. The presentation of the test content depends on the configuration of the test. In particular, the number of answer options or questions per page and the size of any images can influence how well the test can be edited on a cell phone.

Q: Can I export the data from my test?

A: Yes, you can download the results as a PDF in the "Results" tab or you can export the results of your test participants as .csv file format.