Posted on By EvalartTagged
The questionnaire builder is a tool that allows you to build or modify a questionnaire (if you have the privileges to edit a particular questionnaire), as well as see all your information and related items in one place. The questionnaire builder can be accessed from the main menu, Questionnaires, Questionnaire Builder or from the list view of questionnaires. If you enter from the menu, the questionnaire builder starts empty and you have to click on the icon of the folder at the top to load a particular questionnaire. If you want to create a new questionnaire, you must first go to the “New Questionnaire” option in the “Questionnaire” menu in the main menu. Once created, you can move on to the constructor to add the questions, sections and other configurations of the questionnaire.
In the upper part of the Questionnaire Builder the name of the questionnaire is shown, its version (which is an internal identifier of the current version of the questionnaire) and an alert in case there are inconsistencies detected in the questionnaire (such as a questionnaire without questions). Next to the button of the folder that allows to open a questionnaire, there is an icon with the shape of an eye that allows to open a new window with a preview of the questionnaire. Next, the header attributes of the questionnaire, such as level, description, etc., are shown.
A little further down the screen is divided into two parts, on the left the questions of the questionnaire and on the right a view of tabs to add and define the various elements of a questionnaire: Questions, Sections, Pages and Questions (in the tools tab ) and Score Ranges.
Preview: Clicking on the eye icon next to the name of the questionnaire opens a new window with a preview of the questionnaire. This window will show the questionnaire as a candidate would see it when executing the questionnaire. The previews generate a questionnaire instance, so if they are answered, it is possible to see the instance in the results reports. At the end of the questionnaire in preview mode the user will be asked if he wants to save the instance or delete it. If you save it, you can see the results report in the list of questionnaire instances, which can be useful to better understand the information that the report shows. In case of closing the window before finishing, the instance is saved, but it will be automatically deleted the next day (or you can delete it manually from any list report of questionnaire instances). Avoid opening more than one preview at the same time, as this may produce unexpected results.
Add or remove questions: To add questions to the questionnaire you must go to the question tab, which will list all available questions. By default only the questions of the family and sub family of the questionnaire are shown, but you can change the filters to see other types of questions. To add a question, just click on the question you want to add and drag it to the list of questions on the left. The order of the list determines the order in which the questions will appear in the questionnaire (it is possible to drag questions from the list of selected questions to the position that you want the question to have within the questionnaire).
To remove a question you must drag it back from the list of selected to the list of questions. For a preview of a particular question, click on the eye icon of the question, which will show how that particular question looks when running the questionnaire. If you have editing privileges on a particular question, you will see a pencil icon on it, which allows you to go to the question edit view (notice what if you edit a question, this change will affect all the questionnaires that have that question including, not only the questionnaire that is currently working)
It is possible to edit the score and time of a question only for the current questionnaire. For this click on the gear icon. Two fields will appear to edit the score and time. Note that the time does not affect the questionnaire, this value is only referential to estimate an approximate time for the entire questionnaire.
Below the list of selected questions there are several totals that show summarized information.
Add or remove sections: All questionnaires must have at least one section (but may have more). The sections allow to group questions within a questionnaire allowing to describe the subject of the questions that compose it. For example, a proficiency questionnaire could have a numerical reasoning section and a verbal reasoning section. The information of the section will be displayed at the beginning of this lastyou the execution of the questionnaire. The sections have an attribute called “Additional Information”. The additional information is a text that is displayed during the execution of the questionnaire by clicking on a button for this purpose located in the upper right corner of the questionnaire. The questions may also have additional information and if they did not have it, clicking on the information button would show the additional information of the section (if any). To add a section, drag it to the list of selected questions from the sections tab (or the opposite operation to remove a section of the questionnaire). Pagination: By default all the questions appear one per page, however, it is possible to group several questions inside from the same page (what is recommended for short questions). To group several questions on a single page, go to the “Tools” tab and click on “+ Add Page”. Once this is done, 2 bands will appear to mark the start and end of a page. Drag the start band and place it above the question that would be the first question on that page and to mark the last question on the page drag the end-of-page band below it. All questions within the start and end bands will appear on a single page when the questionnaire is run. To undo a page you can drag back the bands or click on the “x” that they have on the right to eliminate them. Note that it is not possible to place sections within a page. Random Questions: Random questions allow to group a set of questions of which only one will be shown during the execution of the questionnaire at random. This is ideal to generate variations of the same questionnaire, being important to ensure that the random questions are equivalent in difficulty and score to maintain the consistency of the questionnaire. To use the random questions function, go to “Tools” and click on “+ Add Random”. You can group a set of questions by dragging the bands that appear, in a similar way as was done with paging, dragging these bands to the question section to indicate the start and end of the group. When the questionnaire is executed, only one of the group’s questions will be displayed randomly. Score Ranges: The scoring ranges allow a questionnaire to be graded according to the score obtained, determining a description for each value of the rank. For example, a score of 1 to 5 can be qualified as “Low Knowledge” and 5 to 10 as “Medium Knowledge”. For each range, a short description and a longer one with more detail on how to interpret the score are specified. The ranges can be applied in two levels: Questionnaire or Category. If a rank is applied at the questionnaire level, it will use the total score of the questionnaire to determine the descriptions, while if it is applied by categories, the rank will be determined by the score obtained by the category to which the rank was assigned ( usually if you are going to use ranges by category you have to define a range for each category that the questionnaire uses) To add or edit a range to the questionnaire, use the “Score Ranges” tab. This tab allows you to select a range or view the range used. It is also possible to edit the score range by clicking on the “Score Ranges” link in blue. Keep in mind that it is possible that several questionnaires share the same rank, so if you modify a range, it could affect multiple questionnaires. To use ranges by category you must go to the “Rating by Category” tab. For more information on what the categories are and how they work see “Categories” Here you can see a tab for each category for which a range was defined (or no tab if the questionnaire does not have ranges by category). To select a range for a category that does not yet have a tab, click on the link “Set of Rating Ranges by Category” in blue. This will open a window where you can link a rank to a category by clicking on the “+ New” button. The same link can be used to edit the categories and ranges already defined for the questionnaire. Finally, you can also edit the values of the ranges for a category. For this, within the particular tab of the category, click on the blue link of “Rankings by Score” and remember that a range can be used by multiple questionnaires or categories and a change can affect all questionnaires that use that range .Cloning: The clone button allows you to generate a copy of the questionnaire. By doing this a new questionnaire will be created equal to the original. This function allows for example to clone a public questionnaire for which you do not have editing permission so as to have a copy that you can modify (take into accountnta that if you want to modify questions for which you do not have access to editing would require cloning the questions individually, since the questions are not cloned by cloning the questionnaire, the questionnaire cloned reference the same questions as the original) Record: The button save will store all the changes in the Evalart database. In order for the preview to show the questionnaire, you must first click on record, since the preview only shows information already saved. If the questionnaire you are trying to save has been used previously, a message will ask if you want to generate a new version. See the following point to determine which option to choose. Questionnaire versions: The questionnaires have versions. A new version can be generated by saving a questionnaire. The versions allow modifying a questionnaire without affecting questionnaire instances already generated. For example, if you used a questionnaire for a while and want to change one of the questions because it is perhaps already well known, you can make the change in the constructor and when recording, choose the option to generate a new version. In this way, any instance of previous or pending questionnaire will not be affected. Keep in mind that, if the change on the questionnaire is not minor, as if the maximum score or the number of questions is modified, it may be better to clone it. The version number is an internal and non-sequential number for a questionnaire, so it is normal to see versions that skip numbering.