"Tips for creating e-learning questions.
The question development process for e-Learning is generally used to check the level of knowledge acquisition and achievement. The main purpose is to check the level of understanding of the learning content, and it is desirable to select questions based on this purpose. However, this task is quite difficult. When implementing e-learning, it is not enough to understand only the learning content that is the "correct answer" to a question. In this article, I would like to explain how to effectively and efficiently create an e-learning program that anyone can easily create. The key to success in e-learning education is to provide students with both "good learning materials" and "good tests. Please take a look at this page for more information. What are "good" questions and tests in e-Learning? 2. First of all, learning materials! The process of creating learning materials for e-Learning 3! Summary 1. What are "good" questions and tests in e-Learning? The purpose of the e-Learning program is clear. Without a clear purpose, it is impossible to start considering question specifications and creating questions and explanations. If you start the production process with unclear objectives, there is a high possibility of rework during the production process. It may cause delays in the question creation schedule, increase production costs, and even result in unintended and unrelated questions. The start of anything is crucial. To avoid regrets during the creation process, start by thinking clearly about "What is the objective? to avoid regrets during the process of creation. The second condition is that the test questions have validity and reliability. The second condition is that the test questions must be valid and reliable. The purpose of the test is to question students about what they have learned through the course material and to measure their understanding of the material. Do not use concepts or ideas that are outside the scope of study for reasons that make it easier to create questions. This will cause confusion and increase the number of questions. When creating stress-free test questions, it is important to put yourself in the learner's shoes. For example, a student who is asked a question about something he or she has not learned will be confused and say, "I have not learned this! They will be confused and think, "I didn't learn this! Even if the questions are within the scope of what they have learned, the content of the questions may cause unnecessary stress to the learner. Start with easy problems and gradually increase the difficulty level. The more problems they cannot solve, the less motivation they will have to learn, and the more they will stop working on the assignment itself. *Test questions should only ask clear and straightforward questions about what has been learned. Make more use of phrased "asserted sentences" when creating questions that are easy to understand the intent of the question. Sentences that are wordy or double negative may lead to misunderstanding or misinterpretation. Use images and video materials. If you find yourself writing long sentences that lack coherence, take the plunge and use images and videos as much as possible. First, the learning materials! Flow of creating e-learning materials Analysis Consider the information necessary for creating learning materials, such as "What is the purpose of creating learning materials and who will be the target audience," "How much time will be set aside for learning and where will the goal be set," and "How will the system be used? ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ Development Based on the design image diagram, we actually create teaching materials. The completed teaching materials are reviewed by a third party to ensure that the content is easy to understand and use, and revisions and creation proceed. ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ ↓ Evaluation ↓ After a certain period of time, we will analyze whether we have achieved our initial objectives by understanding learner trends based on learner course history and survey results. This information will be useful data when reviewing the educational content. 3. After creating educational materials, create questions and tests! Let's review the specific flow of "creating questions and tests" in e-Learning. Basically, questions are created according to the following flow. Decide what to measure and by what standard The main purpose is to "check the level of understanding of the test content," but the breadth and depth of that understanding will depend on the purpose of the learning material paired with the test. The breadth and depth of understanding will vary depending on the purpose of the learning material paired with the test. ▼ What is the purpose of the study material paired with the test? What is the purpose of the test based on the learning materials? ▼ What are the criteria for measuring the level of student understanding? Once the objectives of the questions have been established, the test specifications necessary to achieve those objectives should be considered. The main specifications to consider include the following. ▼ Types of Tests There are several types of test formats. Select the most appropriate type according to your objectives. Pre-test: A test to measure the learner's current ability. Post-test: A test that measures the learner's knowledge gain by comparing it to the results of the pre-test. Confirmation test: A test designed to measure the learner's understanding of each unit of study. Completion test: A test that measures the learner's comprehension of the entire course of study and certifies completion of the course when a set standard score is achieved. Test format: The most commonly used formats are "multiple-choice," "multiple-answer," and "X-X" format. If you want to measure students' understanding more strictly, it is better to choose "multiple-choice" rather than "single-choice" or "multiple-choice" rather than "multiple-question" format. To further increase the difficulty level of the test, "Randomized" questions are available. This means that the order in which the questions are presented changes each time the test is administered. There is also "Choice Shuffle," which changes the order of the choices. There is also the "Writing" method, in which the test taker is asked to write down the answers in writing. It is important to understand that this writing style is difficult to grade after the test is administered. Difficulty level "X-X type" "Multiple Choice type" "Multiple Choice type" ▼Necessity of explanations You must decide whether or not to provide explanations after the test is graded. For questions that simply ask about the content of the study material, explanations are not required. This is because, if the score is below the passing standard, it would be more effective for the student to study the question again before taking the confirmation test. In the case of practice-type questions, explanations are generally provided. This is because practice-type questions are application questions that incorporate the knowledge learned in the study materials, and it is sometimes difficult to understand why the answers are given. The explanations are effective in helping students acquire an applied way of thinking. ➡In this case, the test is not merely a "measurement" but contains an element of "learning" in itself. ▼Passing Criteria While it is common to set passing criteria for tests, these criteria should be adjusted according to the content and learning objectives. In some cases, as in the example below, a score of 100% may be required. 70% if you want all learners to acquire the minimum required knowledge 80% if a certain standard is met, 100% if a perfect response is required, etc. Prepare the manuscript according to the question specifications ▼ Uniformity of Question Specifications Try to unify the specifications of the question texts as much as possible. Multiple specifications may cause stress to learners and make it difficult for them to concentrate on answering the questions. The test draft should be written in "です・ます" or "da・ある" style. Care should be taken not to mix the two tones in one sentence. Again, this can cause unnecessary stress to the learner. Actual Creation Using the Question Creation Tool Once the manuscript is complete, we will actually create the questions. Here is a brief explanation of the creation process using our question creation tool, Quiz Generator. First, create a manuscript that conforms to the file format to be imported into the creation tool. Below is part of the Excel/text file screen used to import a test manuscript into our teaching material creation tool. The image of the teaching material created by importing this file (manuscript) into the tool is shown below. Sample questions ➡Sample questions created with our tool * As you can see, once the file (manuscript) compatible with the question creation tool is created, questions and tests can be created in a short period of time (a few minutes). It also facilitates the revision process. Click here for detailed work procedures ➡Create questions in a text file ➡Create questions in Excel Analyze test results and make improvements Although the created teaching materials are loaded onto the LMS for operation, there is no point in just creating them. It is important to analyze the results of the test and create the next measures based on the results of the learner survey, or to improve the test itself. The points of analysis include the following ➡Continuous implementation of such analysis and improvement will improve the quality of the test, as well as the quality of education and training using e-learning, and lead to higher learner satisfaction. This will lead to higher learner satisfaction. In this report, we have discussed the creation of questions using e-learning. Did you discover anything new? Let's take a brief look back. What is the purpose of e-learning? What is the purpose of e-learning? Let's understand the process of creating e-learning materials. After creating the materials, let's create questions and tests. How to use question creation tools to improve efficiency. Analyze the test results and make improvements. Finally, testing is not the end of the process. Test results and learner feedback (evaluations) need to be analyzed and linked to the next measure or test improvement. For this reason, the person in charge of test creation must be familiar with the contents of the learning materials. Creating a test is a difficult task, but it is not that difficult if the objectives are clearly defined and procedures are followed. We encourage you to try your hand at creating questions using this article as a guide.