Assessment in just-in-time teaching connotes many ideas. JiTT assignments are themselves a type of
formative assessment. They provide students frequent opportunities to consider their understanding of the material, and they provide faculty a regular sightline into their students' progress towards
deeper learning. Successful implementation of JiTT leads to cognitive gains, ranging from moderate to quite significant. Success depends critically on the teacher and students' total buy-in. If students see the on-line assignments merely as an add-on to the course, to be completed perfunctorily in the shortest time possible and then discussed briefly at the beginning of class, before the "real" lecture, they will resent the extra work and will not get any additional benefit from JiTT. Teachers using JiTT report a spectrum of results, ranging from significant affective and cognitive gains to very negative student reactions, disillusionment, and sometimes a regression in learning gains. An example of successful JiTT comes from a five-semester study at
North Georgia College & State University. This study analyzed responses from four
force concept inventory (FCI) questions (the distractors as well as the correct answers) for evidence of students reaching the transition threshold from "common sense thinking to Newtonian thinking", a well-defined notion in
physics education. Sixty-one percent of the students in the JiTT class reached the threshold, compared to only seven percent in the traditionally taught class. Marrs reported similar gains on pre-post assessment in biology, using the Hake metric, defined as (posttest% – pretest%)/(100% – pretest%). With traditional lecture-based pedagogy the gain was 16.7%; the gain jumped to 52.3% with JiTT and to 63.6% with collaborative learning. Since the introduction of JiTT at the
US Air Force Academy, the final exam questions in the introductory
physics sequence have shifted significantly towards conceptual probing for deeper understanding. Analyzing carefully kept records from the pre-JiTT early 1990s until the present, one finds that despite the increasingly more challenging questions, the scores have held steady and even improved in some semesters. When JiTT was introduced in introductory
physics at
IUPUI in 1996 course attendance increased from under 50% to over 80%. Instructors in other disciplines have reported similar results. Better attendance inevitably leads to fewer students dropping the class and an overall rise in grades. In JiTT
Physics and in
Biology courses at
IUPUI the D/F/W numbers decreased from 40% to under 25%. JiTT can make a difference in student study skills. Students in Marrs'
biology class credit JiTT to a significant decrease in
cramming for tests. She asked her students "Did you put off studying for Biotech 540 and as a result 'cram' for Biotech 540 tests?" to her graduate students, and 34% answered yes. However, 62% of the class answered in affirmative to the question "Do you 'cram' for other courses that you have this semester?" Gavrin reported that 80% of the students in his JiTT class responded "yes" to "Do the JiTT exercises help you to be well prepared for lecture?" versus 21% affirmative to the same question in "other classes". He found a 58% vs. 18% split on "staying focused", a 59% vs. 18% split on "feeling like an active participant", and a 71% vs. 21% split on "finding classroom time useful". When trying to assess the efficacy of any pedagogical strategy, it is important to appreciate that the choice and implementation of a particular teaching method will affect student and faculty attitudes and motivation as well as learning outcomes. In her use of JiTT at
Penn State Brandywine, Laura Guertin has noticed strongly positive reactions from her students: I see my students working weekly through open-ended questions that require higher-order cognitive skills. I saw students working together in class, gaining additional practice with quantitative, communication, and management skills. I see my students using the vocabulary of the discipline as they work through JiTT exercises and discuss JiTT responses in class. I see students connecting ideas across the course and across their lives (Guertin, 2010). == See also ==