| Abstract: | The purpose of this study was to measure changes in students' science proficiency produced by a multimedia learning environment, Astronomy Village: Investigating the Solar System, developed at Wheeling Jesuit University's Center for Educational Technologies with funding from the National Science Foundation. The inquiry‐based design of Astronomy Village supports middle school students in learning fundamental concepts in life, earth, and physical science. Astronomy Village was compared to an alternative treatment that simulated elements of traditional science instruction using web site access to background materials and content in Astronomy Village. The results indicate sizable treatment effects for two groups of Astronomy Village students, as well as for the alternative treatment group. Differences in the treatment effect sizes among the three treatment groups reveal the relative merits of different approaches to using technology. The Linear Logistic Model for Change applied in this study is beneficial for comparing alternative uses of technology, since it separates effects due to treatments from natural trend effects and eliminates drawbacks of traditional statistical designs for pretest‐posttest changes. |
