Validating a concept inventory for measuring students’ probabilistic reasoning: The case of reasoning within the context of a raffle

Assessing students’ conceptions related to independence of events and determining probabilities from a sample space has been the focus of research in probability education for over 40 years. While we know a lot from past studies about predictable ways students may reason with well-known tasks, developing a diagnostic assessment that can be used by teachers to inform instruction demands the use of familiar and unfamiliar contexts. This paper presents the current work of a research team whose aim is to create a formative concept inventory with strong evidence of validity that uses a psychometric model to confidently predict whether a student exhibits one or more misconception across many items. We illustrate this process in this paper using a particular item with a context of a raffle aimed to measure whether a student reasons with misconceptions related to independence or equiprobability. The results of two aspects of the validity process: cognitive interviews to assess response processes on individual items, and a large-scale administration to examine internal structure of the concept inventory revealed difficulties in assessing students’ reasoning about these key probability concepts and trends in the prevalence of misconceptions across grades. Results can provide guidance for others aiming to develop assessments in mathematics education and also support further possibilities for research into understanding students’ reasoning about independence and sample space.     

United States teachers’ views of effective mathematics teaching and learning

This study investigates US teachers’ cultural beliefs concerning effective mathematics teaching using semi-structured interviews with 11 experienced teachers. For US teachers, effective teaching is student-centered. Cognitively appropriate mathematical content should be understood through many hands-on activities that allow students to explore by themselves the relationship between mathematical knowledge and their life experiences. Correspondingly, the US teachers view an effective teacher as a facilitator who is sensitive to student social and cognitive needs and is skillful at organizing collaborative learning. The result of this study helps researchers and educators understand the student-centered learning model in US classrooms.     

Development and validation of a 21st Century Skills Assessment: Using an iterative multimethod approach

In response to the call for more rigorously validated educational assessments, this study used an iterative multimethod validation process to develop and validate outcomes from the 21st Century Skills Assessment global rating scale. Qualitative and quantitative data sources were used to inform four types of validity evidence: content, response process, internal structure, and consequential. STEM experts and typical assessment users provided support for content, response process, and consequential validity evidence through focus group interviews and cognitive interviews. Psychometric findings suggest strong internal validity evidence for the assessment through high measures of internal consistency reliability, intra‐rater agreement, and test–retest reliability measures.     

Expanding Notions of “Learning Trajectories” in Mathematics Education

Over the past 20 years learning trajectories and learning progressions have gained prominence in mathematics and science education research. However, use of these representations ranges widely in breadth and depth, often depending on from what discipline they emerge and the type of learning they intend to characterize. Learning trajectories research has spanned from studies of individual student learning of a single concept to trajectories covering a full set of content standards across grade bands. In this article, we discuss important theoretical assumptions that implicitly guide the development and use of learning trajectories and progressions in mathematics education. We argue that diverse theoretical conceptualizations of what it means for a student to “learn” mathematics necessarily both constrains and amplifies what a particular learning trajectory can capture about the development of students’ knowledge.     

Teaching methods comparison in a large calculus class

We report findings from a classroom experiment in which each of two sections of the same Calculus 1 course at a North American research-focused university were subject to an “intervention” week, each for a different topic, during which a less-experienced instructor encouraged a much higher level of student engagement, promoted active learning (answering “clicker” questions, small-group discussions, worksheets) during a significant portion of class time and built on assigned pre-class tasks. The lesson content and analysis of the assessments were informed by existing research on student learning of mathematics and student interviews, though the interventions and assessments were also intended to be compatible with typical course practices in an attempt to appeal to practitioners less familiar with the literature. Our study provides an example of active learning pedagogy (including materials and assessment used) for students at this level of mathematics in a classroom of over one hundred students, and we report improved student performance—on conceptual items in particular—with a switching replication in that each section outperformed the other on the topic for which it received the intervention.     

Mathematics teaching practices with technology that support conceptual understanding for Latino/a students

We analyze how three seventh grade mathematics teachers from a majority Latino/a, linguistically diverse region of Texas taught the same lesson on interpreting graphs of motion as part of the Scaling Up SimCalc study (Roschelle et al., 2010). The students of two of the teachers made strong learning gains as measured by a curriculum-aligned assessment, while the students of the third teacher were less successful. To investigate these different outcomes, we compare the teaching practices in each classroom, focusing on the teachers’ use of class time and instructional format, their use of mathematical discourse practices in whole-class discussions, and their responses to student contributions. We show that the more successful teachers allowed time for students to use the curriculum and software and discuss it with peers, that they used formal mathematical discourse along with less formal language, and that they responded to student errors using higher-level moves. We conclude by discussing implications for teachers and mathematics educators, with special attention to issues related to the mathematics education of Latinos/as.     

Inspecting the foundations of claims about cognitive demand and student learning: A citation analysis of Stein and Lane (1996)

Educational research communities bear responsibility for establishing a substantial body of evidence to support claims that drive the field. For example, one commonly accepted claim is that there is a relationship between the cognitive demand of mathematical task enactments and students’ learning. One study that is often cited in association with this claim is Stein and Lane (1996), and in 44% of those citations, Stein and Lane (1996) is the sole reference. Citation analysis reveals that many of these claims go beyond the warrants provided by the Stein and Lane study, either by granting more confidence in the relationship than the study design allows or by phrasing the claim as a causal relationship between cognitive demand and student learning. A few other studies are occasionally cited in conjunction with Stein and Lane (1996) and are summarized in this article, but there remains a need for replication studies to provide better empirical support for claims about cognitive demand and student learning and to refine our shared understanding.     

Service Learning Within a Secondary Math and Science Teacher Education Program: Preservice MAT Teachers’ Perspectives

Previous literature suggests that service learning may offer new opportunities to support the development of preservice science and math teachers, but few studies examine service learning beyond isolated teaching events. In this qualitative study, we attempt to improve upon this literature by following Master of Arts in Teaching (MAT) students’ views of their service learning experiences throughout their MAT program and first two years teaching. Data sources included audiotaped individual interviews, focus group field notes, and surveys with seven preservice teachers over a three‐year period. Three major findings emerged from the data analysis. First, participants identified characteristics of service learning teaching events that made them particularly useful, and these included the timing of events, targeted grade level, exposure to high‐needs contexts, and opportunities to practice pedagogical skills. Second, participation in the service learning events improved preservice teachers’ confidence and comfort teaching in high‐needs contexts, but several concerns and deficit perspectives about teaching in high‐needs contexts remained. Third, participants indicated specific ways that the service learning teaching events impacted their readiness to teach in high‐needs contexts. These findings may inform other science and math teacher educators seeking to embed service learning opportunities into their programs.     

Student and Teacher Perspectives Across Mathematics and Science Classrooms: The Importance of Engaging Contexts

Substantial recent focus has been placed upon the competitiveness of American students in increasingly global economies and entrepreneurial enterprises. As concerns center on students’ educational preparedness and their efforts at continued learning, researchers acknowledge the importance of student engagement with school. In order to foster engaged learners, teachers must be able to determine and monitor their students’ levels of engagement. The current study examined the alignment of perceptions of engagement by students, teachers, and outside observers across middle and high school mathematics and science classrooms. Results indicated significant teacher‐student differences in perceptions of student cognitive engagement across mathematics and science classrooms with teachers consistently perceiving higher levels than students. Moreover, most effect sizes were moderate to large. A subsequent multi‐level analysis indicated that while teacher perceptions of student cognitive engagement were somewhat predictive of student reported cognitive engagement, academic engagement ratings by outside observers were not.     

Teaching and learning of mathematics: what really matters to teachers and students?

The learner’s perspective study, motivated by a strong belief that the characterization of the practices of mathematics classrooms must attend to learner practice with at least the same priority as that accorded to teacher practice, is a comprehensive study that adopts a complementary accounts methodology to negotiate meanings in classrooms. In Singapore, three mathematics teachers recognized for their locally defined ‘teaching competence’ participated in the study. The comprehensive sets of data from the three classrooms have been used to explore several premises related to the teaching and learning of mathematics. In this paper the student interview data and the teacher interview data were examined to ascertain what do students attach importance to and what do teachers attach importance to in a mathematics lesson? The findings of the student interview data showed that they attached importance to several sub-aspects of the three main aspects, i.e., exposition, seatwork and review and feedback of their teachers’ pedagogical practices. The findings of the teacher interview data showed that they attached importance to student’s self assessment, teacher’s demonstration of procedures, review of prior knowledge and close monitoring of their student’s progress in learning and detailed feedback of their work. It was also found that teachers and students did attach importance to some common lesson events.     

A Learning Progression for Elementary Students’ Functional Thinking

In this article we advance characterizations of and supports for elementary students’ progress in generalizing and representing functional relationships as part of a comprehensive approach to early algebra. Our learning progressions approach to early algebra research involves the coordination of a curricular framework and progression, an instructional sequence, written assessments, and levels of sophistication describing students’ algebraic thinking. After detailing this approach, we focus on what we have learned about the development of students’ abilities to generalize and represent functional relationships in a grades 3–5 early algebra intervention by sharing the levels of responses we observed in students’ written work over time. We found that the sophistication of students’ responses increased over the course of the intervention from recursive patterning to correspondence and in some cases covariation relationships between variables. Students’ responses at times differed by the particular tasks that were posed. We discuss implications for research and practice.     

From “You have to have three numbers and a plus sign” to “It’s the exact same thing”: K–1 students learn to think relationally about equations

This research shares progressions in thinking about equations and the equal sign observed in ten students who took part in an early algebra classroom intervention across Kindergarten and first grade. We report on data from task-based interviews conducted prior to the intervention and at the conclusion of each school year that elicited students’ interpretations of the equal sign and equations of various forms. We found at the beginning of the intervention that most students viewed the equal sign as an operational symbol and did not accept many equations forms as valid. By the end of first grade, almost all students described the symbol as indicating the equivalence of two amounts and were much more successful interpreting and working with equations in a variety of forms. The progressions we observed align with those of other researchers and provide evidence that very young students can learn to reason flexibly about equations.     

Differentiation of teaching and learning mathematics: an action research study in tertiary education

Diversity and differentiation within our classrooms, at all levels of education, is nowadays a fact. It has been one of the biggest challenges for educators to respond to the needs of all students in such a mixed-ability classroom. Teachers’ inability to deal with students with different levels of readiness in a different way leads to school failure and all the negative outcomes that come with it. Differentiation of teaching and learning helps addressing this problem by respecting the different levels that exist in the classroom, and by responding to the needs of each learner. This article presents an action research study where a team of mathematics instructors and an expert in curriculum development developed and implemented a differentiated instruction learning environment in a first-year engineering calculus class at a university in Cyprus. This study provides evidence that differentiated instruction has a positive effect on student engagement and motivation and improves students’ understanding of difficult calculus concepts.     

Capturing and characterizing students’ strategic algebraic reasoning through cognitively demanding tasks with focus on representations

In mathematics education, it is important to assess valued practices such as problem solving and communication. Yet, often we assess students based on correct solutions over their problem solving strategies—strategies that can uncover important mathematical understanding. In this article, we first present a framework of competencies required for strategic reasoning to solve cognitively demanding algebra tasks and assessment tools to capture evidence of these competencies. Then, we qualitatively describe characteristics of student reasoning for various performance levels (low, medium, and high) of eighth-grade students, focusing on generating and interpreting algebraic representations. We argue this analysis allows a more comprehensive and complex perspective of student understanding. Our findings lay groundwork to investigate the continuum of algebraic understanding, and may help educators identify specific areas of students’ strength and weakness when solving cognitively demanding tasks.     

Undergraduate students’ initial conceptions of factorials

Counting problems offer rich opportunities for students to engage in mathematical thinking, but they can be difficult for students to solve. In this paper, we present a study that examines student thinking about one concept within counting, factorials, which are a key aspect of many combinatorial ideas. In an effort to better understand students’ conceptions of factorials, we conducted interviews with 20 undergraduate students. We present a key distinction between computational versus combinatorial conceptions, and we explore three aspects of data that shed light on students’ conceptions (their initial characterizations, their definitions of 0!, and their responses to Likert-response questions). We present implications this may have for mathematics educators both within and separate from combinatorics.     

Conceptual mis(understandings) of beginning undergraduates

In order to understand a set of mathematical skills of some importance to beginning undergraduates in engineering and mathematics, a taxonomy of three levels in increasing order of mathematical demand is proposed. The construction of a test instrument is discussed relating its purpose to the concerns of the preparation of students voiced by such as Anderson et al., to underlying theories of learning, Slavit, and to other taxonomies, Smith et al. The results of applying the questionnaire to 423 students in the period 1994–1996 is analysed and evaluated, focusing on the distributions of the distractors chosen by the students. Results suggest that the instrument is robust, that the taxonomy used is effective and raises questions that affect the teaching and learning paradigms used for mathematics pre-university and on entry to university.     

The use of cross multiplication and other mal–rules in fraction operations by pre-service teachers

Many studies show that prospective teachers often have misconceptions about fractions. In this case study, we report on some of the mal–rules used by a group of 60 prospective South African primary school teachers. The students’ written responses to two items focusing on addition and multiplication of fractions which formed part of an assessment, were analyzed. Semi-structured interviews were also used to elicit the reasoning used in the students’ calculations. Less than half of the participants completed both items correctly, and many of the other students displayed various mal–rules. To interpret the pre–service teachers’ misconceptions, we studied the rules used by the participants, and expressed them as theorems–in–action. An interesting mal–rule governing the multiplication of fractions was the widespread ‘cross multiplication’ rule which after some mutations led to other mal–rules, illustrating how students’ misconceptions can persist many years after their initial learning.