This article and podcast highlight why human observation and traditional paper-and-pencil progress monitoring tasks remain essential for accurately evaluating a student's mathematical abilities. While digital tools efficiently track correct and incorrect answers, they often fail to capture the cognitive processes, such as hesitation or self-correction, that reveal a child's true level of understanding. By watching a student work through a problem manually, an educator can perform an error-pattern analysis to distinguish between simple careless mistakes and fundamental gaps in place-value or logic. The source argues that effective instruction requires moving beyond a single percentage or score to understand the specific strategies a child employs. Ultimately, the author suggests a balanced approach where technology serves as a broad screener, but one-on-one diagnostic sessions guide the actual teaching plan. This method ensures that educators identify the next learnable step for each individual student rather than relying on automated data.
The Child Behind the Score: Why Paper-and-Pencil Math Assessment Still Matters
A mathematics score is not the same thing as mathematical understanding.
As a special education teacher, one of the most valuable parts of sitting down one-on-one with a child and administering an assessment is that you are not simply collecting right answers and wrong answers. You are watching a human being think.
You can see the pause before the answer. You can see the child count on their fingers. You can see that they understood the addition but lost track of place value. You can see that they correctly set up three steps of a subtraction problem and then made one borrowing—or regrouping—error. You can see tally marks, number lines, drawings, invented strategies, self-corrections, hesitation, confidence, frustration, and breakthroughs.
An online assessment may record:
Incorrect.
A skilled teacher watching the child may see:
This student understands the operation. The student understands most of the algorithm. The breakdown occurs specifically when crossing a zero during regrouping.
Those are not remotely the same piece of information.
The central argument of this post is simple:
Assessment should not merely tell us whether an answer is correct. It should help us understand how the child got there—and what to teach next.
The Child Behind the Score
Why Paper-and-Pencil Math Assessment—and a Skilled Human Observer—Still Matter
By Sean David Taylor, M.Ed. | Reading Sage
There is a fundamental problem with much of modern mathematics assessment:
We are collecting answers, but too often we are losing the child.
A student sits in front of a computer. A question appears. The student clicks an answer.
At the end, the software produces a score, perhaps a percentile, a proficiency band, a grade-level equivalent, or a colorful dashboard.
But what happened between the question and the answer?
That is where the real educational information lives.
As a special education teacher, one of the greatest advantages of administering an assessment face-to-face—whether using an instrument such as the BRIGANCE assessment system or a carefully constructed curriculum-based math probe—is that you can actually watch the child think.
You see the strategy.
You see the hesitation.
You see the false start.
You see the self-correction.
You see the child who gets the final answer wrong but demonstrates 90% of the underlying skill correctly.
And sometimes you see something even more important:
The child is much smarter mathematically than the score suggests.
Research on math curriculum-based measurement supports looking beyond a single total score. Error-pattern analysis combined with computation probes can help pinpoint specific difficulties and inform individualized instruction. (Sage Journals)
That is the difference between testing mathematics and diagnosing mathematical learning.
A Wrong Answer Is Not a Diagnosis
Consider this problem:
43
A student writes:
43
An online assessment sees:
❌ Incorrect.
A skilled teacher sees a diagnostic puzzle.
The teacher asks:
Did the student understand that subtraction means finding the difference?
Did the student correctly subtract 8 from 3 but fail to regroup?
Did the student know that 43 is four tens and three ones?
Does the student understand exchanging one ten for ten ones?
Did the student simply reverse the digits?
Did the student make a copying error?
Did the student know the procedure but lose track because of working-memory demands?
Can the student solve the same problem with base-ten blocks?
Can the student explain what happens when we regroup?
Those questions matter because different errors require different instruction.
The score alone cannot tell you whether the student needs:
More subtraction facts.
Place-value instruction.
Concrete manipulatives.
Explicit instruction in regrouping.
A visual model.
Practice aligning numbers.
Working-memory supports.
Or simply a reminder to slow down and check work.
A computer may tell you that the answer is wrong.
A trained teacher can begin discovering why.
The Missing Data: What Happens Between the Question and the Answer?
When I sit beside a student administering a mathematics assessment, I am not just scoring responses.
I am conducting a kind of educational observation of cognition.
I am watching for the invisible processes that created the answer.
The student's paper becomes evidence.
Their markings become evidence.
Their pauses become evidence.
Their self-talk becomes evidence.
Their corrections become evidence.
Their use of fingers, tally marks, drawings, number lines, manipulatives, and invented strategies becomes evidence.
The answer is only the final product.
The process is the diagnostic gold.
Paper-and-Pencil Assessment Gives Us a Window Into Thinking
Paper-and-pencil assessment has a tremendous advantage:
The child leaves a trail.
That trail may include:
Crossed-out answers.
Erasures.
Tally marks.
Finger counting.
Number lines.
Drawings.
Dots.
Groupings.
Base-ten representations.
Partial calculations.
Regrouping marks.
Incorrectly aligned digits.
Repeated addition.
Skip counting.
Counting backward.
Decomposing numbers.
Compensation strategies.
Self-corrections.
Imagine two students who both score 8 out of 10.
Student A
Answers quickly.
Makes two careless mistakes.
Shows automaticity with math facts.
Corrects one answer independently.
Student B
Counts every fact from one.
Uses fingers for 8 + 7.
Does not recognize combinations that make ten.
Makes errors when regrouping.
Writes numbers inconsistently in columns.
Both students receive:
8/10
But they do not have the same instructional needs.
A percentage score can hide radically different mathematical profiles.
Even the Mode of Assessment Can Matter
The issue is not simply nostalgia for paper.
Research comparing paper-based and computerized math curriculum-based measures has found that students may perform differently depending on the mode of administration. One study of upper-elementary students found higher fluency rates on paper probes than on computer versions, while additional studies comparing paper, tablet/stylus, and keyboard conditions also found that many students performed better with traditional paper-and-pencil probes. (PubMed)
That does not mean technology is useless.
It means something much more important:
We should not automatically assume that a score obtained through one mode of assessment is identical to a score obtained through another.
The assessment method itself can affect performance.
And when a child struggles with:
Keyboarding,
Navigating a screen,
Attention,
Working memory,
Fine motor demands,
Reading directions independently,
Or the unfamiliarity of the testing environment,
the assessment may begin measuring more than mathematics.
What BRIGANCE Gets Right: Start Broad, Then Go Deeper
This is one of the reasons inventories such as BRIGANCE have long been useful in special education.
The BRIGANCE Comprehensive Inventory of Basic Skills II includes mathematics assessment alongside reading and language arts, while BRIGANCE's criterion-referenced inventories are designed to help identify present levels and monitor incremental growth over time. (Curriculum Associates)
The power of this approach is not simply the score.
It is the movement from:
Screening → Baseline → Skill Analysis → Instruction → Progress Monitoring
Think of it as a medical model—not because children are patients, but because good diagnosis precedes good intervention.
Step 1: Establish a broad baseline
What can the student do?
Where does performance begin to break down?
What skills appear solid?
What skills are emerging?
What skills are absent?
Step 2: Identify the instructional boundary
The goal is to find the point where the child moves from:
Independent
to
Emerging
to
Frustration or breakdown
That boundary is incredibly valuable.
It tells us where instruction should begin.
Not necessarily at the student's chronological grade.
Not necessarily at the lowest skill the student can perform.
But at the next learnable step.
Step 3: Dive deeper
Once a broad screener or inventory reveals a weakness, we should not stop.
A low score in "subtraction" is not enough.
We need to ask:
What kind of subtraction problem?
Can the student:
Subtract single digits?
Subtract without regrouping?
Subtract with one regrouping?
Regroup across zeros?
Subtract using expanded form?
Solve subtraction word problems?
Explain what subtraction represents?
Estimate whether an answer is reasonable?
The same principle applies to every mathematical domain.
A broad score is the map.
The diagnostic follow-up tells us where to go.
The Mathematics Assessment Observation Checklist
When sitting beside a child during a paper-and-pencil computational assessment, here is what a teacher, interventionist, special educator, tutor, or parent should be watching for.
1. Attention and Task Engagement
Observe:
Does the student begin independently?
Do they understand the directions?
Do they need directions repeated?
Do they rush?
Do they avoid difficult items?
Do they stop after encountering an error?
Do they become frustrated?
Do they persist?
Do they return to skipped problems?
Does fatigue affect performance?
A child who understands mathematics but shuts down after three difficult problems needs a different intervention from a child who does not understand the mathematics.
2. Number Identification
Ask:
Can the student identify numerals?
Do they confuse visually similar numbers?
Can they read multi-digit numbers?
Can they write dictated numbers?
Can they distinguish 16 from 61?
Can they distinguish 305 from 350?
Do they understand the value represented by zeros?
Watch for:
Digit reversals.
Transpositions.
Place-value confusion.
Omitting digits.
Adding extra digits.
3. Counting and Cardinality
Observe whether the student:
Counts orally in sequence.
Counts objects accurately.
Touches or tracks each object once.
Understands that the last number counted represents the total quantity.
Starts counting from one every time.
Can count on from a number.
Can count backward.
Can skip count.
Watch for:
Double counting.
Skipping objects.
Losing one-to-one correspondence.
Beginning over repeatedly.
Knowing the counting sequence without understanding quantity.
4. Subitizing: Can the Child See Number?
Subitizing is one of the most revealing early number-sense skills.
Show the student a small quantity briefly.
Do they instantly recognize:
●●● = 3
Or do they count:
"One… two… three."
That distinction matters.
Observe whether the student can:
Perceptually subitize small quantities.
Recognize familiar dice patterns.
Recognize ten-frame patterns.
Recognize five-and-some-more structures.
Conceptually subitize larger quantities.
For example, when shown eight dots arranged as:
4 + 4
Does the child say:
"Eight."
Or do they count every dot?
Better yet, ask:
"How did you know?"
A child who says:
"I saw four and four."
is revealing important number knowledge.
Free printable subitizing and number-sense cards are available from Little Minds at Work, and other printable assessment resources can support observation of early quantity recognition. (Teach Starter)
5. Counting Strategies
Watch carefully.
How does the student solve:
8 + 5?
Do they:
Count all?
"One, two, three, four, five, six, seven, eight… nine, ten, eleven, twelve, thirteen."
Count on?
"Eight… nine, ten, eleven, twelve, thirteen."
Use fingers?
Draw dots?
Use tally marks?
Make ten?
"8 needs 2. Take 2 from 5. That's 10 plus 3 equals 13."
Retrieve automatically?
"13."
These strategies represent different levels of mathematical development and fluency.
The answer alone does not tell you which strategy the child used.
6. Math Fact Knowledge
Do not simply mark facts:
Right / Wrong.
Look for patterns.
Addition
Which facts are automatic?
Doubles?
Doubles plus one?
Combinations of ten?
Facts involving 0?
Facts involving 1?
Facts involving 5?
Subtraction
Does the student know:
Fact families?
Missing-addend relationships?
Difference relationships?
Doubles-related facts?
Multiplication
Does the student know:
0s?
1s?
2s?
5s?
10s?
Squares?
Doubles relationships?
Commutative relationships?
For example, if the student knows:
6 × 4 = 24
but does not know:
4 × 6
they may not understand the commutative property.
That is diagnostic information.
7. Finger Counting: Don't Just Mark It Wrong
Finger counting is information.
It can tell us:
The student is relying on a concrete counting strategy.
Fact retrieval is not yet automatic.
The student may have weak number relationships.
The student may be using an effective but inefficient strategy.
But the important question is:
How is the student using their fingers?
There is a difference between a child who randomly counts fingers and a child who efficiently uses fingers to count on from the larger addend.
Again:
Observe the strategy, not just the final answer.
8. Place Value
Ask whether the child understands that:
347
is not merely three symbols.
It is:
3 hundreds + 4 tens + 7 ones.
Look for whether the student can:
Read multi-digit numbers.
Write multi-digit numbers.
Compare numbers.
Decompose numbers.
Use expanded form.
Understand the role of zero.
Identify the value of a digit.
Regroup flexibly.
A child who repeatedly makes computational errors may actually have a place-value problem disguised as a computation problem.
9. Addition Errors
When a student misses an addition problem, look for:
Fact errors.
Carrying/regrouping errors.
Failure to regroup.
Incorrect placement of the regrouped digit.
Adding instead of multiplying.
Misaligned columns.
Dropped digits.
Errors involving zero.
Failure to add the carried amount.
Carrying into the wrong column.
Reversing digits.
Also look for successful strategies.
A child may solve:
47 + 36
by thinking:
40 + 30 = 707 + 6 = 1370 + 13 = 83
That child may understand addition deeply even if they do not consistently use the traditional algorithm.
10. Subtraction and Regrouping
This is one of the richest areas for diagnostic observation.
Can the child subtract:
Single digits?
Two-digit numbers without regrouping?
Two-digit numbers with regrouping?
Three-digit numbers?
Across one zero?
Across multiple zeros?
For example:
402
This problem can reveal whether the child understands regrouping or merely memorizes a procedure.
Watch for:
"Bigger number on top" errors.
Subtracting the smaller digit from the larger digit regardless of position.
Borrowing without changing the original digit.
Regrouping from zero incorrectly.
Confusion crossing zeros.
Place-value alignment errors.
The terminology varies—many adults learned "borrowing" and "carrying," while current instruction often emphasizes regrouping, composing, and decomposing—but the mathematical question remains:
Does the child understand that one ten can be decomposed into ten ones?
11. Multiplication
Observe whether multiplication is understood as:
Repeated addition.
Equal groups.
Arrays.
Skip counting.
Scaling.
Area.
Watch for strategies such as:
6 × 7
or:
"I know 5 × 7 is 35, so one more 7 is 42."
That second strategy reveals flexible number reasoning.
Watch for:
Counting errors.
Skip-counting errors.
Place-value errors in multi-digit multiplication.
Failure to shift partial products.
Weak fact fluency.
12. Division
Observe whether the child understands:
Sharing.
Equal groups.
Repeated subtraction.
Multiplication relationships.
Remainders.
Quotients.
Watch for students who can mechanically perform long division but cannot explain:
"What does the answer mean?"
13. Problem Setup
Sometimes the mathematics is correct—but the paper is a disaster.
Observe:
Does the student align digits?
Do they write clearly enough to distinguish numbers?
Do they leave adequate space?
Do they organize multiple steps?
Do they lose track of where they are?
A child may need support in:
Graph paper.
Place-value templates.
Column guides.
Enlarged workspace.
Visual organization.
That is not necessarily a math-concept problem.
It may be an executive-function or written-organization barrier to demonstrating mathematical knowledge.
14. Self-Correction
One of the most important things an automated score can miss is:
Does the child notice their own mistake?
Observe:
Do they spontaneously correct errors?
Do they check their work?
Do they estimate?
Do they recognize an unreasonable answer?
Do they use inverse operations?
A student who says:
"Wait. That can't be right."
has demonstrated something important.
Mathematical competence is not merely getting the first answer right.
It also includes monitoring one's own thinking.
15. Mathematical Language and Explanation
Ask:
"Tell me what you were thinking."
Then listen.
Can the student explain:
Why they added?
Why they regrouped?
Why they multiplied?
What the equal sign means?
How they know the answer is reasonable?
A student may have difficulty with verbal explanation while demonstrating strong mathematical understanding, particularly if language is a barrier.
Conversely, a student may memorize vocabulary without being able to demonstrate the concept.
The teacher needs both kinds of evidence.
The Proctor's Observation Sheet
A simple observation form might include:
| What to Observe | What You Record |
|---|---|
| Problem type | Addition, subtraction, multiplication, division |
| Accuracy | Correct, incorrect, partially correct |
| Strategy | Counting, fingers, drawing, algorithm, decomposition |
| Math facts | Automatic, slow retrieval, unknown |
| Place value | Secure, emerging, weak |
| Regrouping | Independent, inconsistent, unable |
| Number alignment | Accurate, inconsistent, problematic |
| Error pattern | Describe the specific error |
| Self-correction | None, prompted, independent |
| Persistence | Continues, hesitates, avoids |
| Explanation | Can explain, partially explains, cannot explain |
| Supports | Manipulatives, number line, graph paper, verbal cue |
| Next step | Specific skill to assess or teach |
This creates something far more useful than:
Student scored 62%.
It creates a mathematical learning profile.
The 80% Problem
Suppose a child answers 8 out of 10 problems correctly.
The dashboard says:
80%
But what does 80% actually mean?
It could mean:
Student A
Eight problems were automatic. Two were careless errors.
Student B
The student solved every problem correctly until regrouping appeared.
Student C
The student understands the concept but repeatedly misaligns digits.
Student D
The student counts every answer on fingers and runs out of time.
Student E
The student made one systematic place-value error that affected multiple answers.
Student F
The student corrected two answers on paper—but the computer only captured the final response.
These children should not all receive the same intervention.
And yet a single percentage can make them appear identical.
That is the danger of becoming overly dependent on automated assessment data.
A Better Assessment Model: Three Layers of Data
The answer is not to eliminate technology.
The answer is to stop pretending that one type of assessment can do everything.
A better system uses three layers.
Layer 1: Universal Screening
Ask:
Who may be struggling?
Use efficient broad measures.
Curriculum-based measurement is commonly used for universal screening in mathematics, with computation probes measuring procedural skills and concepts-and-applications measures examining broader mathematical understanding. (Iris)
The screener gives you the first signal.
Layer 2: Diagnostic Follow-Up
Ask:
Why is the student struggling?
Now sit down with the child.
Use:
Paper-and-pencil computation.
Manipulatives.
Oral questioning.
Number-sense tasks.
Error analysis.
Observation.
Think-alouds.
This is where the teacher begins identifying the underlying problem.
Layer 3: Progress Monitoring
Ask:
Is the intervention working?
Use repeated, comparable probes.
Collect multiple data points.
Look for growth over time.
But do not merely graph the score.
Periodically look at the actual work.
A student's score may remain flat while their strategies improve dramatically.
That improvement may be the bridge to later automaticity.
Free and Low-Cost Resources for Paper-and-Pencil Math Assessment
There are fewer comprehensive standardized paper-and-pencil assessments available for free than many educators would like. But there are still useful resources for screening, progress monitoring, and diagnostic follow-up.
1. Intervention Central: Math Computation CBM
Intervention Central Math Computation CBM Guidelines
Intervention Central provides guidance for creating curriculum-based computation probes, including examples of computational objectives across addition, subtraction, multiplication, and division. It distinguishes between:
Single-skill probes, useful for examining a specific skill.
Multiple-skill probes, useful for obtaining a broader sample of computational performance.
The guidance describes timed computation probes and scoring approaches that can be used for baseline and progress monitoring. (Intervention Central)
A particularly useful approach is to create your own single-skill diagnostic sequence.
For example:
Subtraction Sequence
Single-digit subtraction.
Two-digit subtraction without regrouping.
Two-digit subtraction with regrouping.
Three-digit subtraction with regrouping.
Regrouping across one zero.
Regrouping across multiple zeros.
Subtraction word problems.
Missing-addend relationships.
When performance breaks down, you have found the next area for diagnostic investigation.
2. CBA Math Computation Probe Generator
CBA Multiple-Skill Math Probe Generator
This free online generator allows educators to create computation worksheets with different problem types.
That makes it useful for creating:
Baseline probes.
Progress-monitoring probes.
Single-skill assessments.
Mixed computation assessments.
The important caution is this:
A teacher-created probe can be extremely useful instructionally without automatically being a nationally standardized test.
Use it for what it is designed to do: observe performance, identify patterns, and monitor growth.
3. Vanderbilt IRIS: Sample Math Screening Probes
Vanderbilt IRIS Center Math Universal Screening Resource
The IRIS Center provides examples and explanations of mathematics universal screening, including computation and concepts-and-applications probes.
This is particularly useful for teachers building an MTSS or RTI assessment system.
4. Free Early Number-Sense Assessment
This printable assessment includes early mathematical skills such as:
Number identification.
Counting.
Subitizing.
Comparing quantities.
Ordering.
Basic operations.
For younger children, this type of assessment can provide a starting point for an individualized observational assessment.
5. Free Subitizing and Number-Sense Cards
Free Number Sense and Subitizing Cards
Use the cards one-on-one.
Do not simply record:
Right or wrong.
Record:
How did the child know?
Ask:
"How many?"
"How did you see it?"
"Did you count?"
"What groups did you see?"
That conversation can reveal whether the child is:
Counting every object.
Perceptually subitizing.
Conceptually subitizing.
Using five-and-some-more.
Recognizing ten-frame structure.
6. Free Beginning Addition Assessments
Pattern Press Addition 1 Evaluation
Pattern Press Addition 2 Evaluation
These printable resources focus on early addition, number relationships, visual models, and developing regrouping concepts.
They can be particularly useful as part of a broader teacher observation rather than as stand-alone high-stakes assessments.
A Free Number Sense Tool Worth Knowing About
For students in approximately third grade and above, the University of Notre Dame's Number Sense Assessment is a freely available educational resource examining areas such as magnitude, operations, representations, and mathematical equivalence. It is an online assessment rather than a paper-and-pencil diagnostic, so it should not replace observation of written work—but it can provide another data point in a balanced assessment system. (Number Sense)
University of Notre Dame Number Sense Assessment
This illustrates the point perfectly:
Technology can be useful.
But technology should contribute to the assessment picture—not become the entire picture.
What Parents Can Do at Home
Parents do not need a $500 testing system to begin learning how their child thinks mathematically.
Sit beside your child with a pencil and a few problems.
Start simple.
Do not immediately correct.
Instead, observe.
Ask:
"Tell me what you're thinking."
Give the child a problem such as:
7 + 6Then watch.
Do they:
Count from one?
Count on from seven?
Use fingers?
Know that 7 + 3 = 10 and then add 3?
Instantly retrieve 13?
Now try:
42 - 18Do they:
Understand subtraction?
Attempt regrouping?
Subtract the smaller digit from the larger digit automatically?
Know what happens to the four tens?
The goal is not to interrogate the child.
The goal is to become curious.
The mistake is not the enemy. The mistake is information.
The Assessment Conversation Matters
There is another advantage to sitting beside a student.
A skilled teacher can regulate the testing experience.
You can see when a child needs:
A short break.
A drink of water.
A reminder to slow down.
Encouragement.
Clarification of standardized directions when permitted.
A different session for diagnostic follow-up.
You can notice:
"This child knew the math for the first fifteen minutes and then cognitive fatigue took over."
That matters.
Of course, formal standardized assessments must be administered according to their prescribed procedures if scores are to be interpreted normatively. But diagnostic teaching is not the same thing as simply administering a standardized test.
After the standardized score gives you information, you can conduct additional diagnostic assessment.
That is where teaching begins.
From Assessment to Prescription
The real purpose of assessment should be:
What should we teach tomorrow?
Suppose the assessment reveals:
Student Profile
Can identify numbers through 1,000.
Understands basic place value.
Adds two-digit numbers without regrouping.
Makes systematic errors when regrouping.
Counts subtraction facts on fingers.
Does not automatically recognize combinations that make ten.
Becomes confused when subtracting across zero.
Uses drawings successfully.
Self-corrects when prompted to estimate.
That profile immediately suggests an instructional prescription.
Possible Instructional Priorities
Priority 1: Build number combinations to ten
Use:
Ten frames.
Counters.
Number bonds.
Five-and-ten structures.
Mental math games.
Priority 2: Strengthen addition and subtraction fact relationships
Teach:
Fact families.
Missing addends.
Doubles.
Near doubles.
Make-ten strategies.
Priority 3: Rebuild regrouping conceptually
Use:
Base-ten blocks.
Bundles of ten.
Expanded notation.
Concrete → pictorial → abstract instruction.
The child must understand:
43 = 4 tens + 3 ones.
And:
1 ten can be decomposed into 10 ones.
Priority 4: Move back to the written algorithm
Only after the concept is becoming secure.
Priority 5: Monitor the specific skill
Do not give a giant general math test every week.
Progress-monitor:
Regrouping accuracy.
Fact fluency.
Place-value understanding.
Use short probes.
Save the work.
Compare strategies over time.
The Most Important Data Point May Be the Error Pattern
Imagine a student takes five subtraction probes.
The student consistently makes this error:
62
The student subtracts the smaller digit from the larger digit.
That is not five random mistakes.
That is a pattern.
The intervention should address the misconception.
Likewise:
402
If the student consistently fails when regrouping across zero, that is a different instructional target.
Error-pattern analysis paired with repeated computation probes has been specifically studied as a way to identify computation difficulties and individualize instruction. (Sage Journals)
This is where special education teachers have always had an important instinct:
Do not stop at the score.
Look at the work.
The Assessment Record Should Follow the Child
Imagine if every math progress-monitoring session produced not only a score but a short observational record:
| Date | Skill | Score | Strategy | Error Pattern | Next Step |
|---|---|---|---|---|---|
| Sept. 1 | Addition facts | 12/20 | Finger counting | Counts all | Teach counting on |
| Sept. 15 | Addition facts | 16/20 | Counting on | Weak make-ten facts | Ten-frame work |
| Oct. 1 | Addition facts | 18/20 | Decomposition | Errors with 7 + 8 | Near-doubles |
| Oct. 15 | Addition facts | 20/20 | Retrieval | None | Move to subtraction relationships |
Now the assessment becomes a story.
You can actually see learning happening.
Not merely:
60 → 72 → 80 → 85
but:
Counting all → counting on → decomposing → automatic retrieval.
That is a much richer description of mathematical growth.
A Proposed Math Assessment Framework for Schools
I would argue that schools need a more balanced system.
Tier 1: Universal Screening
Use efficient broad measures to identify students who may need additional support.
Possible measures include:
Computation CBM.
Concepts-and-applications CBM.
District screeners.
Standardized achievement measures.
Tier 2: Individual Diagnostic Follow-Up
For students who show difficulty:
Sit beside the child.
Use paper and pencil.
Observe strategies.
Analyze errors.
Ask the student to explain.
Use manipulatives when appropriate.
Identify the precise skill boundary.
Tier 3: Instructional Prescription
Create a specific plan.
Not:
"Student will improve in math."
But:
"Student will use place-value models to decompose one ten into ten ones and accurately solve two-digit subtraction problems requiring one regrouping with 80% accuracy across three probes."
That is teachable.
That is observable.
That is measurable.
The Computer Should Be the Assistant, Not the Diagnostician
EdTech can do wonderful things.
It can:
Store data.
Generate reports.
Graph progress.
Adapt item difficulty.
Identify broad patterns.
Provide additional practice.
But there is a danger when we confuse data collection with understanding.
A computer can tell us:
The student missed item 14.
A teacher may discover:
The student understood item 14, correctly set up the problem, completed three steps accurately, and then made one arithmetic error because the student was counting backward incorrectly.
Those are different conclusions.
One produces a red mark.
The other produces an instructional plan.
The Child Is More Than the Dashboard
Perhaps the greatest danger of an assessment system dominated by dashboards is that children begin to disappear behind the numbers.
We see:
Percentiles.
RIT scores.
Proficiency levels.
Correct answers.
Incorrect answers.
Growth targets.
All useful information.
But we stop seeing:
The child counting on their fingers.
The child drawing six circles.
The child discovering that 8 + 2 makes 10.
The child crossing out an answer and trying again.
The child whispering, "Wait, that doesn't make sense."
The child who needs a break.
The child whose mathematical thinking is stronger than their test score.
And that is information we cannot afford to lose.
The Bottom Line
I am not arguing that we should throw away technology.
I am arguing that we should not throw away observation.
The future of assessment should not be:
Paper or technology.
It should be:
Technology + teacher judgment + direct observation + diagnostic follow-up.
Use a broad screener to identify possible concerns.
Establish a baseline.
Then sit down with the child.
Put a pencil in their hand.
Give them space to think.
Watch what they do.
Take notes.
Look for patterns.
Notice the strategies.
Study the errors.
Watch for self-correction.
Ask:
"Tell me how you got that answer."
Because sometimes the most important thing about a mathematics problem is not whether the student got the answer right.
It is understanding how the child thought their way toward the answer.
That is where assessment stops being a sorting machine.
And starts becoming a tool for teaching.
A Final Principle for Every Math Teacher, Special Educator, Interventionist, and Parent
A wrong answer is not the end of the assessment.
It is the beginning of the question: "What happened here?"
And when we sit beside the child long enough to find out, we gain something that no dashboard, percentile, or automated score can fully provide:
A window into the child's mathematical mind.
Paper-and-pencil math assessments offer several critical diagnostic benefits over online testing, moving the focus of assessment from simply recording scores to deeply understanding how a child thinks. The primary benefits highlighted in the sources include:
1. The Child Leaves a "Trail" of Thinking
On paper, the child's written work leaves an invaluable physical trail of their cognitive process. This trail may include erasures, crossed-out answers, tally marks, partial calculations, drawings, number lines, and regrouping marks. While an online test only captures the final answer, paper provides "diagnostic gold" by making the student's invisible thought process visible to a teacher or parent.
2. Identifying the "Why" Behind Mistakes
A computer test simply marks an answer correct or incorrect. However, a wrong answer is not a diagnosis. On paper, a skilled observer can perform an error-pattern analysis to pinpoint the exact root of a student's struggle. For example, a student might understand the subtraction operation and most of the algorithm but fail specifically when crossing a zero during regrouping. Identifying these specific patterns is crucial because different errors require completely different instruction—such as place-value lessons versus basic fact practice.
3. Distinguishing Radically Different Student Profiles
Online dashboards often reduce student performance to a single percentage or score, which can hide distinct learning profiles. For instance, two students might both score an 8 out of 10 (80%) on an assessment.
- Student A might answer quickly, show math fact automaticity, and make two careless errors.
- Student B might count everything from one on their fingers, lack place-value alignment, and struggle with regrouping. While an online score treats them identically, a paper-and-pencil assessment reveals that their instructional needs are entirely different.
Based on your sources, early number sense develops in a clear, cumulative sequence. Instead of treating "number sense" as a single concept, you can trace a child's mathematical growth through these five progressive stages:
1. Number Identification & Representation
Before counting objects, children must connect written numerals with their spoken names and understand value.
- Numeral Recognition: Correctly identifying individual written digits (e.g., distinguishing 6 from 9 or 16 from 61).
- Writing Dictated Numbers: Translating a spoken number into a written symbol.
- Place-Value Understanding of Zero: Recognizing that a zero holds a place and alters a number's value (e.g., distinguishing 305 from 350).
2. Counting and Cardinality
This stage moves the child from reciting numbers like a song to understanding physical quantities.
- Rote Oral Counting: Reciting the number sequence accurately from memory.
- One-to-One Correspondence: Touching or tracking each physical object exactly once as they count, without double-counting or skipping.
- Cardinality: Grasping that the final number spoken represents the total quantity of the group, rather than just being the last word said.
- Counting On and Backward: Moving away from always starting at "one" (e.g., starting at 5 and counting forward, or counting down from 10).
3. Subitizing (The Transition to "Seeing" Number)
Subitizing is the vital bridge between concrete counting and abstract arithmetic where a child instantly recognizes a quantity without counting every individual item.
- Perceptual Subitizing: Instantly recognizing very small quantities (typically 1 to 3 dots) or highly familiar arrangements like dice and ten-frames.
- Conceptual Subitizing: Instantly seeing a larger quantity by mentally decomposing it into smaller, recognizable parts (e.g., seeing 8 dots arranged as two groups of 4 and knowing it is "eight" because \(4 + 4 = 8\)).
4. Counting Strategies (The Progression of Computation)
When presented with basic addition or subtraction (like \(8 + 5\)), children naturally progress through a hierarchy of developmental strategies:
- Count All: Reconstructing both sets from scratch. To add \(8 + 5\), the child counts out 8, counts out 5, and then counts the entire pile starting from one.
- Count On: Holding the larger number in their mind and counting forward from there (e.g., saying "Eight..." and then counting on their fingers "...nine, ten, eleven, twelve, thirteen").
- Using Concrete/Visual Helpers: Using tally marks, drawings, or fingers as physical placeholders to track the count.
5. Strategic Decomposition and Automaticity
At the peak of early number sense, the child manipulates numbers mentally by identifying relationships rather than relying on rote memorization or counting.
- Derived Facts (Decomposition): Using known facts to solve unknown ones (e.g., utilizing a "Make Ten" strategy for \(8 + 5\) by thinking: "8 needs 2 to make 10. I'll take 2 from 5, leaving 3. So, \(10 + 3 = 13\)").
- Automatic Retrieval: Direct, rapid recall of math facts from memory (e.g., immediately knowing \(8 + 5 = 13\) without pausing to count or calculate).
🧩 I can compile a quick print-and-cut set of dot-pattern and ten-frame subitizing cards to help you test this progression in your next assessment.
4. Isolating Mathematical Ability from Technical Barriers
When a child takes an online assessment, the test can easily begin measuring more than mathematics. Performance on computer versions can be hindered by non-mathematical demands, such as screen navigation, keyboarding, attention, working memory, fine motor demands, or reading directions independently. Research shows that students often perform better and exhibit higher fluency on traditional paper-and-pencil probes compared to computerized math measures.
5. Capturing Self-Correction and Behavioral Cues
Sitting down with a child and a paper assessment allows an educator to observe behavioral markers of cognition that digital platforms miss, such as hesitations, self-talk, and frustration. Crucially, online tests often fail to register self-corrections; a computer only captures the final input, whereas a student's paper might show where they caught their own mistake, crossed it out, and tried a new strategy. Spontaneously correcting errors demonstrates vital self-monitoring and mathematical competence.
Ultimately, while online testing acts as a broad "sorting machine," paper assessments coupled with direct teacher observation serve as a powerful tool for diagnosing learning and planning tomorrow's instruction
To spot an "instructional boundary," you must identify the transition point where a student moves across three levels of performance:
- Independent: The skills the child can perform solidly, fluently, and automatically.
- Emerging: The skills the child is beginning to grasp but performs inconsistently, slowly, with heavy strategy use, or with prompting.
- Frustration or Breakdown: The point where the student's process completely halts, results in systematic errors, or causes them to shut down.
This boundary is the "next learnable step"—the exact sweet spot where your instruction should begin. It is not determined by the student's grade level, nor is it the absolute lowest skill they can perform.
Here is how you actively spot it:
1. Administer a Single-Skill Diagnostic Sequence
Instead of testing math concepts randomly, present problems in a progressive sequence of difficulty. For subtraction, a diagnostic sequence looks like this:
- Level 1: Single-digit subtraction
- Level 2: Two-digit subtraction without regrouping
- Level 3: Two-digit subtraction with regrouping
- Level 4: Three-digit subtraction with regrouping
- Level 5: Regrouping across a single zero
- Level 6: Regrouping across multiple zeros
2. Watch for the Shift in Strategies
As the child works through the sequence on paper, watch for changes in their cognitive behavior.
- At the Independent level, they will retrieve facts automatically or complete algorithms quickly with ease.
- At the Emerging (Boundary) level, you will see their strategy shift. They may slow down, hesitate, count on their fingers, draw tally marks, talk to themselves, or make careless errors that they spontaneously correct on paper. This shift is the boundary.
- At the Breakdown level, they will make systematic error patterns (such as always subtracting the smaller digit from the larger digit regardless of position) or shut down completely.
3. Ask "How did you know?"
The written paper gives you "diagnostic gold," but verbal explanation seals it. When a child reaches a problem where they hesitate or make an error, ask them: "Tell me what you were thinking" or "How did you get that answer?" Listening to their mathematical language will tell you if they conceptually understand the regrouping/place-value exchange or if they are simply trying to apply a memorized procedure they don't understand.
Once you pinpoint the exact step in the sequence where fluent independence transitions into emerging struggle, you have found your boundary—and your exact instructional starting point for tomorrow.
To spot an "instructional boundary," you must identify the transition point where a student moves across three levels of performance:
- Independent: The skills the child can perform solidly, fluently, and automatically.
- Emerging: The skills the child is beginning to grasp but performs inconsistently, slowly, with heavy strategy use, or with prompting.
- Frustration or Breakdown: The point where the student's process completely halts, results in systematic errors, or causes them to shut down.
This boundary is the "next learnable step"—the exact sweet spot where your instruction should begin. It is not determined by the student's grade level, nor is it the absolute lowest skill they can perform.
Here is how you actively spot it:
1. Administer a Single-Skill Diagnostic Sequence
Instead of testing math concepts randomly, present problems in a progressive sequence of difficulty. For subtraction, a diagnostic sequence looks like this:
- Level 1: Single-digit subtraction
- Level 2: Two-digit subtraction without regrouping
- Level 3: Two-digit subtraction with regrouping
- Level 4: Three-digit subtraction with regrouping
- Level 5: Regrouping across a single zero
- Level 6: Regrouping across multiple zeros
2. Watch for the Shift in Strategies
As the child works through the sequence on paper, watch for changes in their cognitive behavior.
- At the Independent level, they will retrieve facts automatically or complete algorithms quickly with ease.
- At the Emerging (Boundary) level, you will see their strategy shift. They may slow down, hesitate, count on their fingers, draw tally marks, talk to themselves, or make careless errors that they spontaneously correct on paper. This shift is the boundary.
- At the Breakdown level, they will make systematic error patterns (such as always subtracting the smaller digit from the larger digit regardless of position) or shut down completely.
3. Ask "How did you know?"
The written paper gives you "diagnostic gold," but verbal explanation seals it. When a child reaches a problem where they hesitate or make an error, ask them: "Tell me what you were thinking" or "How did you get that answer?" Listening to their mathematical language will tell you if they conceptually understand the regrouping/place-value exchange or if they are simply trying to apply a memorized procedure they don't understand.
Once you pinpoint the exact step in the sequence where fluent independence transitions into emerging struggle, you have found your boundary—and your exact instructional starting point for tomorrow
No comments:
Post a Comment
Thank you!