Precision Compensation Measurements in Machine Tool Machining
A machine tool never moves exactly where the control tells it to. Every axis carries a small, repeatable error from backlash, screw pitch, thermal growth and tool wear. This page explains what each error physically is, how it is measured, and when compensation helps. It is written for engineers and buyers who have to judge whether a tight tolerance is achievable on a given machine.

In this article
- 1
- 2
- 3
- 4
- 5
- 6
Why precision compensation measurements matter on every axis
A CNC control sends an axis to a commanded position. The table arrives somewhere else. The gap between the two is the positioning error. It comes from several independent sources stacked on top of each other.
Backlash in the screw nut and thrust bearings shows up as lost motion when the axis reverses. Screw pitch error comes from the machining tolerance of the ball screw itself, so the error grows and falls along the travel. Thermal growth changes the screw length and the machine structure as the machine warms up. Tool wear, spindle growth and servo tuning each add their own small contribution.
None of these errors is random in the short term. Backlash repeats on every reversal. A warm machine drifts in a predictable direction. That repeatability is what makes precision compensation measurements useful: if the error can be measured, it can often be mapped and cancelled in the control.
The limit is that compensation only works on errors the machine can see and repeat. A loose gib or a chipped insert produces scatter, not a curve, and no parameter table will fix it. Measurement comes first, compensation second.
In practice we separate the error sources before touching any parameter. Backlash, pitch, thermal drift and tool wear are handled in different places, and confusing them wastes setup time.
Backlash and lost motion: the reversal error
Backlash is the small amount of movement the servo makes before the table actually starts to move. In a ball screw drive it comes from clearance between the screw and the nut, from thrust bearing clearance, and from any wear in the coupling. On a worn machine it can reach 0.02 mm or more on a single axis.
The classic symptom is a step or witness mark on a part where the cutter changed direction. A circle interpolated on a machine with 0.02 mm backlash comes out slightly oval, and the error appears on the quadrant lines. Roughing loads can push the same error larger on the finishing pass.
The standard measurement is a reversal test. The machine moves the axis in one direction, stops, then moves back in small increments while a dial indicator or a laser interferometer reads the table position. The distance between commanded and actual motion at the reversal is the backlash figure.
Compensation is applied in the control as a backlash value per axis. The control adds that distance to every reversal command. It works well on a healthy machine. If the value needed is growing month over month, the nut or bearings are wearing and the mechanical repair comes before the parameter.
Pitch error and the error map along travel
A ball screw is a precision part, not a perfect one. Over 1,000 mm of travel a rolled screw may deviate 0.05 mm from the ideal pitch, and even a ground screw carries a few micrometres. The deviation is not linear. It is a curve that depends on how the screw was ground.
Pitch error compensation stores that curve as a table inside the control. A laser interferometer measures actual position at 20 to 50 points along the axis, the deviations are entered as a correction table, and the control offsets the command at each point.
This is where precision compensation measurements in machine tool machining pay off most clearly on long axes. A 4,000 mm machine can hold ±0.005 mm on a short feature only if the pitch map is current. Re-measure after a crash, after a screw replacement, or roughly once a year on a production machine.
The measurement itself has conditions. Do the laser run at the temperature the machine will run at, with the way lube cycle normal, and with the same preload on the table. A pitch map taken on a cold machine is a map of the wrong machine.
Thermal drift: the slow error that ruins a long run
Heat changes length. A 1,000 mm steel screw grows about 12 μm for every 1 °C rise. Run a spindle at 12,000 rpm for two hours and the screw, the bed and the column all move by different amounts. The result is a part that measures well at 8 a.m. and drifts out of tolerance by lunchtime.
Thermal error is not uniform, which is why a simple offset rarely fixes it. The screw is warmest near the thrust bearing, so the error is larger at one end of the travel. The column leans as it warms, which tilts the spindle in relation to the table.
The practical controls are warm-up cycles, spindle and screw cooling, and thermal compensation models in the control. A warm-up program that runs the axes through their full travel for 20 to 30 minutes before the first cut is cheap and effective. On long unattended runs, in-process probing catches the drift before it becomes scrap.
There is a boundary here. Thermal compensation works when the heat load is steady. A job that stops and starts, or a shop where the door opens all day, gives the model nothing consistent to track.
Tool wear, spindle growth and radius offsets
A cutting tool shrinks as it wears. On a 10 mm end mill running 4140 steel, flank wear of 0.05 mm changes the finished dimension by roughly that amount on a side wall. The error is monotonic: it only grows, and it grows faster as the edge dulls.
Tool radius and length offsets are the everyday compensation. The operator measures the tool on a presetter or in the machine, enters the offset, and the control corrects the path. On a mill-turn center or a 5-axis job, the same logic extends to the tool tip position and the rotary axis centre.
Spindle thermal growth is a related problem. The spindle nose extends as the bearings heat, typically 10 to 30 μm over the first hour of running. On a horizontal machine this pushes the tool deeper into the part; on a vertical machine it changes the depth of a face cut.
When a tool wears past the point where the offset can keep up, the answer is a tool change, not a bigger offset. Pushing a dull tool ruins the surface finish and loads the spindle. On Ra 0.8–1.6 μm work the finish usually fails before the size does.
Error source, measurement and compensation at a glance
Figures are typical ranges, not promises for a specific machine.
| Error source | Typical size | How it is measured | Where compensation lives |
|---|---|---|---|
| Backlash / lost motion | 0.005–0.02 mm per axis | Reversal test with indicator or laser | Backlash parameter, per axis |
| Screw pitch error | 0.02–0.05 mm over 1,000 mm | Laser interferometer, 20–50 points | Pitch error correction table |
| Thermal drift | 0.01–0.05 mm over a shift | Probing or laser, at running temperature | Thermal model or warm-up cycle |
| Tool wear | 0.02–0.1 mm on a side wall | Presetter or in-machine touch probe | Tool radius and length offsets |
| Spindle growth | 0.01–0.03 mm in the first hour | Test cut or spindle probe | Warm-up cycle, then offsets |
| Servo tuning error | Micrometre level, follows the feed | Ballbar circular test | Servo gain and feed-forward |
Compensate, or fix the machine first?
If the error repeats on every cycle, map it and compensate in the control. If the error scatters from part to part, the machine has a mechanical fault and no parameter table will hide it.
Frequently asked questions
How often should precision compensation measurements be repeated?
On a production machine, run a laser pitch check and a reversal test about once a year. Re-measure after any crash, after a screw or bearing replacement, and after a move to a new foundation.
If the machine runs two or three shifts a day, watch the backlash value. A number that climbs steadily is a wear signal, not a compensation problem.
Can compensation hold ±0.005 mm on a long part?
A current pitch map and stable thermal conditions make ±0.005 mm realistic on a well-maintained machine, and we hold that tolerance on production parts.
The risk is not the table. It is the temperature swing during a long cycle and the rigidity of the setup. A thin wall or a long overhang will move more than any axis error.
Does thermal compensation replace a warm-up cycle?
No. A model predicts drift, but it needs a steady heat load to be accurate. The warm-up cycle gives the machine that steady state before the first cut.
In our shop we run a warm-up program through the full axis travel for 20 to 30 minutes before critical work. It is the cheapest accuracy improvement available.
Why does a circle come out oval after compensation is set?
Quadrant error on a circle usually points at backlash or at servo mismatch between the two axes. Check the reversal test on both axes first.
If backlash is small and the oval shape stays, the problem may be a loose gib or a worn guide. That is mechanical, and it needs repair, not a parameter change.
Do tool offsets count as compensation?
Yes. Tool radius and length offsets are the compensation most operators use every day. They correct the difference between the programmed path and the actual cutting edge.
They cannot correct machine geometry. If the machine itself is out of square or the rotary axis centre is wrong, tool offsets only move the error around the part.
What information do you need to quote a tight-tolerance part?
Send the drawing with tolerances, the material and the expected quantity. Tell us which features are critical and which are free.
We reply with a quotation and a DFM analysis within 12 hours, and we flag any tolerance that depends on compensation limits rather than on the cutting process.
Send us your tight-tolerance parts
Upload a drawing and we will tell you which tolerances are achievable on our machines, and which ones need a different approach.
12-hour quote100% inspection±0.005 mm