High-precision CNC machining: where the tolerance actually comes from
This page explains the mechanics behind high-precision CNC machining: machine geometry, thermal drift, tool deflection and probing. It is written for design engineers and buyers who need to decide which features can hold ±0.005 mm and which ones should be redesigned, ground, or measured differently.

High-precision CNC machining: what a ±0.005 mm callout really costs
A drawing that says ±0.005 mm is not a request for a better machine. It is a request to control every error source in the loop: spindle growth, ball screw pitch error, thermal drift over the run, fixture compliance, and the measurement itself.
On a 16-hour run, a spindle can grow 10–20 μm from cold start. That is already two to four times the whole band. So the shop either lets the machine warm up for 30–60 minutes, or it probes a master ball and re-zeroes between operations.
Fixtures matter just as much. A part clamped on three points will move when the clamp is released, and a thin wall will spring back after the finishing pass. We often leave 0.1–0.2 mm of stock for a stress-relief pass before the final cut.
The last error source is metrology. A CMM at 20 °C reads differently from a caliper on the shop floor at 28 °C. Aluminium expands about 23 μm per metre per degree, so a 300 mm part grows roughly 7 μm per degree Celsius.
When 5-axis, mill-turn or 3-axis is the right call
Five-axis earns its cost when a part has features on five or more faces, deep pockets with a tilted floor, or undercut geometry a 3-axis setup cannot reach. One setup also removes the re-datum error that comes from flipping a part three times.
Simultaneous 5-axis is not always faster. On a simple bracket with four holes, a 3-axis machine with a good fixture will beat a 5-axis centre because the rotary axes add interpolation error. We keep 27 three-axis machines for exactly that reason.
Mill-turn centres make sense for round parts with milled flats, cross holes, or a slot that has to stay concentric to a turned bore. Turning and milling in one spindle keeps concentricity inside 0.01 mm without a second chucking.
The rule we use: if a part needs more than two setups, or a true position under 0.02 mm across faces, move it to 5-axis. If it is a shaft with a keyway, mill-turn. Everything else stays on 3-axis.
Tool deflection, chip load and surface finish limits
A 6 mm carbide end mill hanging 40 mm out of the holder will deflect under side load. On aluminium at 0.05 mm per tooth, radial deflection can reach 15–20 μm. That is the real limit on a thin rib, not the machine's positioning accuracy.
The fix is not always a slower feed. Shortening the gauge length by 15 mm, or stepping up to an 8 mm tool with a 0.03 mm per tooth load, usually cuts deflection more than reducing the depth of cut.
Surface finish is a separate budget. Ra 1.6–3.2 μm is a normal as-machined finish. Ra 0.8–1.6 μm needs a finishing pass with a sharp insert and a small stepover. Below Ra 0.8 μm, we usually switch to lapping or polishing rather than chasing the number on the mill.
Hard materials change the picture. Inconel and Ti-6Al-4V work-harden, so a dwell or a light rub will raise the surface hardness and kill the next insert. Keep the feed per tooth high enough to stay under the hardened layer.
How to measure high-precision CNC machining results
A tolerance is only as good as the instrument that verifies it. A 0–25 mm micrometer reads to 0.001 mm, but only at the temperature it was calibrated. On the shop floor we let the part and the gauge sit together for 20 minutes before the final reading.
For position and form, a CMM with a 0.5 μm probe is the usual tool. For a bore roundness under 5 μm, a roundness tester beats a CMM because it spins the part rather than sampling points.
We inspect 100% of parts before shipment, with raw material check, in-process monitoring and a final inspection. Reports are available on request, and the qualification rate we hold is 99.99%.
If a feature cannot be measured to a tenth of its tolerance, the drawing is asking for something the shop cannot prove. Redesign the callout or add a functional gauge to the print.
Which process fits which feature
Use the tightest feature on the print to pick the process, not the overall part size.
| Feature | Best process | Typical hold | Watch out for |
|---|---|---|---|
| Flat face, open pocket | 3-axis milling | ±0.02 mm | Fixture lift on thin walls |
| Five-face bracket | 5-axis milling | ±0.01 mm | Rotary axis backlash |
| Cross hole in a shaft | Mill-turn | 0.01 mm concentricity | Second chucking error |
| Bore under 5 μm round | Grinding | ±0.003 mm | Heat from the grind |
| Sealing face, Ra 0.4 μm | Lapping or polishing | Ra 0.2–0.4 μm | Edge roll-over |
| Deep rib, 1 mm wide | 3-axis, short tool | ±0.03 mm | Tool deflection |
| Hardened tool steel | EDM or grinding | ±0.005 mm | Recast layer |
The trade-off in one line
If the tight feature sits on one face, use 3-axis with a stiff fixture; if it spans three faces or more, pay for 5-axis and skip the re-datum error. Grinding only pays off below Ra 0.8 μm or above 45 HRC.
Questions engineers ask before quoting
Can high-precision CNC machining hold ±0.005 mm on every feature?
No. That number applies to a specific dimension on a specific setup, usually a bore or a ground face.
A general tolerance of ±0.005 mm across a whole part would need every feature measured at 20 °C and every setup probed. We quote it feature by feature.
How much stock should I leave for a finishing pass?
0.2–0.3 mm on a milled face, 0.1–0.15 mm on a turned diameter, and 0.05 mm on a ground surface.
Too little stock and the tool rubs; too much and the finishing pass moves the part from stress relief.
Does the material change the achievable tolerance?
Yes. Aluminium and brass hold tight numbers easily. Stainless 316 and Ti-6Al-4V move more after machining because of residual stress.
For those, we often rough, stress-relieve, then finish, which adds a day to the schedule.
What surface finish can I get straight off the machine?
Ra 1.6–3.2 μm is standard as-machined. Ra 0.8–1.6 μm is a normal finishing pass on aluminium and mild steel.
Below Ra 0.8 μm we move to bead blasting, lapping or polishing rather than a lighter cut.
Do you need an NDA before I send drawings?
Uploads are secure and confidential. An NDA is available on request if your program requires one.
We can also quote from a simplified print with the critical dimensions only, if that is easier for your team.
How fast can a tight-tolerance part ship?
Quotation and DFM analysis come back within 12 hours, and production can start within 24 hours.
Parts ship in 3–5 days for most geometries. Extra grinding or heat treatment steps add time, and we will say so in the quote.
Send the print, get a tolerance review
We quote high-precision CNC machining feature by feature and flag any callout the process cannot prove.
12-hour quote100% inspection±0.005 mm