GreatLight CNC Machining Factory logo
CNC Machining
Rapid Prototyping
Materials
Industries
News
About GL

Get Instant Quote

Engineering explainer

High-precision CNC machining: where the tolerance actually comes from

This page explains the mechanics behind high-precision CNC machining: machine geometry, thermal drift, tool deflection and probing. It is written for design engineers and buyers who need to decide which features can hold ±0.005 mm and which ones should be redesigned, ground, or measured differently.

±0.005 mm16 five-axis centersRa 0.2–0.8 μmISO 9001 / IATF 16949
Aerospace part produced by high-precision CNC machining
Tolerance budget

High-precision CNC machining: what a ±0.005 mm callout really costs

A drawing that says ±0.005 mm is not a request for a better machine. It is a request to control every error source in the loop: spindle growth, ball screw pitch error, thermal drift over the run, fixture compliance, and the measurement itself.

On a 16-hour run, a spindle can grow 10–20 μm from cold start. That is already two to four times the whole band. So the shop either lets the machine warm up for 30–60 minutes, or it probes a master ball and re-zeroes between operations.

Fixtures matter just as much. A part clamped on three points will move when the clamp is released, and a thin wall will spring back after the finishing pass. We often leave 0.1–0.2 mm of stock for a stress-relief pass before the final cut.

The last error source is metrology. A CMM at 20 °C reads differently from a caliper on the shop floor at 28 °C. Aluminium expands about 23 μm per metre per degree, so a 300 mm part grows roughly 7 μm per degree Celsius.

Machine choice

When 5-axis, mill-turn or 3-axis is the right call

Five-axis earns its cost when a part has features on five or more faces, deep pockets with a tilted floor, or undercut geometry a 3-axis setup cannot reach. One setup also removes the re-datum error that comes from flipping a part three times.

Simultaneous 5-axis is not always faster. On a simple bracket with four holes, a 3-axis machine with a good fixture will beat a 5-axis centre because the rotary axes add interpolation error. We keep 27 three-axis machines for exactly that reason.

Mill-turn centres make sense for round parts with milled flats, cross holes, or a slot that has to stay concentric to a turned bore. Turning and milling in one spindle keeps concentricity inside 0.01 mm without a second chucking.

The rule we use: if a part needs more than two setups, or a true position under 0.02 mm across faces, move it to 5-axis. If it is a shaft with a keyway, mill-turn. Everything else stays on 3-axis.

Cutting mechanics

Tool deflection, chip load and surface finish limits

A 6 mm carbide end mill hanging 40 mm out of the holder will deflect under side load. On aluminium at 0.05 mm per tooth, radial deflection can reach 15–20 μm. That is the real limit on a thin rib, not the machine's positioning accuracy.

The fix is not always a slower feed. Shortening the gauge length by 15 mm, or stepping up to an 8 mm tool with a 0.03 mm per tooth load, usually cuts deflection more than reducing the depth of cut.

Surface finish is a separate budget. Ra 1.6–3.2 μm is a normal as-machined finish. Ra 0.8–1.6 μm needs a finishing pass with a sharp insert and a small stepover. Below Ra 0.8 μm, we usually switch to lapping or polishing rather than chasing the number on the mill.

Hard materials change the picture. Inconel and Ti-6Al-4V work-harden, so a dwell or a light rub will raise the surface hardness and kill the next insert. Keep the feed per tooth high enough to stay under the hardened layer.

Inspection

How to measure high-precision CNC machining results

A tolerance is only as good as the instrument that verifies it. A 0–25 mm micrometer reads to 0.001 mm, but only at the temperature it was calibrated. On the shop floor we let the part and the gauge sit together for 20 minutes before the final reading.

For position and form, a CMM with a 0.5 μm probe is the usual tool. For a bore roundness under 5 μm, a roundness tester beats a CMM because it spins the part rather than sampling points.

We inspect 100% of parts before shipment, with raw material check, in-process monitoring and a final inspection. Reports are available on request, and the qualification rate we hold is 99.99%.

If a feature cannot be measured to a tenth of its tolerance, the drawing is asking for something the shop cannot prove. Redesign the callout or add a functional gauge to the print.

Decision table

Which process fits which feature

Use the tightest feature on the print to pick the process, not the overall part size.

FeatureBest processTypical holdWatch out for
Flat face, open pocket3-axis milling±0.02 mmFixture lift on thin walls
Five-face bracket5-axis milling±0.01 mmRotary axis backlash
Cross hole in a shaftMill-turn0.01 mm concentricitySecond chucking error
Bore under 5 μm roundGrinding±0.003 mmHeat from the grind
Sealing face, Ra 0.4 μmLapping or polishingRa 0.2–0.4 μmEdge roll-over
Deep rib, 1 mm wide3-axis, short tool±0.03 mmTool deflection
Hardened tool steelEDM or grinding±0.005 mmRecast layer

The trade-off in one line

If the tight feature sits on one face, use 3-axis with a stiff fixture; if it spans three faces or more, pay for 5-axis and skip the re-datum error. Grinding only pays off below Ra 0.8 μm or above 45 HRC.

FAQs

Questions engineers ask before quoting

Can high-precision CNC machining hold ±0.005 mm on every feature?

No. That number applies to a specific dimension on a specific setup, usually a bore or a ground face.

A general tolerance of ±0.005 mm across a whole part would need every feature measured at 20 °C and every setup probed. We quote it feature by feature.

How much stock should I leave for a finishing pass?

0.2–0.3 mm on a milled face, 0.1–0.15 mm on a turned diameter, and 0.05 mm on a ground surface.

Too little stock and the tool rubs; too much and the finishing pass moves the part from stress relief.

Does the material change the achievable tolerance?

Yes. Aluminium and brass hold tight numbers easily. Stainless 316 and Ti-6Al-4V move more after machining because of residual stress.

For those, we often rough, stress-relieve, then finish, which adds a day to the schedule.

What surface finish can I get straight off the machine?

Ra 1.6–3.2 μm is standard as-machined. Ra 0.8–1.6 μm is a normal finishing pass on aluminium and mild steel.

Below Ra 0.8 μm we move to bead blasting, lapping or polishing rather than a lighter cut.

Do you need an NDA before I send drawings?

Uploads are secure and confidential. An NDA is available on request if your program requires one.

We can also quote from a simplified print with the critical dimensions only, if that is easier for your team.

How fast can a tight-tolerance part ship?

Quotation and DFM analysis come back within 12 hours, and production can start within 24 hours.

Parts ship in 3–5 days for most geometries. Extra grinding or heat treatment steps add time, and we will say so in the quote.

Send the print, get a tolerance review

We quote high-precision CNC machining feature by feature and flag any callout the process cannot prove.

12-hour quote100% inspection±0.005 mm

Follow

More from the shop floor

We publish setup notes, tooling trials and inspection data from the factory floor.

FacebookTikTokYouTubeLinkedInInstagramThreadsPinterest

Trusted by engineers and manufacturers worldwide

Tesla Ford Motor Company BYD Auto Denso Magna International Boeing Airbus Medtronic KUKA FANUC