Precision CNC: Tight Tolerances for Delivery

• 1
  What a tolerance really controls
• 2
  Where the error comes from
• 3
  How five-axis setups cut error stacking
• 4
  Process control and inspection for tight tolerances for delivery
• 5
  Design choices that make tight tolerances cheaper
• 6
  Which tolerance to call out, and where

A tolerance is the allowed spread between the largest and smallest acceptable value of a dimension. On a shaft, ±0.005 mm means the finished diameter may vary by 0.010 mm total. That is roughly one seventh of a human hair. It is also close to the resolution floor of a good CNC milling machine, which is why the number only means something when the drawing also says where it applies.

Three quantities are often mixed up. Dimensional tolerance controls the size of a feature. Geometric tolerance controls its form, orientation and location. Surface roughness controls the micro-texture left by the cutter. A bore can sit dead on nominal diameter and still refuse to accept a bearing, because its roundness or its position drifted outside the envelope.

That is the first practical consequence. A title block that says "±0.005 mm unless otherwise stated" forces every feature on the part into the same box, including clearance holes and chamfers that never needed it. The shop then has to slow down, add setups and inspect features that carry no function. Cost rises and nothing gets better.

Good drawings put the tight callout only on the surfaces that mate, seal, slide or locate. Everything else gets a general tolerance of ±0.1 mm or looser. This single decision does more for delivery than any machine upgrade, because it removes inspection time and rework from the parts that do not need them.

• 1
  Size vs. formDiameter can be correct while roundness is not.
• 2
  Location mattersPosition tolerance controls where the hole sits.
• 3
  Texture is separateRa describes the surface, not the dimension.

Every tight-tolerance feature accumulates error from four sources before the cutter even touches metal. Machine geometry sets the baseline: a five-axis center is laser-calibrated for squareness and rotary center offset, and that calibration drifts with temperature and with any crash. Spindle thermal growth moves the tool tip by several microns over the first hours of running.

Workholding comes next. A vise clamping a thin wall will push the wall inward while cutting and let it spring back after unclamping. The measured dimension then reads correctly on the machine and incorrectly on the CMM. This is the most common cause of a part that passes in-process checks and fails final inspection.

Cutting force and tool deflection add their share. A long, small-diameter end mill in aluminum will bend under load; a rigid tool in titanium will push the part instead. Both shift the wall you are trying to hold. Tool runout of 0.003 mm alone consumes more than half of a ±0.005 mm budget before any other error appears.

Thermal drift is the slow one. A shop at 22 °C and a part heated by roughing at 40 °C do not agree on dimensions. Finishing with light cuts, coolant at stable temperature, and letting the part rest before final measurement removes most of this. It is boring work. It is also what separates a tolerance that holds from one that only holds on the first part.

• 1
  CalibrationRotary and linear axes checked against a known artifact.
• 2
  RunoutKeep tool runout under 0.003 mm for tight bores.
• 3
  Spring-backSupport thin walls; do not clamp them closed.

On a three-axis machine, a part with features on five faces needs multiple setups. Each setup brings a new zero point, a new clamp position and a new chance to be off by a few microns. Those errors add. Five faces, three setups, and a ±0.005 mm position callout across them becomes very hard to guarantee.

A simultaneous five-axis machine keeps the part in one fixture. The tool reaches the angled face by rotating the table and the spindle, not by moving the part. Datum transfer disappears, so position error between features on different faces drops to the accuracy of the rotary axes rather than the sum of three fixturings.

Angle holes, port faces, impeller blades and hydraulic manifolds are the classic beneficiaries. A cross-drilled hole that must intersect an internal bore at a precise angle is a single operation on a five-axis center and a tolerance stack on a three-axis one. The same logic applies to undercut features and to blended radii that must run continuously across a curved surface.

The trade-off is real. Five-axis setups are harder to program and slower to prove out, and the rotary axes themselves introduce positioning error that a simple three-axis move does not have. For a flat plate with holes on one face, a three-axis machine is faster, cheaper and just as accurate. Use the right machine for the geometry, not the one with the best brochure.

• 1
  One fixtureFewer datum transfers means less accumulated error.
• 2
  Angled featuresPorts and cross-holes in one operation.
• 3
  Not always rightFlat parts are cheaper on three axes.

Tight tolerances for delivery only survive if the process is measured while there is still time to react. The sequence that works is raw material verification, in-process checks at defined intervals, and a full final inspection before the part leaves the building. Skipping the middle step is how a batch of twenty parts becomes nineteen good ones and one scrap.

Raw material matters more than most buyers expect. A 7075 billet and a 6061 billet machine differently, and a certified mill report tells you what you actually received. Hardness variation inside a single plate can move a bore by several microns from one end to the other. Checking hardness before cutting is cheaper than discovering it at final inspection.

In-process monitoring uses the machine's own probing or a shop-floor gauge to catch drift early. If the first part measures 0.002 mm over nominal, the operator adjusts the offset before part two. This is normal practice for tight work and it is why the tolerance is repeatable rather than lucky.

Final inspection is the last gate. Calipers are not enough for ±0.005 mm; a coordinate measuring machine or a micrometer with a known-zero standard is. Reports are available on request, and parts are inspected 100% before shipment on tight-tolerance jobs. A first-article report without a full inspection plan behind it is a piece of paper, not a guarantee.

• 1
  Material checkVerify alloy and hardness before the first cut.
• 2
  In-process probingCorrect offsets while the batch is still running.
• 3
  Final gateCMM or calibrated micrometer, not calipers.

Tolerance cost is not linear. Going from ±0.05 mm to ±0.005 mm can multiply the machining and inspection effort several times over for the same feature. Designers who understand this put the tight callout only where the function demands it, and they design the feature so that it can be reached, measured and held without heroics.

Deep bores with a high length-to-diameter ratio are the hardest common feature. A Ø10 mm bore 100 mm deep is ten times its diameter, and the boring bar deflects along the way. Keeping the ratio under 4:1 lets a standard tool hold ±0.005 mm comfortably. Beyond that, expect a reaming or honing step and a higher price.

Thin walls behave the same way. A wall under 1 mm will move during clamping and during cutting, and no amount of machine accuracy fixes it. Adding a rib, increasing the wall to 1.5–2 mm, or accepting a looser tolerance on that face usually solves the problem at the design stage rather than in the shop.

Corner radii and fillets should match standard tool sizes. A 3.05 mm internal radius means the tool has to be ground specially or the corner has to be plunged, which adds time and risk. A 3 mm radius uses an off-the-shelf cutter and cuts cleaner. Small drawing decisions like this are what actually shorten the path from quote to delivered part.

• 1
  Bore ratioKeep depth under 4× diameter for easy ±0.005 mm.
• 2
  Wall thickness1.5–2 mm minimum for stable clamping.
• 3
  Standard radiiMatch fillets to available cutter sizes.