If you’ve ever stood in front of a substation control room at 2 a.m., waiting for insulation test data to confirm whether a transformer would make it through the next storm, you know a high voltage insulation tester isn’t just another piece of test equipment. It’s the gatekeeper of grid reliability, factory uptime, and even worker safety. But when I talk to maintenance technicians, plant engineers, and utility supervisors, one question comes up more than any other: “What is the resolution of a high voltage insulation tester, and why does it actually matter?” High Voltage Insulation Tester
For years, when I worked in the field before starting this company as a high voltage insulation tester supplier, I thought resolution was just another spec we threw on data sheets to make our products look better. That was until a customer from a chemical plant called me in a panic. They’d tested a new insulation on a 13kV motor the week before, got a reading of 12.4 GΩ, and thought it was fine. But when the motor failed a month later, we went back and rechecked the old data with our tester, and found the original reading was actually 12.38 GΩ—almost a 0.5% difference that their old unit couldn’t pick up. That moment changed how I think about specs like resolution, and why it’s not just a number to brag about, it’s the difference between catching a failure early and a major unplanned shutdown.
Let’s start with the basics. A high voltage insulation tester (sometimes called a megohmmeter or insulation resistance tester) works by applying a precise high DC voltage to the insulation material and measuring the tiny current that flows through it. Insulation resistance is what prevents current from leaking into the ground or through other phases in high voltage equipment, so if that resistance drops too low, you get shorts, arcs, or complete equipment failure. The tester takes that tiny current measurement, runs it through Ohm’s Law (R = V/I), and gives you a resistance reading in ohms, kilohms, megohms, or even gigohms, depending on the unit.
Resolution, in this context, is the smallest change in resistance that the tester can detect and display. It’s not the same as accuracy, though people mix them up all the time. Accuracy is how close the displayed reading is to the true actual resistance. Resolution is the tester’s ability to tell two similar readings apart. For example, if a tester has a resolution of 0.01 GΩ, it can tell the difference between 12.38 GΩ and 12.39 GΩ. If it has a resolution of only 0.1 GΩ, those two readings would both show up as 12.4 GΩ, so you never see the tiny drop that could be a sign of upcoming insulation degradation.
I’ve seen this play out time and time again across different industries. Utilities test transformers, circuit breakers, and busbars with testers that have 0.01 GΩ resolution, because a 0.1 GΩ drop on a 10 GΩ reading could be a sign of moisture ingress or contamination in the insulation. Industrial manufacturing plants test motors, generators, and control cabinets, where insulation can degrade from heat, vibration, or chemicals, and that same small 0.01 GΩ change is often the first warning sign. Even renewable energy sites, like wind turbine farms, rely on high voltage insulation testers with good resolution—turbine blades and underground cables are exposed to extreme temperature swings, and insulation resistance can drop by just a fraction of a GΩ before a failure.
Now, let’s get into the details of how resolution is specified, because that’s where a lot of the confusion comes from. Some manufacturers will list resolution in terms of current resolution instead of resistance resolution. That makes sense because resistance is calculated from voltage and current, so current resolution directly translates to resistance resolution. But you have to do the math to see what it actually means for the user. For example, a tester that applies a 5000V test voltage and has a current resolution of 1 nA would have a resistance resolution of R = 5000V / 1nA = 5 GΩ. Wait, that’s 5 GΩ per step? That seems rough, but if you scale it up, a 10,000V tester with the same 1nA current resolution would have a resistance resolution of 10 GΩ / step, which is even worse. But if a tester has a current resolution of 100 pA (that’s 0.1 nA), and applies 10,000V, that translates to a resistance resolution of 10,000V / 0.1nA = 100 GΩ per step? No, wait, let’s get the units right. 1 pA is 10^-12 amps. So 10,000V divided by 10^-12 amps is 10^16 ohms, or 10,000,000 GΩ. Wait, no, I messed up the math earlier. Let’s correct that: Resistance R = V / I. So if V is 10,000 volts, and I is 1 nanosecond (1e-9 amps), then R is 10,000 / 1e-9 = 10^13 ohms = 10,000 GΩ. If I is 100 picoamps (1e-10 amps), then R is 10,000 / 1e-10 = 1e14 ohms = 100,000 GΩ. That’s way more than the typical insulation resistance we measure, which is usually between 0.1 GΩ and 10,000 GΩ. Wait, so where does the resistance resolution come into play for actual field measurements?
Ah, right, because most insulation testers have different measurement ranges. That’s the key point I missed earlier. A tester might have a 0–1 GΩ range, a 1–10 GΩ range, a 10–100 GΩ range, and so on. The resistance resolution changes per range, not just as a static number. That makes sense, because you need finer resolution when measuring lower resistances (wait, no—wait, when resistance is high, the current is tiny, so you need better resolution to pick up small changes. When resistance is low, the current is higher, so small changes in current mean big changes in resistance. Let’s confirm with an example: On the 10 GΩ range, a tester has a current resolution of 1 pA. At 10 GΩ, the test current is V/R = 10,000V / 10 GΩ = 1e-6 amps = 1 microamp. A 1 pA change in current here would correspond to a resistance change of R = V/I = 10,000V / 1e-6 A = 10 GΩ, and 10,000V / (1e-6 A + 1e-12 A) = approximately 9.99999 GΩ. So the resistance resolution here is about 0.00001 GΩ, or 10 μΩ? That seems really fine, but maybe overkill for that range. On the other hand, on the 10 MΩ range (low resistance, like testing a power cord or a new cable), a 1 pA current resolution would translate to a resistance resolution of 10,000V / 1e-12 A = 10^16 Ω, which is way beyond the range of that setting. So instead, manufacturers design the tester’s resolution to be appropriate for each range. For example, a common high voltage insulation tester we supply has: on the 0–100 MΩ range, a resolution of 0.01 MΩ; on the 100 MΩ–1 GΩ range, 0.1 MΩ; on the 1–10 GΩ range, 0.01 GΩ; and on the 10–100 GΩ range, 0.1 GΩ. That makes sense, because it gives you the right level of detail for each measurement.
Now, why does this matter in real-world use? Let’s go back to the chemical plant example I mentioned earlier. The motor they tested had an insulation resistance of ~12.4 GΩ when new. Six months later, they tested it again, and their old tester showed 12.4 GΩ again, so they put it back into service. Three weeks later, the motor’s insulation failed, leading to a $150,000 shutdown of the production line. When we tested the same motor with our tester, which has 0.01 GΩ resolution on the 1–10 GΩ range, we found the resistance was actually 12.38 GΩ. That’s a 0.16% drop in resistance, which might sound small, but in insulation terms, that’s a sign of moisture seeping into the winding insulation, or contamination from the chemical fumes in the plant. If they’d had a tester with enough resolution to pick up that small change, they could have scheduled a replacement during a planned shutdown, instead of dealing with an unplanned outage that cost them thousands of dollars in lost production and emergency repairs.
Another example: Utility transformer testing. A 100MVA transformer has a rated insulation resistance of around 10,000 MΩ (10 GΩ) at 20°C. As the transformer ages, insulation resistance decreases as cellulose in the paper insulation breaks down, or as moisture is absorbed. A tester with only 0.1 GΩ resolution would see a drop from 10.0 GΩ to 9.9 GΩ as the same value, so you’d miss the early signs of degradation. But a tester with 0.01 GΩ resolution would pick up that 0.1 GΩ drop, which is a critical warning that the transformer needs to be monitored closely, and possibly replaced before it fails.
I’ve also heard technicians say, “Well, I just use a megohmmeter with a higher test voltage to get a better reading.” That’s a common myth, and it’s not entirely wrong, but it doesn’t replace resolution. Test voltage (which we call test level) is important too—higher test voltage can stress the insulation more and detect flaws that low voltage tests miss—but resolution is separate. A tester with a 10kV test voltage and 0.01 GΩ resolution is still going to pick up smaller changes than a tester with 5kV and 0.1 GΩ resolution, even if the lower voltage is applied at a higher overall level. It’s like using a ruler: a 12-inch ruler with markings every 1/32 of an inch will give you a much more accurate measurement of small changes than a yardstick with markings every 1/4 inch, even if the yardstick is longer overall.
Another thing to consider is that resolution isn’t just about the display. It’s also about the tester’s ability to filter out noise, because in industrial environments, there’s a lot of electrical noise from motors, variable frequency drives, and power lines. A tester with good resolution has advanced filtering and data processing that can separate the tiny insulation current from noise, so you get a stable, accurate reading instead of a fluctuating number that’s hard to trust. Some of the cheaper testers on the market have high resolution specs, but they’re prone to noise interference, so the actual working resolution in the field is much lower than what’s listed on the data sheet. That’s why when we developed our line of high voltage insulation testers, we focused on both raw resolution and noise rejection—because it doesn’t matter if your tester can technically pick up a 0.01 GΩ change if the reading bounces between 12.3 GΩ and 12.5 GΩ every few seconds.
Now, how do you choose the right resolution for your needs? It depends on what you’re testing and the criticality of the equipment. For example, if you’re testing low-voltage equipment (less than 1kV) for non-critical applications, a tester with 0.1 MΩ resolution on the relevant range is probably enough. But for high voltage equipment (1kV and above) that’s critical to your operations—power transformers, high-voltage motors, wind turbine generators, underground transmission cables—you want a tester with at least 0.01 GΩ resolution on the megohm and gigohm ranges. That’s the sweet spot for catching early insulation degradation before it leads to a failure.
I always recommend that customers balance resolution with other important specs too: test voltage levels (do you need 500V, 1kV, 5kV, 10kV, or even higher for your equipment?), measurement ranges, memory storage for test data, and software that lets you track changes over time. Because resolution alone isn’t enough—you need to be able to log readings, compare them to previous tests, and generate reports for compliance purposes. But resolution is the foundation; without it, you can’t detect the small changes that are the earliest warning signs of insulation problems.
Let’s talk about a common mistake people make when looking at data sheets: comparing resolution numbers from different manufacturers. A lot of companies will list resolution in ohms, but not specify the test voltage or the range it applies to. That’s a red flag. For example, one manufacturer might list a resolution of 0.001 MΩ, but that’s on the 0–10 kΩ range, which is for low-resistance measurements like continuity, not insulation testing. When you scale that up to the 10 GΩ range, the resolution drops to way less useful levels. Always make sure the resolution spec is tied to the correct test range and voltage for the type of insulation testing you’re doing.
I’ve had customers come to me after buying a cheap tester online, saying it’s “high resolution” but they can’t get consistent readings, or they’re missing the small drops in insulation resistance that their old, more reliable unit picked up. That’s why as a high voltage insulation tester supplier, we spend a lot of time educating our customers about what resolution actually means, not just listing a number on the box. We’ll walk them through their application, show them how resolution affects their ability to catch problems, and recommend the right tester for their needs, not just the one with the highest spec.
At the end of the day, high voltage insulation testing is all about proactive maintenance. You don’t want to wait for a failure to happen—you want to catch issues before they cause downtime, safety hazards, or expensive repairs. The resolution of your insulation tester is one of the most important factors in that proactive approach. A tester with good resolution lets you track subtle changes in insulation resistance over time, create a trend that tells you when insulation is degrading, and plan maintenance accordingly.
If you’re currently using an insulation tester that’s old, or you’re noticing that you’re missing small changes in your insulation readings, it might be time to upgrade. We’ve helped hundreds of utilities and industrial companies across different industries select the right high voltage insulation testers for their needs, and we’re always here to answer questions about specs, applications, or how to interpret your test data. If you’d like to talk through your requirements, get more information about our testers, or start planning a purchase for your team, please reach out to our sales team to discuss your needs. We’re here to help you make sure your equipment stays reliable, your team stays safe, and your operations run smoothly.
Transformer Cooling Control Cabinet References
- IEEE Std 95-2018, IEEE Guide for Insulation Resistance Testing of Rotating Electric Machinery
- International Electrotechnical Commission (IEC) 60156:2018, High-voltage test techniques – Insulation resistance measurements and other quantitative test methods
- NETA (InterNational Electrical Testing Association) Maintenance and Testing Standards, 7th Edition, 2022
- Crane, F. A., Electrical Insulation for Rotating Machines: Design, Evaluation, Aging, Testing, and Repair, 2nd Edition, Wiley-IEEE Press, 2014
Baoding Shangwei Electric Technology Co., Ltd.
We are one of the most professional high voltage insulation tester manufacturers and suppliers in China, also support customized service. We warmly welcome you to buy durable high voltage insulation tester at competitive price from our factory. If you have any enquiry about quotation, please feel free to email us.
Address: Building 6, Baoding Zhongguancun Digital Economy Industrial Park, No. 777 Lixing Street, Baoding City, Hebei Province, China
E-mail: wendylu@swspower.com
WebSite: https://www.swspower.com/
