navitron
 
Renewable Energy and Sustainability Forum
UK's most popular Renewable Energy Forum May 24, 2012, 12:11:28 AM *
Welcome, Guest. Please login or register.

Login with username, password and session length
News: Anyone wishing to register as a new member on the forum is strongly recommended to use a "proper" email address - following recent spam/hack attempts on the forum, all security is set to "high", and "disposable" email addresses like Gmail, Yahoo and Hotmail tend to be viewed with suspicion, and the application rejected if there is any doubt whatsoever
 
Recent Articles: UPDATE ON DECC APPLICATION FOR LEAVE TO APPEAL TO THE SUPREME COURT | Yingli Green Energy's PV Module Ranks No.2 in TUV Rheinland Energy Yield Test | Navitron Solar Showers at Glastonbury for Year 5!
   Home   Help Search Login Register  
Pages: [1] 2   Go Down
  Print  
Author Topic: Measurement errors.  (Read 2355 times)
Ivan
Administrator
Hero Member
*****
Offline Offline

Posts: 1221


« on: February 08, 2011, 01:53:34 AM »

Firstly, I am not a mathematician. If someone like St.B, with much greater mathematical ability than I, would compile a more informed version of this post, I'd be very grateful

First point: Nothing is absolute. All measurements have errors. Some measuring devices (usually expensive, cumbersome and large) have extremely small errors. Some (usually cheap, small , simple) have much larger errors. The endless advance of technology usually means that cheaper, simpler, more accurate measurement devices supercede  older designs.

Second point: Not all errors are equal.

Third point: It's important to distinguish between accuracy and precision. Both are important but very different. The layman usually uses these terms indiscriminately, and thus causes confusion to himself and others

Accuracy

First we have absolute errors in measurements. These are errors caused by incorrect calibration. An inaccurate reading will always be inaccurate, regardless of how many times the reading is taken. Every reading will have an absolute error to a certain extent. These errors relate to ACCURACY. Readings which are consistently high or consistently low are known as INACCURATE readings. Scientists, and manufacturers of measurement devices often define the extent of inaccuracy. Inaccuracy is often the effect of manufacturer quality control. For example, a thermometer manufacturer may state that a particular type of thermometer is +/- 2% accuracy. Meaning that the reading may be consistently high or low to an extent equivalent to no more than 2%. The manufacturer's spec is usually based on a statistical (yawn!) sampling method, and might, for instance indicate that 95% of all the products will conform to the range indicated (but a large proportion, eg 50% may be much more accurate).

Accuracy errors may be generated by 1)manufacturer's tolerance ie the measuring equipment 2)method in which the equipment is employed/installed 3)environmental effects (eg variations in temperature/pressure/humidity/light levels/vibration levels etc may affect the accuracy of the sensor/measuring device).

Therefore, accuracy errors are not necessarily constant, merely constant under a standard set of conditions.

Measurement accuracy depends entirely on the accuracy of the instrument calibration. I like to think of everything being as simple as a straight line graph - defined by the equation y=(m * x) + c. There are two areas for inaccuracy in this equation. The multiplier 'm' and the constant 'c'. If the multiplier is not 100% accurate, then the calibration line will deviate from the true reading. If the slope of the lines (true reading vs calibration) do not match perfectly, then the higher the reading, the greater the level of inaccuracy. So high readings will be inaccurate, whereas low readings will be relatively much more accurate, even if the error in the slope (m) is quite large. Conversely, errors in the constant 'c' will make very little difference with high readings, so as to become almost negligible. However, at low readings, any error in 'c' turns into a large error in the accuracy of the reading. So if you are measuring temperature, and you have an error of 1C in the 'c' constant, then (assuming the slope m is perfectly calibrated), you will have a 1% error in a reading of 100C, a 10% error in a reading of 10C, a 100% error in a reading of 1C and a 1000% error in a reading of 0.1C!

Precision
Precision is usually of much more interest to scientists. It is basically a measure of reproducibility. If you take 10 measurements of the same thing, you would expect to have 10 identical readings. In practice, you will not. There are many effects - eg noise which affect the reproducibility of the reading. This variation is known as Precision. A very good measuring instrument has very high levels of Precision. High levels of Precision lead to a high level of confidence in the readings. A low level of Precision correspondingly leads to a low level of confidence. However, here's the weird thing about Precision. The more readings you take, the more reliable the average becomes. So it is common in sensitive scientific experiments to compensate for limitations of measurement precision by taking multiple readings. For very tiny measurements, scientists sometimes average the results from hundreds or millions of readings to get a meaningful result. The study of precision is very much in the realm of statistics (yawn), so best left to mathematicians and scientists.

Precision and Accuracy errors may vary across the measurement range
In fact, they usually do. For example, a voltmeter may read from 0 - 100V. If you read a voltage of 20V, you may get a reading of 20.1V on one occasion, 20.0V on another and 19.9V on another occasion - The accuracy would be spot on, whereas precision is far from perfect. However, precision is directly related to another concept - background noise. The higher the level of background noise, or to put it another way, the closer the reading is to background noise, the worse the precision.

Background Noise
As you try to take ever-smaller readings, eventually, your readings will descend into the background noise. Instruments (and the design of the set of conditions under which the readings are taken) will dictate at what level the readings become meaningless,as they are overwhelmed by background noise. Highly sensitive scientific equipment is often cooled to very low temperatures to minimise the effects of thermal noise (often on the electronics of the instrument), thus achieving a much higher level of sensitivity than conventional instruments. It is often possible to make meaningful readings of very weak signals by taking many readings thus improving the precision.

Limit of Sensitivity

For any instrument, there exists a useful range throughout which readings can be taken. Most measuring instruments demonstrate working ranges of 2 - 3 decades of measurement. In the past, I have worked with instruments that were able to respond linearly to 6 decades of measurement - something quite unusual. At the lower end of the measurement range we reach a level where the signal disappears into the sea of background noise. This is known as the limit of sensitivity.

Precision Profiles

If you were to take many readings of a variety of measurements across an instrument's working range, you could empirically calculate the precision at different levels. You can also calculate precision using some fairly tedious mathematics (to me, anyway). Precision profiles seem mainly to be of interest to medical professionals - I guess this is because typically there is an inherently low level of precision in the measurements they tend to make, however the concept is valid for all measuring instruments, and is extremely revealing. It also explains why readings can be very misleading at the low end of the working range, even for relatively accurate/precise insturments. Here's a typical precision profile. Note that if as the curve is extrapolated to zero, the precision tends to infinity.


And if you choose to ignore everything above, at least remember this one: Errors multiply and accumulate ('compound')
If you have make a measurement which has a number of areas where errors may be introduced, then these errors multiply. For example, you may be measuring a temperature using a thermocouple attached to a pipe.

Error caused by poor thermal contact with pipe = 10%
Quantum error in the voltage generated by the thermocouple = 1%
Error caused by unaccounted-for resistance of cable = 5%
Calibration error of instrument reading the sensor = 10%
Precision error of reading = 5%

All relatively low errors, but the total (compounded) error of the reading is 34.7% (ie 1.10 x 1.01 x 1.05 x 1.10 x 1.05) (NB See St.B's comments below - I've got this slightly wrong)

Significant Figures
Scientifically, it is normal to state your errors when stating a measurement eg 100V +/- 1%. It is also conventional to write readings in a manner which suggests their level of confidence. eg 106V (written to three significant figures) would suggest an error not exceeding +/-1V, but a reading of 106.000V (six significant figures) would suggest that it is measured to a confidence of a thousandth of a Volt.








« Last Edit: February 10, 2011, 10:13:54 PM by Ivan » Logged

Navitron Member of Staff
www.epogee.co.uk - Solar PV & Solar Thermal Training / MCS
Billy
Hero Member
*****
Offline Offline

Posts: 1358



WWW
« Reply #1 on: February 08, 2011, 08:33:55 AM »

Ivan, thanks for that.

Well put and easy to understand.

Here's hoping,

billy

 Grin Grin Grin
Logged

Navitron 24vx300watt windy thing, 20x47mm toobs,24v Rolls @458ah C5, Victron MultiPlus 3kw inverter/charger, WBS with boiler.
StBarnabas
Hero Member
*****
Offline Offline

Posts: 2111


St Barnabas Chapel (2009)


« Reply #2 on: February 08, 2011, 09:05:24 AM »

Ivan
thanks for this generally V. Good. I will try to put something together when I have a bit of time.
StB
Logged


Gestis Censere. 40x47mm DHW with TDC3. 3kW ASHP, 9kW GSHP, 3kW Navitron PV with Platinum 3100S GTI, 6.5kW WBS, 5 chickens. FMY 2009.
djh
Hero Member
*****
Offline Offline

Posts: 1222


« Reply #3 on: February 08, 2011, 10:37:56 AM »

As ever, wikipedia has a view: http://en.wikipedia.org/wiki/Accuracy
Logged

Cheers, Dave
StBarnabas
Hero Member
*****
Offline Offline

Posts: 2111


St Barnabas Chapel (2009)


« Reply #4 on: February 08, 2011, 11:05:07 AM »

One of my favourite measurement jokes...

When visiting the natural history recently I was surprised by the assertion that a particular dinosaur skeleton was 55 million years and three months old.
“That is amazing” I said how can you be so precise in your dating of the skeleton? Simple the museum, attendant said “exactly three months ago we head the greatest dinosaur specialist in the world who dated the bone to 75 million years ago.” 
Logged


Gestis Censere. 40x47mm DHW with TDC3. 3kW ASHP, 9kW GSHP, 3kW Navitron PV with Platinum 3100S GTI, 6.5kW WBS, 5 chickens. FMY 2009.
Billy
Hero Member
*****
Offline Offline

Posts: 1358



WWW
« Reply #5 on: February 08, 2011, 11:28:34 AM »

Sean lol and you introducing another 20 million into the bargain or is it a trick facepalm

billy

 Grin Grin Grin
Logged

Navitron 24vx300watt windy thing, 20x47mm toobs,24v Rolls @458ah C5, Victron MultiPlus 3kw inverter/charger, WBS with boiler.
biff
Hero Member
*****
Offline Offline

Posts: 2547



« Reply #6 on: February 08, 2011, 12:07:33 PM »

going from metric to imperial, whistlie
Logged
StBarnabas
Hero Member
*****
Offline Offline

Posts: 2111


St Barnabas Chapel (2009)


« Reply #7 on: February 08, 2011, 12:39:42 PM »

Oh
and now can't edit! Never mind you get the gist of the joke I hope.

On a more serious topic if the errors are normally distributed and non correlated then errors add in quadrature. Two 1% errors will give a 1.414% error (square root of two) rather than Ivan's compounding method.  sqrt(a^2 +b^2)


 
Logged


Gestis Censere. 40x47mm DHW with TDC3. 3kW ASHP, 9kW GSHP, 3kW Navitron PV with Platinum 3100S GTI, 6.5kW WBS, 5 chickens. FMY 2009.
JohnS
Hero Member
*****
Offline Offline

Posts: 898


« Reply #8 on: February 08, 2011, 01:48:03 PM »

So if you are measuring temperature, and you have an error of 1C in the 'c' constant, then (assuming the slope m is perfectly calibrated), you will have a 1% error in a reading of 100C, a 10% error in a reading of 10C, a 100% error in a reading of 1C and a 1000% error in a reading of 0.1C!


You will get different percentage accuracy using the Kelvin scale !!

If you take a mercury thermometer and put slightly too much or too little mercury in it, it will over or under read.  Ignoring second order effects, the over or under amount will be constant for each thermometer.  In many cases, repeatability is more important than absolute accuracy. 

Logged

2.1kWp solar PV
EccentricAnomaly
Guest
« Reply #9 on: February 08, 2011, 03:24:23 PM »

In another thread:

For example if the true value is 9.5 but your instrument only reads 9 or 10 then over time readings will be distributed in proportion to the actual value. This is not fanciful, over the years I have calibrated multimillion pound satellites (there's no second chance after launch) and life saving equipment with such techniques.

It doesn't have to be over much time, as I pointed out to stephendv the other day.

In general, quantization error is another source of problems which Ivan doesn't mention and which need some consideration.
Logged
StBarnabas
Hero Member
*****
Offline Offline

Posts: 2111


St Barnabas Chapel (2009)


« Reply #10 on: February 08, 2011, 05:42:10 PM »

EA
you are right, but I disagree a bit regarding ADCs. The ADCs on PICs and Arduinos are typicall 10 bit. yielding 1014 possible values -- slightly better than 0.1% precision. It is most unlikely that this will dominate in a measurement system. Also I'm not sure about the Arduinos bot with the newer PICs you can set VREF+ and VREF- hence narrowing the range. My own experience with my Twin ADC HalfBee PIC (72p) is that there is jitter in the bottom three bits probably caused by pickup. Should sort this out but not a major issue as I tend to smooth anyway and despite my very expensive Kipp and Zonen  SPLITE irradiance sensor claiming to be accurate to within about 2%  I regularly get reading of above 1kW/m^2

Regarding jittering the least significant bit I agree 100%. This is a very common "trick."

Baz I was involved in the calibration of the ESA MERIS instrument http://en.wikipedia.org/wiki/MERIS so small world as they say!
Logged


Gestis Censere. 40x47mm DHW with TDC3. 3kW ASHP, 9kW GSHP, 3kW Navitron PV with Platinum 3100S GTI, 6.5kW WBS, 5 chickens. FMY 2009.
EccentricAnomaly
Guest
« Reply #11 on: February 08, 2011, 07:11:09 PM »

...yielding 1014 possible values...

1024, a typo I assume.

Quote
Also I'm not sure about the Arduinos bot with the newer PICs you can set VREF+ and VREF- hence narrowing the range.

Arduinos have various options for VREF+ but, as far as I know, the bottom end of the range is always zero volts.
Logged
StBarnabas
Hero Member
*****
Offline Offline

Posts: 2111


St Barnabas Chapel (2009)


« Reply #12 on: February 08, 2011, 09:27:42 PM »

...yielding 1014 possible values...

1024, a typo I assume.

Quote


Also I'm not sure about the Arduinos bot with the newer PICs you can set VREF+ and VREF- hence narrowing the range.

Arduinos have various options for VREF+ but, as far as I know, the bottom end of the range is always zero volts.

1) Absolutely 1024. The limit on revising typo's has been reduced to nearly zero: 15 minutes? I was sure I typed in 1024 but I get snatched moments looking at the forum these days. I very seldom have the luxury of being able to proof read. I used to rely on going back in the next few days to clear up typos. The fact that I an dyslexic does not help either.....

2) I am more worried about Vref+. For my own system I am using the +5V generated from the PC as a reference. What checks I have done with better instrumentation  it looks good within about 1% but I should more checks on ripple. My amplifier chain is set by high precision resistors but even then there is a 1% compounded error.
Logged


Gestis Censere. 40x47mm DHW with TDC3. 3kW ASHP, 9kW GSHP, 3kW Navitron PV with Platinum 3100S GTI, 6.5kW WBS, 5 chickens. FMY 2009.
Jonathan
Guest
« Reply #13 on: February 09, 2011, 11:49:06 AM »

The removal of the facility for editing was directly driven by the mis-behaviour of one individual. He has now gone, left the building etc. etc. Other than him, no one else I know of abused the facility for re-writing history, but only used it for correcting minor errors or adding clarification.

Is it time we re-instated the edit facility?

IMHO
Logged
Robl
Newbie
*
Online Online

Posts: 21


« Reply #14 on: February 09, 2011, 02:00:53 PM »

Thermocouples are always in fact fundamentally differential measurements.  They have to be.  There's a welded thermocouple joint where you want to measure a temperature, with dissimilar metals coming from it in a twisted pair all the way, through  a "K type" plug often, into the meter/logger, where there will be two more junctions to a copper pcb.  The K plug/socket is actually dissimilar metals too (the "chromel" side is magnetic, other not - try it).  Ultimately, the round trip is copper-chromel-alumel-copper. 
The multimeter/logger then has to use an internal absolute temperature reference, to "cold junction compensate" for the temperature where the dissimilar metals couple to the pcb.
To find the temperature of the welded thermocouple, the meter adds the temperature of this internal reference to the difference measurement the thermocouples give.

Having this cold reference is a source of errors - it has to be physically near the point on the pcb where the dissimilar metals connect, to get the answer right.  Any fluctuation in the meter temp, will briefly change the answer as the time constants won't match up.  Absolute temperature sensing accurately is expensive (A PT100 platinum resistor is £2 even in volume, so I imagine anything <£100 won't use one), so inexpensive meters will not do as good a job as expensive ones.  The temperature that they think the thermocouple is at will vary dependent on the meter temperature itself.
Also, as the signal is very small, it will be subject to many noise sources.  The cheapest electronic components will suffer significant 1/f  or "flicker" noise, which will produce yet more error, on a slow timescale.

Most of the time cheap meters are fine.  But measuring TempA and TempB with different circuits, and manually subtracting them to give A-B is not to be taken lightly, if you want <4C accuracy.

For super accurate differential measurements, I would use a single reel of thermocouple wire, chop it up & weld it to make 2 identical thermocouples - or buy them pre-made as matched pairs.  Then use a differential thermocouple amplifier - basically a precision multimeter with the correct gain.  This way the cold junction problem is avoided, and the metals in the junctions is identical.   

Interesting paper here, where they used multiple differential thermocouples, to get the voltage out higher and give 0.01C accuracy:
http://mmto.org/MMTpapers/pdfs/ctm/ctm99-2.pdf

hope it helps someone ! Wink
Logged
Pages: [1] 2   Go Up
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.16 | SMF © 2011, Simple Machines Valid XHTML 1.0! Valid CSS!