Open Access

Table 7

Error on k in pcm after lossy compression by truncated HT on the MOX dataset with separate matrices M per nuclide and reaction.

τ μ P5 P50 Mean P95 max tail
1.0e−01 97.42 −641.367 −384.974 −343.453 −228.370 −796.313
1.0e−02 97.37 +27.412 +49.085 +51.710 +68.203 +78.249
1.0e−03 95.99 +27.650 +50.005 +52.135 +70.868 +81.429
1.0e−04 95.08 −12.033 +0.223 +1.337 +8.534 −14.812
1.0e−05 94.33 −11.172 −0.403 +1.176 +6.422 −11.946
1.0e−06 91.11 −0.688 −0.104 −0.274 +1.015 +1.924
1.0e−07 88.56 −0.460 −0.024 −0.063 +0.561 +0.944
1.0e−08 84.54 −0.557 −0.008 +0.074 +0.408 −0.717