summary refs log tree commit diff
path: root/stdlib/atoll.c
diff options
context:
space:
mode:
authorJoseph Myers <joseph@codesourcery.com>2020-06-30 23:04:06 +0000
committerJoseph Myers <joseph@codesourcery.com>2020-06-30 23:04:06 +0000
commit09555b9721d090f7917f8221be2613a4d6a9b0f6 (patch)
treeabf1d8e3d22a0e111e882dc7954d36dec847e19a /stdlib/atoll.c
parent5f40e4b1ba69a22923f6ec692d2d0f65733ccb0b (diff)
downloadglibc-09555b9721d090f7917f8221be2613a4d6a9b0f6.tar.gz
glibc-09555b9721d090f7917f8221be2613a4d6a9b0f6.tar.xz
glibc-09555b9721d090f7917f8221be2613a4d6a9b0f6.zip
Fix strtod multiple-precision division bug (bug 26137).
Bug 26137 reports spurious "inexact" exceptions from strtod, on 32-bit
systems only, for a decimal argument that is exactly 1 + 2^-32.  In
fact the same issue also appears for 1 + 2^-64 and 1 + 2^-96 as
arguments to strtof128 on 32-bit systems, and 1 + 2^-64 as an argument
to strtof128 on 64-bit systems.  In FE_DOWNWARD or FE_TOWARDZERO mode,
the return value is also incorrect.

The problem is in the multiple-precision division logic used in the
case of dividing by a denominator that occupies at least three GMP
limbs.  There was a comment "The division does not work if the upper
limb of the two-limb mumerator is greater than the denominator.", but
in fact there were problems for the case of equality (that is, where
the high limbs are equal, offset by some multiple of the GMP limb
size) as well.  In such cases, the code used "quot = ~(mp_limb_t) 0;"
(with subsequent correction if that is an overestimate), because
udiv_qrnnd does not support the case of equality, but it's possible
for the shifted numerator to be greater than or equal to the
denominator, in which case that is an underestimate.  To avoid that,
this patch changes the ">" condition to ">=", meaning the first
division is done with a zero high word.

The tests added are all 1 + 2^-n for n from 1 to 113 except for those
that were already present in tst-strtod-round-data.

Tested for x86_64 and x86.
Diffstat (limited to 'stdlib/atoll.c')
0 files changed, 0 insertions, 0 deletions