diff options
author | H.J. Lu <hjl.tools@gmail.com> | 2017-06-09 05:45:43 -0700 |
---|---|---|
committer | H.J. Lu <hjl.tools@gmail.com> | 2017-06-09 05:45:52 -0700 |
commit | d2538b91568af2a63c9d8649ce11756d4dfbdac3 (patch) | |
tree | 22cc8602e6ab159f296651224be8a6c3460f2581 /sysdeps/x86_64/multiarch/strrchr-sse2.S | |
parent | 5ac7aa1d7cce8580f8225c33c819991abca102b9 (diff) | |
download | glibc-d2538b91568af2a63c9d8649ce11756d4dfbdac3.tar.gz glibc-d2538b91568af2a63c9d8649ce11756d4dfbdac3.tar.xz glibc-d2538b91568af2a63c9d8649ce11756d4dfbdac3.zip |
x86-64: Optimize strrchr/wcsrchr with AVX2
Optimize strrchr/wcsrchr with AVX2 to check 32 bytes with vector instructions. It is as fast as SSE2 version for small data sizes and up to 1X faster for large data sizes on Haswell. Select AVX2 version on AVX2 machines where vzeroupper is preferred and AVX unaligned load is fast. * sysdeps/x86_64/multiarch/Makefile (sysdep_routines): Add strrchr-sse2, strrchr-avx2, wcsrchr-sse2 and wcsrchr-avx2. * sysdeps/x86_64/multiarch/ifunc-impl-list.c (__libc_ifunc_impl_list): Add tests for __strrchr_avx2, __strrchr_sse2, __wcsrchr_avx2 and __wcsrchr_sse2. * sysdeps/x86_64/multiarch/strrchr-avx2.S: New file. * sysdeps/x86_64/multiarch/strrchr-sse2.S: Likewise. * sysdeps/x86_64/multiarch/strrchr.c: Likewise. * sysdeps/x86_64/multiarch/wcsrchr-avx2.S: Likewise. * sysdeps/x86_64/multiarch/wcsrchr-sse2.S: Likewise. * sysdeps/x86_64/multiarch/wcsrchr.c: Likewise.
Diffstat (limited to 'sysdeps/x86_64/multiarch/strrchr-sse2.S')
-rw-r--r-- | sysdeps/x86_64/multiarch/strrchr-sse2.S | 28 |
1 files changed, 28 insertions, 0 deletions
diff --git a/sysdeps/x86_64/multiarch/strrchr-sse2.S b/sysdeps/x86_64/multiarch/strrchr-sse2.S new file mode 100644 index 0000000000..6479d17915 --- /dev/null +++ b/sysdeps/x86_64/multiarch/strrchr-sse2.S @@ -0,0 +1,28 @@ +/* strrchr optimized with SSE2. + Copyright (C) 2017 Free Software Foundation, Inc. + This file is part of the GNU C Library. + + The GNU C Library is free software; you can redistribute it and/or + modify it under the terms of the GNU Lesser General Public + License as published by the Free Software Foundation; either + version 2.1 of the License, or (at your option) any later version. + + The GNU C Library is distributed in the hope that it will be useful, + but WITHOUT ANY WARRANTY; without even the implied warranty of + MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU + Lesser General Public License for more details. + + You should have received a copy of the GNU Lesser General Public + License along with the GNU C Library; if not, see + <http://www.gnu.org/licenses/>. */ + +#if IS_IN (libc) +# define strrchr __strrchr_sse2 + +# undef weak_alias +# define weak_alias(strrchr, rindex) +# undef libc_hidden_builtin_def +# define libc_hidden_builtin_def(strrchr) +#endif + +#include "../strrchr.S" |