about summary refs log tree commit diff
path: root/sysdeps/x86_64/memcmpeq.S
diff options
context:
space:
mode:
authorNoah Goldstein <goldstein.w.n@gmail.com>2022-06-29 16:11:22 -0700
committerNoah Goldstein <goldstein.w.n@gmail.com>2022-07-05 16:42:42 -0700
commitae308947ff0fa950431d53bcc90c875295d57715 (patch)
treed14ede08a3dae637cdd57410d42e3dcf00624e2c /sysdeps/x86_64/memcmpeq.S
parent37ecc657b22c3367a56df5ebd53908e34e65fa16 (diff)
downloadglibc-ae308947ff0fa950431d53bcc90c875295d57715.tar.gz
glibc-ae308947ff0fa950431d53bcc90c875295d57715.tar.xz
glibc-ae308947ff0fa950431d53bcc90c875295d57715.zip
x86: Add support for building {w}memcmp{eq} with explicit ISA level
1. Refactor files so that all implementations are in the multiarch
   directory
    - Moved the implementation portion of memcmp sse2 from memcmp.S to
      multiarch/memcmp-sse2.S

    - The non-multiarch file now only includes one of the
      implementations in the multiarch directory based on the compiled
      ISA level (only used for non-multiarch builds.  Otherwise we go
      through the ifunc selector).

2. Add ISA level build guards to different implementations.
    - I.e memcmp-avx2-movsb.S which is ISA level 3 will only build if
      compiled ISA level <= 3. Otherwise there is no reason to include
      it as we will always use one of the ISA level 4
      implementations (memcmp-evex-movbe.S).

3. Add new multiarch/rtld-{w}memcmp{eq}.S that just include the
   non-multiarch {w}memcmp{eq}.S which will in turn select the best
   implementation based on the compiled ISA level.

4. Refactor the ifunc selector and ifunc implementation list to use
   the ISA level aware wrapper macros that allow functions below the
   compiled ISA level (with a guranteed replacement) to be skipped.

Tested with and without multiarch on x86_64 for ISA levels:
{generic, x86-64-v2, x86-64-v3, x86-64-v4}

And m32 with and without multiarch.
Diffstat (limited to 'sysdeps/x86_64/memcmpeq.S')
-rw-r--r--sysdeps/x86_64/memcmpeq.S14
1 files changed, 10 insertions, 4 deletions
diff --git a/sysdeps/x86_64/memcmpeq.S b/sysdeps/x86_64/memcmpeq.S
index 80c5e912a6..d1e47e0539 100644
--- a/sysdeps/x86_64/memcmpeq.S
+++ b/sysdeps/x86_64/memcmpeq.S
@@ -1,4 +1,4 @@
-/* __memcmpeq optimized with SSE2.
+/* __memcmpeq hook for non-multiarch and RTLD build.
    Copyright (C) 2017-2022 Free Software Foundation, Inc.
    This file is part of the GNU C Library.
 
@@ -16,6 +16,12 @@
    License along with the GNU C Library; if not, see
    <https://www.gnu.org/licenses/>.  */
 
-#define MEMCMP	__memcmpeq
-#define USE_AS_MEMCMPEQ	1
-#include "multiarch/memcmp-sse2.S"
+#define MEMCMPEQ	__memcmpeq
+
+#define DEFAULT_IMPL_V1	"multiarch/memcmpeq-sse2.S"
+#define DEFAULT_IMPL_V3	"multiarch/memcmpeq-avx2.S"
+#define DEFAULT_IMPL_V4	"multiarch/memcmpeq-evex.S"
+
+#include "isa-default-impl.h"
+
+libc_hidden_def(__memcmpeq)