about summary refs log tree commit diff
diff options
context:
space:
mode:
authorNaohiro Tamura <naohirot@fujitsu.com>2021-08-27 05:03:04 +0000
committerSzabolcs Nagy <szabolcs.nagy@arm.com>2021-09-06 10:23:24 +0100
commit1d9f99ce1b3788d1897cb53a76d57e973111b8fe (patch)
tree684c81cc6e88650313797fadaa642d714fcce8a8
parentf873adf3df443f8d302677f963adcc3c22187e68 (diff)
downloadglibc-1d9f99ce1b3788d1897cb53a76d57e973111b8fe.tar.gz
glibc-1d9f99ce1b3788d1897cb53a76d57e973111b8fe.tar.xz
glibc-1d9f99ce1b3788d1897cb53a76d57e973111b8fe.zip
AArch64: Update A64FX memset not to degrade at 16KB
This patch updates unroll8 code so as not to degrade at the peak
performance 16KB for both FX1000 and FX700.

Inserted 2 instructions at the beginning of the unroll8 loop,
cmp and branch, are a workaround that is found heuristically.

Reviewed-by: Wilco Dijkstra <Wilco.Dijkstra@arm.com>
-rw-r--r--sysdeps/aarch64/multiarch/memset_a64fx.S9
1 files changed, 8 insertions, 1 deletions
diff --git a/sysdeps/aarch64/multiarch/memset_a64fx.S b/sysdeps/aarch64/multiarch/memset_a64fx.S
index 7bf759b6a7..f7dfdaace7 100644
--- a/sysdeps/aarch64/multiarch/memset_a64fx.S
+++ b/sysdeps/aarch64/multiarch/memset_a64fx.S
@@ -96,7 +96,14 @@ L(vl_agnostic): // VL Agnostic
 L(unroll8):
 	sub	count, count, tmp1
 	.p2align 4
-1:	st1b_unroll 0, 7
+	// The 2 instructions at the beginning of the following loop,
+	// cmp and branch, are a workaround so as not to degrade at
+	// the peak performance 16KB.
+	// It is found heuristically and the branch condition, b.ne,
+	// is chosen intentionally never to jump.
+1:	cmp	xzr, xzr
+	b.ne	1b
+	st1b_unroll 0, 7
 	add	dst, dst, tmp1
 	subs	count, count, tmp1
 	b.hi	1b