Changes in numa_memblks.h

63db8170 - mm/fake-numa: allow later numa node hotplug

Mon, 06 Jan 2025 12:06:59 +0000

mm/fake-numa: allow later numa node hotplugCurrent fake-numa implementation prevents new Numa nodes to be laterhot-plugged by drivers. A common symptom of this limitation is the "node was absent from the node_possible_map" message by associated warningin mm/memory_hotplug.c: add_memory_resource().This comes from the lack of remapping in both pxm_to_node_map[] andnode_to_pxm_map[] tables to take fake-numa nodes into account and thustriggers collisions with original and physical nodes only-mapping that hadbeen determined from BIOS tables.This patch fixes this by doing the necessary node-ids translation in bothpxm_to_node_map[]/node_to_pxm_map[] tables. node_distance[] table hasalso been fixed accordingly.Details:When trying to use fake-numa feature on our system where new Numa nodesare being "hot-plugged" upon driver load, this fails with the followingtype of message and warning with stack :node 8 was absent from the node_possible_map WARNING: CPU: 61 PID: 4259 atmm/memory_hotplug.c:1506 add_memory_resource+0x3dc/0x418This issue prevents the use of the fake-NUMA debug feature with thesystem's full configuration, when it has proven to be sometimes extremelyuseful for performance testing of multi-tasked, memory-bound applications,as it enables better isolation of processes/ranks compared to fat NUMAnodes.Usual numactl output after driver has “hot-plugged”/unveiled somenew Numa nodes with and without memory :$ numactl --hardwareavailable: 9 nodes (0-8)node 0 cpus: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 2021 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 4243 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 6465 66 67 68 69 70 71node 0 size: 490037 MBnode 0 free: 484432 MBnode 1 cpus:node 1 size: 97280 MBnode 1 free: 97279 MBnode 2 cpus:node 2 size: 0 MBnode 2 free: 0 MBnode 3 cpus:node 3 size: 0 MBnode 3 free: 0 MBnode 4 cpus:node 4 size: 0 MBnode 4 free: 0 MBnode 5 cpus:node 5 size: 0 MBnode 5 free: 0 MBnode 6 cpus:node 6 size: 0 MBnode 6 free: 0 MBnode 7 cpus:node 7 size: 0 MBnode 7 free: 0 MBnode 8 cpus:node 8 size: 0 MBnode 8 free: 0 MBnode distances:node 0 1 2 3 4 5 6 7 8 0: 10 80 80 80 80 80 80 80 80 1: 80 10 255 255 255 255 255 255 255 2: 80 255 10 255 255 255 255 255 255 3: 80 255 255 10 255 255 255 255 255 4: 80 255 255 255 10 255 255 255 255 5: 80 255 255 255 255 10 255 255 255 6: 80 255 255 255 255 255 10 255 255 7: 80 255 255 255 255 255 255 10 255 8: 80 255 255 255 255 255 255 255 10With recent M.Rapoport set of fake-numa patches in mm-everythingand using numa=fake=4 boot parameter :$ numactl --hardwareavailable: 4 nodes (0-3)node 0 cpus: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 2021 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 4243 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 6465 66 67 68 69 70 71node 0 size: 122518 MBnode 0 free: 117141 MBnode 1 cpus: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 2021 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 4243 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 6465 66 67 68 69 70 71node 1 size: 219911 MBnode 1 free: 219751 MBnode 2 cpus: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 2021 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 4243 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 6465 66 67 68 69 70 71node 2 size: 122599 MBnode 2 free: 122541 MBnode 3 cpus: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 2021 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 4243 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 6465 66 67 68 69 70 71node 3 size: 122479 MBnode 3 free: 122408 MBnode distances:node 0 1 2 3 0: 10 10 10 10 1: 10 10 10 10 2: 10 10 10 10 3: 10 10 10 10With recent M.Rapoport set of fake-numa patches in mm-everything,this patch on top, using numa=fake=4 boot parameter :# numactl —hardwareavailable: 12 nodes (0-11)node 0 cpus: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 2021 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 4243 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 6465 66 67 68 69 70 71node 0 size: 122518 MBnode 0 free: 116429 MBnode 1 cpus: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 2021 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 4243 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 6465 66 67 68 69 70 71node 1 size: 122631 MBnode 1 free: 122576 MBnode 2 cpus: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 2021 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 4243 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 6465 66 67 68 69 70 71node 2 size: 122599 MBnode 2 free: 122544 MBnode 3 cpus: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 2021 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 4243 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 6465 66 67 68 69 70 71node 3 size: 122479 MBnode 3 free: 122419 MBnode 4 cpus:node 4 size: 97280 MBnode 4 free: 97279 MBnode 5 cpus:node 5 size: 0 MBnode 5 free: 0 MBnode 6 cpus:node 6 size: 0 MBnode 6 free: 0 MBnode 7 cpus:node 7 size: 0 MBnode 7 free: 0 MBnode 8 cpus:node 8 size: 0 MBnode 8 free: 0 MBnode 9 cpus:node 9 size: 0 MBnode 9 free: 0 MBnode 10 cpus:node 10 size: 0 MBnode 10 free: 0 MBnode 11 cpus:node 11 size: 0 MBnode 11 free: 0 MBnode distances:node 0 1 2 3 4 5 6 7 8 9 10 11 0: 10 10 10 10 80 80 80 80 80 80 80 80 1: 10 10 10 10 80 80 80 80 80 80 80 80 2: 10 10 10 10 80 80 80 80 80 80 80 80 3: 10 10 10 10 80 80 80 80 80 80 80 80 4: 80 80 80 80 10 255 255 255 255 255 255 255 5: 80 80 80 80 255 10 255 255 255 255 255 255 6: 80 80 80 80 255 255 10 255 255 255 255 255 7: 80 80 80 80 255 255 255 10 255 255 255 255 8: 80 80 80 80 255 255 255 255 10 255 255 255 9: 80 80 80 80 255 255 255 255 255 10 255 255 10: 80 80 80 80 255 255 255 255 255 255 10 255 11: 80 80 80 80 255 255 255 255 255 255 255 10Link: https://lkml.kernel.org/r/20250106120659.359610-2-bfaccini@nvidia.comSigned-off-by: Bruno Faccini Cc: David Hildenbrand Cc: John Hubbard Cc: Mike Rapoport (Microsoft) Cc: Zi Yan Signed-off-by: Andrew Morton List of files: /linux-6.15/include/linux/numa_memblks.h

1b5695b0 - mm: make range-to-target_node lookup facility a part of numa_memblks

Wed, 07 Aug 2024 06:41:09 +0000

mm: make range-to-target_node lookup facility a part of numa_memblksThe x86 implementation of range-to-target_node lookup (i.e. phys_to_target_node() and memory_add_physaddr_to_nid()) relies onnuma_memblks.Since numa_memblks are now part of the generic code, move these functionsfrom x86 to mm/numa_memblks.c and select CONFIG_NUMA_KEEP_MEMINFO whenCONFIG_NUMA_MEMBLKS=y for dax and cxl.[rppt@kernel.org: fix build] Link: https://lkml.kernel.org/r/ZtVfSt_zloPdDqVB@kernel.orgLink: https://lkml.kernel.org/r/20240807064110.1003856-26-rppt@kernel.orgSigned-off-by: Mike Rapoport (Microsoft) Reviewed-by: Jonathan Cameron Tested-by: Zi Yan # for x86_64 and arm64Tested-by: Jonathan Cameron [arm64 + CXL via QEMU]Reviewed-by: Dan Williams Acked-by: David Hildenbrand Cc: Alexander Gordeev Cc: Andreas Larsson Cc: Arnd Bergmann Cc: Borislav Petkov Cc: Catalin Marinas Cc: Christophe Leroy Cc: Dave Hansen Cc: Davidlohr Bueso Cc: David S. Miller Cc: Greg Kroah-Hartman Cc: Heiko Carstens Cc: Huacai Chen Cc: Ingo Molnar Cc: Jiaxun Yang Cc: John Paul Adrian Glaubitz Cc: Jonathan Corbet Cc: Michael Ellerman Cc: Palmer Dabbelt Cc: Rafael J. Wysocki Cc: Rob Herring (Arm) Cc: Samuel Holland Cc: Thomas Bogendoerfer Cc: Thomas Gleixner Cc: Vasily Gorbik Cc: Will Deacon Signed-off-by: Andrew Morton List of files: /linux-6.15/include/linux/numa_memblks.h

317ef459 - mm: numa_memblks: make several functions and variables static

Wed, 07 Aug 2024 06:41:05 +0000

mm: numa_memblks: make several functions and variables staticMake functions and variables that are exclusively used by numa_memblksstatic.Move numa_nodemask_from_meminfo() before its callers to avoid forwarddeclaration.Link: https://lkml.kernel.org/r/20240807064110.1003856-22-rppt@kernel.orgSigned-off-by: Mike Rapoport (Microsoft) Tested-by: Zi Yan # for x86_64 and arm64Reviewed-by: Jonathan Cameron Tested-by: Jonathan Cameron [arm64 + CXL via QEMU]Acked-by: Dan Williams Acked-by: David Hildenbrand Cc: Alexander Gordeev Cc: Andreas Larsson Cc: Arnd Bergmann Cc: Borislav Petkov Cc: Catalin Marinas Cc: Christophe Leroy Cc: Dave Hansen Cc: Davidlohr Bueso Cc: David S. Miller Cc: Greg Kroah-Hartman Cc: Heiko Carstens Cc: Huacai Chen Cc: Ingo Molnar Cc: Jiaxun Yang Cc: John Paul Adrian Glaubitz Cc: Jonathan Corbet Cc: Michael Ellerman Cc: Palmer Dabbelt Cc: Rafael J. Wysocki Cc: Rob Herring (Arm) Cc: Samuel Holland Cc: Thomas Bogendoerfer Cc: Thomas Gleixner Cc: Vasily Gorbik Cc: Will Deacon Signed-off-by: Andrew Morton List of files: /linux-6.15/include/linux/numa_memblks.h

692d73d2 - mm: numa_memblks: introduce numa_memblks_init

Wed, 07 Aug 2024 06:41:04 +0000

mm: numa_memblks: introduce numa_memblks_initMove most of x86::numa_init() to numa_memblks so that the latter will bemore self-contained.With this numa_memblk data structures should not be exposed to thearchitecture specific code.Link: https://lkml.kernel.org/r/20240807064110.1003856-21-rppt@kernel.orgSigned-off-by: Mike Rapoport (Microsoft) Tested-by: Zi Yan # for x86_64 and arm64Reviewed-by: Jonathan Cameron Tested-by: Jonathan Cameron [arm64 + CXL via QEMU]Acked-by: Dan Williams Acked-by: David Hildenbrand Cc: Alexander Gordeev Cc: Andreas Larsson Cc: Arnd Bergmann Cc: Borislav Petkov Cc: Catalin Marinas Cc: Christophe Leroy Cc: Dave Hansen Cc: Davidlohr Bueso Cc: David S. Miller Cc: Greg Kroah-Hartman Cc: Heiko Carstens Cc: Huacai Chen Cc: Ingo Molnar Cc: Jiaxun Yang Cc: John Paul Adrian Glaubitz Cc: Jonathan Corbet Cc: Michael Ellerman Cc: Palmer Dabbelt Cc: Rafael J. Wysocki Cc: Rob Herring (Arm) Cc: Samuel Holland Cc: Thomas Bogendoerfer Cc: Thomas Gleixner Cc: Vasily Gorbik Cc: Will Deacon Signed-off-by: Andrew Morton List of files: /linux-6.15/include/linux/numa_memblks.h

b0c4e27c - mm: introduce numa_emulation

Wed, 07 Aug 2024 06:41:03 +0000

mm: introduce numa_emulationMove numa_emulation code from arch/x86 to mm/numa_emulation.cThis code will be later reused by arch_numa.No functional changes.Link: https://lkml.kernel.org/r/20240807064110.1003856-20-rppt@kernel.orgSigned-off-by: Mike Rapoport (Microsoft) Tested-by: Zi Yan # for x86_64 and arm64Reviewed-by: Jonathan Cameron Tested-by: Jonathan Cameron [arm64 + CXL via QEMU]Acked-by: Dan Williams Cc: Alexander Gordeev Cc: Andreas Larsson Cc: Arnd Bergmann Cc: Borislav Petkov Cc: Catalin Marinas Cc: Christophe Leroy Cc: Dave Hansen Cc: David Hildenbrand Cc: Davidlohr Bueso Cc: David S. Miller Cc: Greg Kroah-Hartman Cc: Heiko Carstens Cc: Huacai Chen Cc: Ingo Molnar Cc: Jiaxun Yang Cc: John Paul Adrian Glaubitz Cc: Jonathan Corbet Cc: Michael Ellerman Cc: Palmer Dabbelt Cc: Rafael J. Wysocki Cc: Rob Herring (Arm) Cc: Samuel Holland Cc: Thomas Bogendoerfer Cc: Thomas Gleixner Cc: Vasily Gorbik Cc: Will Deacon Signed-off-by: Andrew Morton List of files: /linux-6.15/include/linux/numa_memblks.h

75f9d4cc - mm: move numa_distance and related code from x86 to numa_memblks

Wed, 07 Aug 2024 06:41:02 +0000

mm: move numa_distance and related code from x86 to numa_memblksMove code dealing with numa_distance array from arch/x86 tomm/numa_memblks.cThis code will be later reused by arch_numa.No functional changes.Link: https://lkml.kernel.org/r/20240807064110.1003856-19-rppt@kernel.orgSigned-off-by: Mike Rapoport (Microsoft) Tested-by: Zi Yan # for x86_64 and arm64Reviewed-by: Jonathan Cameron Tested-by: Jonathan Cameron [arm64 + CXL via QEMU]Acked-by: Dan Williams Acked-by: David Hildenbrand Cc: Alexander Gordeev Cc: Andreas Larsson Cc: Arnd Bergmann Cc: Borislav Petkov Cc: Catalin Marinas Cc: Christophe Leroy Cc: Dave Hansen Cc: Davidlohr Bueso Cc: David S. Miller Cc: Greg Kroah-Hartman Cc: Heiko Carstens Cc: Huacai Chen Cc: Ingo Molnar Cc: Jiaxun Yang Cc: John Paul Adrian Glaubitz Cc: Jonathan Corbet Cc: Michael Ellerman Cc: Palmer Dabbelt Cc: Rafael J. Wysocki Cc: Rob Herring (Arm) Cc: Samuel Holland Cc: Thomas Bogendoerfer Cc: Thomas Gleixner Cc: Vasily Gorbik Cc: Will Deacon Signed-off-by: Andrew Morton List of files: /linux-6.15/include/linux/numa_memblks.h

87482708 - mm: introduce numa_memblks

Wed, 07 Aug 2024 06:41:01 +0000

mm: introduce numa_memblksMove code dealing with numa_memblks from arch/x86 to mm/ and add Kconfigoptions to let x86 select it in its Kconfig.This code will be later reused by arch_numa.No functional changes.Link: https://lkml.kernel.org/r/20240807064110.1003856-18-rppt@kernel.orgSigned-off-by: Mike Rapoport (Microsoft) Tested-by: Zi Yan # for x86_64 and arm64Reviewed-by: Jonathan Cameron Tested-by: Jonathan Cameron [arm64 + CXL via QEMU]Acked-by: Dan Williams Acked-by: David Hildenbrand Cc: Alexander Gordeev Cc: Andreas Larsson Cc: Arnd Bergmann Cc: Borislav Petkov Cc: Catalin Marinas Cc: Christophe Leroy Cc: Dave Hansen Cc: Davidlohr Bueso Cc: David S. Miller Cc: Greg Kroah-Hartman Cc: Heiko Carstens Cc: Huacai Chen Cc: Ingo Molnar Cc: Jiaxun Yang Cc: John Paul Adrian Glaubitz Cc: Jonathan Corbet Cc: Michael Ellerman Cc: Palmer Dabbelt Cc: Rafael J. Wysocki Cc: Rob Herring (Arm) Cc: Samuel Holland Cc: Thomas Bogendoerfer Cc: Thomas Gleixner Cc: Vasily Gorbik Cc: Will Deacon Signed-off-by: Andrew Morton List of files: /linux-6.15/include/linux/numa_memblks.h