mm: add kmem_cache_create_rcu()
authorChristian Brauner <brauner@kernel.org>
Wed, 28 Aug 2024 10:56:24 +0000 (12:56 +0200)
committerChristian Brauner <brauner@kernel.org>
Thu, 29 Aug 2024 13:20:32 +0000 (15:20 +0200)
commitd345bd2e9834e2da505977e154a1c179c793b7b2
tree5bd9bfdb853f72c587a0986039d990c3f2a96114
parente446f18e98e89fb7de2b320620ce983929bb2486
mm: add kmem_cache_create_rcu()

When a kmem cache is created with SLAB_TYPESAFE_BY_RCU the free pointer
must be located outside of the object because we don't know what part of
the memory can safely be overwritten as it may be needed to prevent
object recycling.

That has the consequence that SLAB_TYPESAFE_BY_RCU may end up adding a
new cacheline. This is the case for e.g., struct file. After having it
shrunk down by 40 bytes and having it fit in three cachelines we still
have SLAB_TYPESAFE_BY_RCU adding a fourth cacheline because it needs to
accommodate the free pointer.

Add a new kmem_cache_create_rcu() function that allows the caller to
specify an offset where the free pointer is supposed to be placed.

Link: https://lore.kernel.org/r/20240828-work-kmem_cache-rcu-v3-2-5460bc1f09f6@kernel.org
Acked-by: Mike Rapoport (Microsoft) <rppt@kernel.org>
Reviewed-by: Vlastimil Babka <vbabka@suse.cz>
Signed-off-by: Christian Brauner <brauner@kernel.org>
include/linux/slab.h
mm/slab.h
mm/slab_common.c
mm/slub.c