292 lines
13 KiB
Plaintext
292 lines
13 KiB
Plaintext
|
=============================
|
||
|
|
NO-MMU MEMORY MAPPING SUPPORT
|
||
|
|
=============================
|
||
|
|
|
||
|
|
The kernel has limited support for memory mapping under no-MMU conditions, such
|
||
|
|
as are used in uClinux environments. From the userspace point of view, memory
|
||
|
|
mapping is made use of in conjunction with the mmap() system call, the shmat()
|
||
|
|
call and the execve() system call. From the kernel's point of view, execve()
|
||
|
|
mapping is actually performed by the binfmt drivers, which call back into the
|
||
|
|
mmap() routines to do the actual work.
|
||
|
|
|
||
|
|
Memory mapping behaviour also involves the way fork(), vfork(), clone() and
|
||
|
|
ptrace() work. Under uClinux there is no fork(), and clone() must be supplied
|
||
|
|
the CLONE_VM flag.
|
||
|
|
|
||
|
|
The behaviour is similar between the MMU and no-MMU cases, but not identical;
|
||
|
|
and it's also much more restricted in the latter case:
|
||
|
|
|
||
|
|
(*) Anonymous mapping, MAP_PRIVATE
|
||
|
|
|
||
|
|
In the MMU case: VM regions backed by arbitrary pages; copy-on-write
|
||
|
|
across fork.
|
||
|
|
|
||
|
|
In the no-MMU case: VM regions backed by arbitrary contiguous runs of
|
||
|
|
pages.
|
||
|
|
|
||
|
|
(*) Anonymous mapping, MAP_SHARED
|
||
|
|
|
||
|
|
These behave very much like private mappings, except that they're
|
||
|
|
shared across fork() or clone() without CLONE_VM in the MMU case. Since
|
||
|
|
the no-MMU case doesn't support these, behaviour is identical to
|
||
|
|
MAP_PRIVATE there.
|
||
|
|
|
||
|
|
(*) File, MAP_PRIVATE, PROT_READ / PROT_EXEC, !PROT_WRITE
|
||
|
|
|
||
|
|
In the MMU case: VM regions backed by pages read from file; changes to
|
||
|
|
the underlying file are reflected in the mapping; copied across fork.
|
||
|
|
|
||
|
|
In the no-MMU case:
|
||
|
|
|
||
|
|
- If one exists, the kernel will re-use an existing mapping to the
|
||
|
|
same segment of the same file if that has compatible permissions,
|
||
|
|
even if this was created by another process.
|
||
|
|
|
||
|
|
- If possible, the file mapping will be directly on the backing device
|
||
|
|
if the backing device has the NOMMU_MAP_DIRECT capability and
|
||
|
|
appropriate mapping protection capabilities. Ramfs, romfs, cramfs
|
||
|
|
and mtd might all permit this.
|
||
|
|
|
||
|
|
- If the backing device device can't or won't permit direct sharing,
|
||
|
|
but does have the NOMMU_MAP_COPY capability, then a copy of the
|
||
|
|
appropriate bit of the file will be read into a contiguous bit of
|
||
|
|
memory and any extraneous space beyond the EOF will be cleared
|
||
|
|
|
||
|
|
- Writes to the file do not affect the mapping; writes to the mapping
|
||
|
|
are visible in other processes (no MMU protection), but should not
|
||
|
|
happen.
|
||
|
|
|
||
|
|
(*) File, MAP_PRIVATE, PROT_READ / PROT_EXEC, PROT_WRITE
|
||
|
|
|
||
|
|
In the MMU case: like the non-PROT_WRITE case, except that the pages in
|
||
|
|
question get copied before the write actually happens. From that point
|
||
|
|
on writes to the file underneath that page no longer get reflected into
|
||
|
|
the mapping's backing pages. The page is then backed by swap instead.
|
||
|
|
|
||
|
|
In the no-MMU case: works much like the non-PROT_WRITE case, except
|
||
|
|
that a copy is always taken and never shared.
|
||
|
|
|
||
|
|
(*) Regular file / blockdev, MAP_SHARED, PROT_READ / PROT_EXEC / PROT_WRITE
|
||
|
|
|
||
|
|
In the MMU case: VM regions backed by pages read from file; changes to
|
||
|
|
pages written back to file; writes to file reflected into pages backing
|
||
|
|
mapping; shared across fork.
|
||
|
|
|
||
|
|
In the no-MMU case: not supported.
|
||
|
|
|
||
|
|
(*) Memory backed regular file, MAP_SHARED, PROT_READ / PROT_EXEC / PROT_WRITE
|
||
|
|
|
||
|
|
In the MMU case: As for ordinary regular files.
|
||
|
|
|
||
|
|
In the no-MMU case: The filesystem providing the memory-backed file
|
||
|
|
(such as ramfs or tmpfs) may choose to honour an open, truncate, mmap
|
||
|
|
sequence by providing a contiguous sequence of pages to map. In that
|
||
|
|
case, a shared-writable memory mapping will be possible. It will work
|
||
|
|
as for the MMU case. If the filesystem does not provide any such
|
||
|
|
support, then the mapping request will be denied.
|
||
|
|
|
||
|
|
(*) Memory backed blockdev, MAP_SHARED, PROT_READ / PROT_EXEC / PROT_WRITE
|
||
|
|
|
||
|
|
In the MMU case: As for ordinary regular files.
|
||
|
|
|
||
|
|
In the no-MMU case: As for memory backed regular files, but the
|
||
|
|
blockdev must be able to provide a contiguous run of pages without
|
||
|
|
truncate being called. The ramdisk driver could do this if it allocated
|
||
|
|
all its memory as a contiguous array upfront.
|
||
|
|
|
||
|
|
(*) Memory backed chardev, MAP_SHARED, PROT_READ / PROT_EXEC / PROT_WRITE
|
||
|
|
|
||
|
|
In the MMU case: As for ordinary regular files.
|
||
|
|
|
||
|
|
In the no-MMU case: The character device driver may choose to honour
|
||
|
|
the mmap() by providing direct access to the underlying device if it
|
||
|
|
provides memory or quasi-memory that can be accessed directly. Examples
|
||
|
|
of such are frame buffers and flash devices. If the driver does not
|
||
|
|
provide any such support, then the mapping request will be denied.
|
||
|
|
|
||
|
|
|
||
|
|
============================
|
||
|
|
FURTHER NOTES ON NO-MMU MMAP
|
||
|
|
============================
|
||
|
|
|
||
|
|
(*) A request for a private mapping of a file may return a buffer that is not
|
||
|
|
page-aligned. This is because XIP may take place, and the data may not be
|
||
|
|
paged aligned in the backing store.
|
||
|
|
|
||
|
|
(*) A request for an anonymous mapping will always be page aligned. If
|
||
|
|
possible the size of the request should be a power of two otherwise some
|
||
|
|
of the space may be wasted as the kernel must allocate a power-of-2
|
||
|
|
granule but will only discard the excess if appropriately configured as
|
||
|
|
this has an effect on fragmentation.
|
||
|
|
|
||
|
|
(*) The memory allocated by a request for an anonymous mapping will normally
|
||
|
|
be cleared by the kernel before being returned in accordance with the
|
||
|
|
Linux man pages (ver 2.22 or later).
|
||
|
|
|
||
|
|
In the MMU case this can be achieved with reasonable performance as
|
||
|
|
regions are backed by virtual pages, with the contents only being mapped
|
||
|
|
to cleared physical pages when a write happens on that specific page
|
||
|
|
(prior to which, the pages are effectively mapped to the global zero page
|
||
|
|
from which reads can take place). This spreads out the time it takes to
|
||
|
|
initialize the contents of a page - depending on the write-usage of the
|
||
|
|
mapping.
|
||
|
|
|
||
|
|
In the no-MMU case, however, anonymous mappings are backed by physical
|
||
|
|
pages, and the entire map is cleared at allocation time. This can cause
|
||
|
|
significant delays during a userspace malloc() as the C library does an
|
||
|
|
anonymous mapping and the kernel then does a memset for the entire map.
|
||
|
|
|
||
|
|
However, for memory that isn't required to be precleared - such as that
|
||
|
|
returned by malloc() - mmap() can take a MAP_UNINITIALIZED flag to
|
||
|
|
indicate to the kernel that it shouldn't bother clearing the memory before
|
||
|
|
returning it. Note that CONFIG_MMAP_ALLOW_UNINITIALIZED must be enabled
|
||
|
|
to permit this, otherwise the flag will be ignored.
|
||
|
|
|
||
|
|
uClibc uses this to speed up malloc(), and the ELF-FDPIC binfmt uses this
|
||
|
|
to allocate the brk and stack region.
|
||
|
|
|
||
|
|
(*) A list of all the private copy and anonymous mappings on the system is
|
||
|
|
visible through /proc/maps in no-MMU mode.
|
||
|
|
|
||
|
|
(*) A list of all the mappings in use by a process is visible through
|
||
|
|
/proc/<pid>/maps in no-MMU mode.
|
||
|
|
|
||
|
|
(*) Supplying MAP_FIXED or a requesting a particular mapping address will
|
||
|
|
result in an error.
|
||
|
|
|
||
|
|
(*) Files mapped privately usually have to have a read method provided by the
|
||
|
|
driver or filesystem so that the contents can be read into the memory
|
||
|
|
allocated if mmap() chooses not to map the backing device directly. An
|
||
|
|
error will result if they don't. This is most likely to be encountered
|
||
|
|
with character device files, pipes, fifos and sockets.
|
||
|
|
|
||
|
|
|
||
|
|
==========================
|
||
|
|
INTERPROCESS SHARED MEMORY
|
||
|
|
==========================
|
||
|
|
|
||
|
|
Both SYSV IPC SHM shared memory and POSIX shared memory is supported in NOMMU
|
||
|
|
mode. The former through the usual mechanism, the latter through files created
|
||
|
|
on ramfs or tmpfs mounts.
|
||
|
|
|
||
|
|
|
||
|
|
=======
|
||
|
|
FUTEXES
|
||
|
|
=======
|
||
|
|
|
||
|
|
Futexes are supported in NOMMU mode if the arch supports them. An error will
|
||
|
|
be given if an address passed to the futex system call lies outside the
|
||
|
|
mappings made by a process or if the mapping in which the address lies does not
|
||
|
|
support futexes (such as an I/O chardev mapping).
|
||
|
|
|
||
|
|
|
||
|
|
=============
|
||
|
|
NO-MMU MREMAP
|
||
|
|
=============
|
||
|
|
|
||
|
|
The mremap() function is partially supported. It may change the size of a
|
||
|
|
mapping, and may move it[*] if MREMAP_MAYMOVE is specified and if the new size
|
||
|
|
of the mapping exceeds the size of the slab object currently occupied by the
|
||
|
|
memory to which the mapping refers, or if a smaller slab object could be used.
|
||
|
|
|
||
|
|
MREMAP_FIXED is not supported, though it is ignored if there's no change of
|
||
|
|
address and the object does not need to be moved.
|
||
|
|
|
||
|
|
Shared mappings may not be moved. Shareable mappings may not be moved either,
|
||
|
|
even if they are not currently shared.
|
||
|
|
|
||
|
|
The mremap() function must be given an exact match for base address and size of
|
||
|
|
a previously mapped object. It may not be used to create holes in existing
|
||
|
|
mappings, move parts of existing mappings or resize parts of mappings. It must
|
||
|
|
act on a complete mapping.
|
||
|
|
|
||
|
|
[*] Not currently supported.
|
||
|
|
|
||
|
|
|
||
|
|
============================================
|
||
|
|
PROVIDING SHAREABLE CHARACTER DEVICE SUPPORT
|
||
|
|
============================================
|
||
|
|
|
||
|
|
To provide shareable character device support, a driver must provide a
|
||
|
|
file->f_op->get_unmapped_area() operation. The mmap() routines will call this
|
||
|
|
to get a proposed address for the mapping. This may return an error if it
|
||
|
|
doesn't wish to honour the mapping because it's too long, at a weird offset,
|
||
|
|
under some unsupported combination of flags or whatever.
|
||
|
|
|
||
|
|
The driver should also provide backing device information with capabilities set
|
||
|
|
to indicate the permitted types of mapping on such devices. The default is
|
||
|
|
assumed to be readable and writable, not executable, and only shareable
|
||
|
|
directly (can't be copied).
|
||
|
|
|
||
|
|
The file->f_op->mmap() operation will be called to actually inaugurate the
|
||
|
|
mapping. It can be rejected at that point. Returning the ENOSYS error will
|
||
|
|
cause the mapping to be copied instead if NOMMU_MAP_COPY is specified.
|
||
|
|
|
||
|
|
The vm_ops->close() routine will be invoked when the last mapping on a chardev
|
||
|
|
is removed. An existing mapping will be shared, partially or not, if possible
|
||
|
|
without notifying the driver.
|
||
|
|
|
||
|
|
It is permitted also for the file->f_op->get_unmapped_area() operation to
|
||
|
|
return -ENOSYS. This will be taken to mean that this operation just doesn't
|
||
|
|
want to handle it, despite the fact it's got an operation. For instance, it
|
||
|
|
might try directing the call to a secondary driver which turns out not to
|
||
|
|
implement it. Such is the case for the framebuffer driver which attempts to
|
||
|
|
direct the call to the device-specific driver. Under such circumstances, the
|
||
|
|
mapping request will be rejected if NOMMU_MAP_COPY is not specified, and a
|
||
|
|
copy mapped otherwise.
|
||
|
|
|
||
|
|
IMPORTANT NOTE:
|
||
|
|
|
||
|
|
Some types of device may present a different appearance to anyone
|
||
|
|
looking at them in certain modes. Flash chips can be like this; for
|
||
|
|
instance if they're in programming or erase mode, you might see the
|
||
|
|
status reflected in the mapping, instead of the data.
|
||
|
|
|
||
|
|
In such a case, care must be taken lest userspace see a shared or a
|
||
|
|
private mapping showing such information when the driver is busy
|
||
|
|
controlling the device. Remember especially: private executable
|
||
|
|
mappings may still be mapped directly off the device under some
|
||
|
|
circumstances!
|
||
|
|
|
||
|
|
|
||
|
|
==============================================
|
||
|
|
PROVIDING SHAREABLE MEMORY-BACKED FILE SUPPORT
|
||
|
|
==============================================
|
||
|
|
|
||
|
|
Provision of shared mappings on memory backed files is similar to the provision
|
||
|
|
of support for shared mapped character devices. The main difference is that the
|
||
|
|
filesystem providing the service will probably allocate a contiguous collection
|
||
|
|
of pages and permit mappings to be made on that.
|
||
|
|
|
||
|
|
It is recommended that a truncate operation applied to such a file that
|
||
|
|
increases the file size, if that file is empty, be taken as a request to gather
|
||
|
|
enough pages to honour a mapping. This is required to support POSIX shared
|
||
|
|
memory.
|
||
|
|
|
||
|
|
Memory backed devices are indicated by the mapping's backing device info having
|
||
|
|
the memory_backed flag set.
|
||
|
|
|
||
|
|
|
||
|
|
========================================
|
||
|
|
PROVIDING SHAREABLE BLOCK DEVICE SUPPORT
|
||
|
|
========================================
|
||
|
|
|
||
|
|
Provision of shared mappings on block device files is exactly the same as for
|
||
|
|
character devices. If there isn't a real device underneath, then the driver
|
||
|
|
should allocate sufficient contiguous memory to honour any supported mapping.
|
||
|
|
|
||
|
|
|
||
|
|
=================================
|
||
|
|
ADJUSTING PAGE TRIMMING BEHAVIOUR
|
||
|
|
=================================
|
||
|
|
|
||
|
|
NOMMU mmap automatically rounds up to the nearest power-of-2 number of pages
|
||
|
|
when performing an allocation. This can have adverse effects on memory
|
||
|
|
fragmentation, and as such, is left configurable. The default behaviour is to
|
||
|
|
aggressively trim allocations and discard any excess pages back in to the page
|
||
|
|
allocator. In order to retain finer-grained control over fragmentation, this
|
||
|
|
behaviour can either be disabled completely, or bumped up to a higher page
|
||
|
|
watermark where trimming begins.
|
||
|
|
|
||
|
|
Page trimming behaviour is configurable via the sysctl `vm.nr_trim_pages'.
|