• Jitendra Kolhe's avatar
    mem-prealloc: reduce large guest start-up and migration time. · 1e356fc1
    Jitendra Kolhe authored
    Using "-mem-prealloc" option for a large guest leads to higher guest
    start-up and migration time. This is because with "-mem-prealloc" option
    qemu tries to map every guest page (create address translations), and
    make sure the pages are available during runtime. virsh/libvirt by
    default, seems to use "-mem-prealloc" option in case the guest is
    configured to use huge pages. The patch tries to map all guest pages
    simultaneously by spawning multiple threads. Currently limiting the
    change to QEMU library functions on POSIX compliant host only, as we are
    not sure if the problem exists on win32. Below are some stats with
    "-mem-prealloc" option for guest configured to use huge pages.
    
    ------------------------------------------------------------------------
    Idle Guest      | Start-up time | Migration time
    ------------------------------------------------------------------------
    Guest stats with 2M HugePage usage - single threaded (existing code)
    ------------------------------------------------------------------------
    64 Core - 4TB   | 54m11.796s    | 75m43.843s
    64 Core - 1TB   | 8m56.576s     | 14m29.049s
    64 Core - 256GB | 2m11.245s     | 3m26.598s
    ------------------------------------------------------------------------
    Guest stats with 2M HugePage usage - map guest pages using 8 threads
    ------------------------------------------------------------------------
    64 Core - 4TB   | 5m1.027s      | 34m10.565s
    64 Core - 1TB   | 1m10.366s     | 8m28.188s
    64 Core - 256GB | 0m19.040s     | 2m10.148s
    -----------------------------------------------------------------------
    Guest stats with 2M HugePage usage - map guest pages using 16 threads
    -----------------------------------------------------------------------
    64 Core - 4TB   | 1m58.970s     | 31m43.400s
    64 Core - 1TB   | 0m39.885s     | 7m55.289s
    64 Core - 256GB | 0m11.960s     | 2m0.135s
    -----------------------------------------------------------------------
    
    Changed in v2:
     - modify number of memset threads spawned to min(smp_cpus, 16).
     - removed 64GB memory restriction for spawning memset threads.
    
    Changed in v3:
     - limit number of threads spawned based on
       min(sysconf(_SC_NPROCESSORS_ONLN), 16, smp_cpus)
     - implement memset thread specific siglongjmp in SIGBUS signal_handler.
    
    Changed in v4
     - remove sigsetjmp/siglongjmp and SIGBUS unblock/block for main thread
       as main thread no longer touches any pages.
     - simplify code my returning memset_thread_failed status from
       touch_all_pages.
    Signed-off-by: 's avatarJitendra Kolhe <jitendra.kolhe@hpe.com>
    Message-Id: <1487907103-32350-1-git-send-email-jitendra.kolhe@hpe.com>
    Signed-off-by: 's avatarPaolo Bonzini <pbonzini@redhat.com>
    1e356fc1
Name
Last commit
Last update
audio Loading commit data...
backends Loading commit data...
block Loading commit data...
bsd-user Loading commit data...
chardev Loading commit data...
contrib Loading commit data...
crypto Loading commit data...
default-configs Loading commit data...
disas Loading commit data...
docs Loading commit data...
dtc @ 558cd81b Loading commit data...
fpu Loading commit data...
fsdev Loading commit data...
gdb-xml Loading commit data...
hw Loading commit data...
include Loading commit data...
io Loading commit data...
libdecnumber Loading commit data...
linux-headers Loading commit data...
linux-user Loading commit data...
migration Loading commit data...
nbd Loading commit data...
net Loading commit data...
pc-bios Loading commit data...
pixman @ 87eea99e Loading commit data...
po Loading commit data...
qapi Loading commit data...
qga Loading commit data...
qobject Loading commit data...
qom Loading commit data...
replay Loading commit data...
roms Loading commit data...
scripts Loading commit data...
slirp Loading commit data...
stubs Loading commit data...
target Loading commit data...
tcg Loading commit data...
tests Loading commit data...
trace Loading commit data...
ui Loading commit data...
util Loading commit data...
.dir-locals.el Loading commit data...
.exrc Loading commit data...
.gitignore Loading commit data...
.gitmodules Loading commit data...
.mailmap Loading commit data...
.shippable.yml Loading commit data...
.travis.yml Loading commit data...
CODING_STYLE Loading commit data...
COPYING Loading commit data...
COPYING.LIB Loading commit data...
Changelog Loading commit data...
HACKING Loading commit data...
LICENSE Loading commit data...
MAINTAINERS Loading commit data...
Makefile Loading commit data...
Makefile.objs Loading commit data...
Makefile.target Loading commit data...
README Loading commit data...
VERSION Loading commit data...
accel.c Loading commit data...
arch_init.c Loading commit data...
atomic_template.h Loading commit data...
balloon.c Loading commit data...
block.c Loading commit data...
blockdev-nbd.c Loading commit data...
blockdev.c Loading commit data...
blockjob.c Loading commit data...
bootdevice.c Loading commit data...
bt-host.c Loading commit data...
bt-vhci.c Loading commit data...
configure Loading commit data...
cpu-exec-common.c Loading commit data...
cpu-exec.c Loading commit data...
cpus-common.c Loading commit data...
cpus.c Loading commit data...
cputlb.c Loading commit data...
device-hotplug.c Loading commit data...
device_tree.c Loading commit data...
disas.c Loading commit data...
dma-helpers.c Loading commit data...
dump.c Loading commit data...
exec.c Loading commit data...
gdbstub.c Loading commit data...
hax-stub.c Loading commit data...
hmp-commands-info.hx Loading commit data...
hmp-commands.hx Loading commit data...
hmp.c Loading commit data...
hmp.h Loading commit data...
ioport.c Loading commit data...
iothread.c Loading commit data...
kvm-all.c Loading commit data...
kvm-stub.c Loading commit data...
memory.c Loading commit data...
memory_ldst.inc.c Loading commit data...
memory_mapping.c Loading commit data...
module-common.c Loading commit data...
monitor.c Loading commit data...
numa.c Loading commit data...
os-posix.c Loading commit data...
os-win32.c Loading commit data...
page_cache.c Loading commit data...
qapi-schema.json Loading commit data...
qdev-monitor.c Loading commit data...
qdict-test-data.txt Loading commit data...
qemu-bridge-helper.c Loading commit data...
qemu-doc.texi Loading commit data...
qemu-ga.texi Loading commit data...
qemu-img-cmds.hx Loading commit data...
qemu-img.c Loading commit data...
qemu-img.texi Loading commit data...
qemu-io-cmds.c Loading commit data...
qemu-io.c Loading commit data...
qemu-nbd.c Loading commit data...
qemu-nbd.texi Loading commit data...
qemu-option-trace.texi Loading commit data...
qemu-options-wrapper.h Loading commit data...
qemu-options.h Loading commit data...
qemu-options.hx Loading commit data...
qemu-seccomp.c Loading commit data...
qemu-tech.texi Loading commit data...
qemu.nsi Loading commit data...
qemu.sasl Loading commit data...
qmp.c Loading commit data...
qtest.c Loading commit data...
replication.c Loading commit data...
replication.h Loading commit data...
rules.mak Loading commit data...
softmmu_template.h Loading commit data...
spice-qemu-char.c Loading commit data...
tcg-runtime.c Loading commit data...
tci.c Loading commit data...
thunk.c Loading commit data...
tpm.c Loading commit data...
trace-events Loading commit data...
translate-all.c Loading commit data...
translate-all.h Loading commit data...
translate-common.c Loading commit data...
user-exec-stub.c Loading commit data...
user-exec.c Loading commit data...
version.rc Loading commit data...
vl.c Loading commit data...
xen-common-stub.c Loading commit data...
xen-common.c Loading commit data...
xen-hvm-stub.c Loading commit data...
xen-hvm.c Loading commit data...
xen-mapcache.c Loading commit data...