1# 2# Config file for ktest.pl 3# 4# Place your customized version of this, named ktest.conf, in the 5# working directory that ktest.pl is run from. 6# 7# Note, all paths must be absolute 8# 9 10# Options set in the beginning of the file are considered to be 11# default options. These options can be overriden by test specific 12# options, with the following exceptions: 13# 14# LOG_FILE 15# CLEAR_LOG 16# POWEROFF_ON_SUCCESS 17# REBOOT_ON_SUCCESS 18# 19# Test specific options are set after the label: 20# 21# TEST_START 22# 23# The options after a TEST_START label are specific to that test. 24# Each TEST_START label will set up a new test. If you want to 25# perform a test more than once, you can add the ITERATE label 26# to it followed by the number of times you want that test 27# to iterate. If the ITERATE is left off, the test will only 28# be performed once. 29# 30# TEST_START ITERATE 10 31# 32# You can skip a test by adding SKIP (before or after the ITERATE 33# and number) 34# 35# TEST_START SKIP 36# 37# TEST_START SKIP ITERATE 10 38# 39# TEST_START ITERATE 10 SKIP 40# 41# The SKIP label causes the options and the test itself to be ignored. 42# This is useful to set up several different tests in one config file, and 43# only enabling the ones you want to use for a current test run. 44# 45# You can add default options anywhere in the file as well 46# with the DEFAULTS tag. This allows you to have default options 47# after the test options to keep the test options at the top 48# of the file. You can even place the DEFAULTS tag between 49# test cases (but not in the middle of a single test case) 50# 51# TEST_START 52# MIN_CONFIG = /home/test/config-test1 53# 54# DEFAULTS 55# MIN_CONFIG = /home/test/config-default 56# 57# TEST_START ITERATE 10 58# 59# The above will run the first test with MIN_CONFIG set to 60# /home/test/config-test-1. Then 10 tests will be executed 61# with MIN_CONFIG with /home/test/config-default. 62# 63# You can also disable defaults with the SKIP option 64# 65# DEFAULTS SKIP 66# MIN_CONFIG = /home/test/config-use-sometimes 67# 68# DEFAULTS 69# MIN_CONFIG = /home/test/config-most-times 70# 71# The above will ignore the first MIN_CONFIG. If you want to 72# use the first MIN_CONFIG, remove the SKIP from the first 73# DEFAULTS tag and add it to the second. Be careful, options 74# may only be declared once per test or default. If you have 75# the same option name under the same test or as default 76# ktest will fail to execute, and no tests will run. 77# 78# DEFAULTS OVERRIDE 79# 80# Options defined in the DEFAULTS section can not be duplicated 81# even if they are defined in two different DEFAULT sections. 82# This is done to catch mistakes where an option is added but 83# the previous option was forgotten about and not commented. 84# 85# The OVERRIDE keyword can be added to a section to allow this 86# section to override other DEFAULT sections values that have 87# been defined previously. It will only override options that 88# have been defined before its use. Options defined later 89# in a non override section will still error. The same option 90# can not be defined in the same section even if that section 91# is marked OVERRIDE. 92# 93# 94# 95# Both TEST_START and DEFAULTS sections can also have the IF keyword 96# The value after the IF must evaluate into a 0 or non 0 positive 97# integer, and can use the config variables (explained below). 98# 99# DEFAULTS IF ${IS_X86_32} 100# 101# The above will process the DEFAULTS section if the config 102# variable IS_X86_32 evaluates to a non zero positive integer 103# otherwise if it evaluates to zero, it will act the same 104# as if the SKIP keyword was used. 105# 106# The ELSE keyword can be used directly after a section with 107# a IF statement. 108# 109# TEST_START IF ${RUN_NET_TESTS} 110# BUILD_TYPE = useconfig:${CONFIG_DIR}/config-network 111# 112# ELSE 113# 114# BUILD_TYPE = useconfig:${CONFIG_DIR}/config-normal 115# 116# 117# The ELSE keyword can also contain an IF statement to allow multiple 118# if then else sections. But all the sections must be either 119# DEFAULT or TEST_START, they can not be a mixture. 120# 121# TEST_START IF ${RUN_NET_TESTS} 122# BUILD_TYPE = useconfig:${CONFIG_DIR}/config-network 123# 124# ELSE IF ${RUN_DISK_TESTS} 125# BUILD_TYPE = useconfig:${CONFIG_DIR}/config-tests 126# 127# ELSE IF ${RUN_CPU_TESTS} 128# BUILD_TYPE = useconfig:${CONFIG_DIR}/config-cpu 129# 130# ELSE 131# BUILD_TYPE = useconfig:${CONFIG_DIR}/config-network 132# 133# The if statement may also have comparisons that will and for 134# == and !=, strings may be used for both sides. 135# 136# BOX_TYPE := x86_32 137# 138# DEFAULTS IF ${BOX_TYPE} == x86_32 139# BUILD_TYPE = useconfig:${CONFIG_DIR}/config-32 140# ELSE 141# BUILD_TYPE = useconfig:${CONFIG_DIR}/config-64 142# 143# The DEFINED keyword can be used by the IF statements too. 144# It returns true if the given config variable or option has been defined 145# or false otherwise. 146# 147# 148# DEFAULTS IF DEFINED USE_CC 149# CC := ${USE_CC} 150# ELSE 151# CC := gcc 152# 153# 154# As well as NOT DEFINED. 155# 156# DEFAULTS IF NOT DEFINED MAKE_CMD 157# MAKE_CMD := make ARCH=x86 158# 159# 160# And/or ops (&&,||) may also be used to make complex conditionals. 161# 162# TEST_START IF (DEFINED ALL_TESTS || ${MYTEST} == boottest) && ${MACHINE} == gandalf 163# 164# Notice the use of parentheses. Without any parentheses the above would be 165# processed the same as: 166# 167# TEST_START IF DEFINED ALL_TESTS || (${MYTEST} == boottest && ${MACHINE} == gandalf) 168# 169# 170# 171# INCLUDE file 172# 173# The INCLUDE keyword may be used in DEFAULT sections. This will 174# read another config file and process that file as well. The included 175# file can include other files, add new test cases or default 176# statements. Config variables will be passed to these files and changes 177# to config variables will be seen by top level config files. Including 178# a file is processed just like the contents of the file was cut and pasted 179# into the top level file, except, that include files that end with 180# TEST_START sections will have that section ended at the end of 181# the include file. That is, an included file is included followed 182# by another DEFAULT keyword. 183# 184# Unlike other files referenced in this config, the file path does not need 185# to be absolute. If the file does not start with '/', then the directory 186# that the current config file was located in is used. If no config by the 187# given name is found there, then the current directory is searched. 188# 189# INCLUDE myfile 190# DEFAULT 191# 192# is the same as: 193# 194# INCLUDE myfile 195# 196# Note, if the include file does not contain a full path, the file is 197# searched first by the location of the original include file, and then 198# by the location that ktest.pl was executed in. 199# 200 201#### Config variables #### 202# 203# This config file can also contain "config variables". 204# These are assigned with ":=" instead of the ktest option 205# assigment "=". 206# 207# The difference between ktest options and config variables 208# is that config variables can be used multiple times, 209# where each instance will override the previous instance. 210# And that they only live at time of processing this config. 211# 212# The advantage to config variables are that they can be used 213# by any option or any other config variables to define thing 214# that you may use over and over again in the options. 215# 216# For example: 217# 218# USER := root 219# TARGET := mybox 220# TEST_CASE := ssh ${USER}@${TARGET} /path/to/my/test 221# 222# TEST_START 223# MIN_CONFIG = config1 224# TEST = ${TEST_CASE} 225# 226# TEST_START 227# MIN_CONFIG = config2 228# TEST = ${TEST_CASE} 229# 230# TEST_CASE := ssh ${USER}@${TARGET} /path/to/my/test2 231# 232# TEST_START 233# MIN_CONFIG = config1 234# TEST = ${TEST_CASE} 235# 236# TEST_START 237# MIN_CONFIG = config2 238# TEST = ${TEST_CASE} 239# 240# TEST_DIR := /home/me/test 241# 242# BUILD_DIR = ${TEST_DIR}/linux.git 243# OUTPUT_DIR = ${TEST_DIR}/test 244# 245# Note, the config variables are evaluated immediately, thus 246# updating TARGET after TEST_CASE has been assigned does nothing 247# to TEST_CASE. 248# 249# As shown in the example, to evaluate a config variable, you 250# use the ${X} convention. Simple $X will not work. 251# 252# If the config variable does not exist, the ${X} will not 253# be evaluated. Thus: 254# 255# MAKE_CMD = PATH=/mypath:${PATH} make 256# 257# If PATH is not a config variable, then the ${PATH} in 258# the MAKE_CMD option will be evaluated by the shell when 259# the MAKE_CMD option is passed into shell processing. 260 261#### Using options in other options #### 262# 263# Options that are defined in the config file may also be used 264# by other options. All options are evaulated at time of 265# use (except that config variables are evaluated at config 266# processing time). 267# 268# If an ktest option is used within another option, instead of 269# typing it again in that option you can simply use the option 270# just like you can config variables. 271# 272# MACHINE = mybox 273# 274# TEST = ssh root@${MACHINE} /path/to/test 275# 276# The option will be used per test case. Thus: 277# 278# TEST_TYPE = test 279# TEST = ssh root@{MACHINE} 280# 281# TEST_START 282# MACHINE = box1 283# 284# TEST_START 285# MACHINE = box2 286# 287# For both test cases, MACHINE will be evaluated at the time 288# of the test case. The first test will run ssh root@box1 289# and the second will run ssh root@box2. 290 291#### Mandatory Default Options #### 292 293# These options must be in the default section, although most 294# may be overridden by test options. 295 296# The machine hostname that you will test 297#MACHINE = target 298 299# The box is expected to have ssh on normal bootup, provide the user 300# (most likely root, since you need privileged operations) 301#SSH_USER = root 302 303# The directory that contains the Linux source code 304#BUILD_DIR = /home/test/linux.git 305 306# The directory that the objects will be built 307# (can not be same as BUILD_DIR) 308#OUTPUT_DIR = /home/test/build/target 309 310# The location of the compiled file to copy to the target 311# (relative to OUTPUT_DIR) 312#BUILD_TARGET = arch/x86/boot/bzImage 313 314# The place to put your image on the test machine 315#TARGET_IMAGE = /boot/vmlinuz-test 316 317# A script or command to reboot the box 318# 319# Here is a digital loggers power switch example 320#POWER_CYCLE = wget --no-proxy -O /dev/null -q --auth-no-challenge 'http://admin:admin@power/outlet?5=CCL' 321# 322# Here is an example to reboot a virtual box on the current host 323# with the name "Guest". 324#POWER_CYCLE = virsh destroy Guest; sleep 5; virsh start Guest 325 326# The script or command that reads the console 327# 328# If you use ttywatch server, something like the following would work. 329#CONSOLE = nc -d localhost 3001 330# 331# For a virtual machine with guest name "Guest". 332#CONSOLE = virsh console Guest 333 334# Signal to send to kill console. 335# ktest.pl will create a child process to monitor the console. 336# When the console is finished, ktest will kill the child process 337# with this signal. 338# (default INT) 339#CLOSE_CONSOLE_SIGNAL = HUP 340 341# Required version ending to differentiate the test 342# from other linux builds on the system. 343#LOCALVERSION = -test 344 345# For REBOOT_TYPE = grub2, you must specify where the grub.cfg 346# file is. This is the file that is searched to find the menu 347# option to boot to with GRUB_REBOOT 348#GRUB_FILE = /boot/grub2/grub.cfg 349 350# The tool for REBOOT_TYPE = grub2 to set the next reboot kernel 351# to boot into (one shot mode). 352# (default grub2_reboot) 353#GRUB_REBOOT = grub2_reboot 354 355# The grub title name for the test kernel to boot 356# (Only mandatory if REBOOT_TYPE = grub or grub2) 357# 358# Note, ktest.pl will not update the grub menu.lst, you need to 359# manually add an option for the test. ktest.pl will search 360# the grub menu.lst for this option to find what kernel to 361# reboot into. 362# 363# For example, if in the /boot/grub/menu.lst the test kernel title has: 364# title Test Kernel 365# kernel vmlinuz-test 366# 367# For grub2, a search of top level "menuentry"s are done. No 368# submenu is searched. The menu is found by searching for the 369# contents of GRUB_MENU in the line that starts with "menuentry". 370# You may want to include the quotes around the option. For example: 371# for: menuentry 'Test Kernel' 372# do a: GRUB_MENU = 'Test Kernel' 373# For customizing, add your entry in /etc/grub.d/40_custom. 374# 375#GRUB_MENU = Test Kernel 376 377# For REBOOT_TYPE = syslinux, the name of the syslinux executable 378# (on the target) to use to set up the next reboot to boot the 379# test kernel. 380# (default extlinux) 381#SYSLINUX = syslinux 382 383# For REBOOT_TYPE = syslinux, the path that is passed to to the 384# syslinux command where syslinux is installed. 385# (default /boot/extlinux) 386#SYSLINUX_PATH = /boot/syslinux 387 388# For REBOOT_TYPE = syslinux, the syslinux label that references the 389# test kernel in the syslinux config file. 390# (default undefined) 391#SYSLINUX_LABEL = "test-kernel" 392 393# A script to reboot the target into the test kernel 394# This and SWITCH_TO_TEST are about the same, except 395# SWITCH_TO_TEST is run even for REBOOT_TYPE = grub. 396# This may be left undefined. 397# (default undefined) 398#REBOOT_SCRIPT = 399 400#### Optional Config Options (all have defaults) #### 401 402# Start a test setup. If you leave this off, all options 403# will be default and the test will run once. 404# This is a label and not really an option (it takes no value). 405# You can append ITERATE and a number after it to iterate the 406# test a number of times, or SKIP to ignore this test. 407# 408#TEST_START 409#TEST_START ITERATE 5 410#TEST_START SKIP 411 412# Have the following options as default again. Used after tests 413# have already been defined by TEST_START. Optionally, you can 414# just define all default options before the first TEST_START 415# and you do not need this option. 416# 417# This is a label and not really an option (it takes no value). 418# You can append SKIP to this label and the options within this 419# section will be ignored. 420# 421# DEFAULTS 422# DEFAULTS SKIP 423 424# If you want to execute some command before the first test runs 425# you can set this option. Note, it can be set as a default option 426# or an option in the first test case. All other test cases will 427# ignore it. If both the default and first test have this option 428# set, then the first test will take precedence. 429# 430# default (undefined) 431#PRE_KTEST = ${SSH} ~/set_up_test 432 433# If you want to execute some command after all the tests have 434# completed, you can set this option. Note, it can be set as a 435# default or any test case can override it. If multiple test cases 436# set this option, then the last test case that set it will take 437# precedence 438# 439# default (undefined) 440#POST_KTEST = ${SSH} ~/dismantle_test 441 442# The default test type (default test) 443# The test types may be: 444# build - only build the kernel, do nothing else 445# install - build and install, but do nothing else (does not reboot) 446# boot - build, install, and boot the kernel 447# test - build, boot and if TEST is set, run the test script 448# (If TEST is not set, it defaults back to boot) 449# bisect - Perform a bisect on the kernel (see BISECT_TYPE below) 450# patchcheck - Do a test on a series of commits in git (see PATCHCHECK below) 451#TEST_TYPE = test 452 453# Test to run if there is a successful boot and TEST_TYPE is test. 454# Must exit with 0 on success and non zero on error 455# default (undefined) 456#TEST = ssh user@machine /root/run_test 457 458# The build type is any make config type or special command 459# (default randconfig) 460# nobuild - skip the clean and build step 461# useconfig:/path/to/config - use the given config and run 462# oldconfig on it. 463# This option is ignored if TEST_TYPE is patchcheck or bisect 464#BUILD_TYPE = randconfig 465 466# The make command (default make) 467# If you are building a 32bit x86 on a 64 bit host 468#MAKE_CMD = CC=i386-gcc AS=i386-as make ARCH=i386 469 470# Any build options for the make of the kernel (not for other makes, like configs) 471# (default "") 472#BUILD_OPTIONS = -j20 473 474# If you need to do some special handling before installing 475# you can add a script with this option. 476# The environment variable KERNEL_VERSION will be set to the 477# kernel version that is used. 478# 479# default (undefined) 480#PRE_INSTALL = ssh user@target rm -rf '/lib/modules/*-test*' 481 482# If you need an initrd, you can add a script or code here to install 483# it. The environment variable KERNEL_VERSION will be set to the 484# kernel version that is used. Remember to add the initrd line 485# to your grub menu.lst file. 486# 487# Here's a couple of examples to use: 488#POST_INSTALL = ssh user@target /sbin/mkinitrd --allow-missing -f /boot/initramfs-test.img $KERNEL_VERSION 489# 490# or on some systems: 491#POST_INSTALL = ssh user@target /sbin/dracut -f /boot/initramfs-test.img $KERNEL_VERSION 492 493# If for some reason you just want to boot the kernel and you do not 494# want the test to install anything new. For example, you may just want 495# to boot test the same kernel over and over and do not want to go through 496# the hassle of installing anything, you can set this option to 1 497# (default 0) 498#NO_INSTALL = 1 499 500# If there is a command that you want to run before the individual test 501# case executes, then you can set this option 502# 503# default (undefined) 504#PRE_TEST = ${SSH} reboot_to_special_kernel 505 506# If there is a command you want to run after the individual test case 507# completes, then you can set this option. 508# 509# default (undefined) 510#POST_TEST = cd ${BUILD_DIR}; git reset --hard 511 512# If there is a script that you require to run before the build is done 513# you can specify it with PRE_BUILD. 514# 515# One example may be if you must add a temporary patch to the build to 516# fix a unrelated bug to perform a patchcheck test. This will apply the 517# patch before each build that is made. Use the POST_BUILD to do a git reset --hard 518# to remove the patch. 519# 520# (default undef) 521#PRE_BUILD = cd ${BUILD_DIR} && patch -p1 < /tmp/temp.patch 522 523# To specify if the test should fail if the PRE_BUILD fails, 524# PRE_BUILD_DIE needs to be set to 1. Otherwise the PRE_BUILD 525# result is ignored. 526# (default 0) 527# PRE_BUILD_DIE = 1 528 529# If there is a script that should run after the build is done 530# you can specify it with POST_BUILD. 531# 532# As the example in PRE_BUILD, POST_BUILD can be used to reset modifications 533# made by the PRE_BUILD. 534# 535# (default undef) 536#POST_BUILD = cd ${BUILD_DIR} && git reset --hard 537 538# To specify if the test should fail if the POST_BUILD fails, 539# POST_BUILD_DIE needs to be set to 1. Otherwise the POST_BUILD 540# result is ignored. 541# (default 0) 542#POST_BUILD_DIE = 1 543 544# Way to reboot the box to the test kernel. 545# Only valid options so far are "grub", "grub2", "syslinux" and "script" 546# (default grub) 547# If you specify grub, it will assume grub version 1 548# and will search in /boot/grub/menu.lst for the title $GRUB_MENU 549# and select that target to reboot to the kernel. If this is not 550# your setup, then specify "script" and have a command or script 551# specified in REBOOT_SCRIPT to boot to the target. 552# 553# For REBOOT_TYPE = grub2, you must define both GRUB_MENU and 554# GRUB_FILE. 555# 556# For REBOOT_TYPE = syslinux, you must define SYSLINUX_LABEL, and 557# perhaps modify SYSLINUX (default extlinux) and SYSLINUX_PATH 558# (default /boot/extlinux) 559# 560# The entry in /boot/grub/menu.lst must be entered in manually. 561# The test will not modify that file. 562#REBOOT_TYPE = grub 563 564# If you are using a machine that doesn't boot with grub, and 565# perhaps gets its kernel from a remote server (tftp), then 566# you can use this option to update the target image with the 567# test image. 568# 569# You could also do the same with POST_INSTALL, but the difference 570# between that option and this option is that POST_INSTALL runs 571# after the install, where this one runs just before a reboot. 572# (default undefined) 573#SWITCH_TO_TEST = cp ${OUTPUT_DIR}/${BUILD_TARGET} ${TARGET_IMAGE} 574 575# If you are using a machine that doesn't boot with grub, and 576# perhaps gets its kernel from a remote server (tftp), then 577# you can use this option to update the target image with the 578# the known good image to reboot safely back into. 579# 580# This option holds a command that will execute before needing 581# to reboot to a good known image. 582# (default undefined) 583#SWITCH_TO_GOOD = ssh ${SSH_USER}/${MACHINE} cp good_image ${TARGET_IMAGE} 584 585# The min config that is needed to build for the machine 586# A nice way to create this is with the following: 587# 588# $ ssh target 589# $ lsmod > mymods 590# $ scp mymods host:/tmp 591# $ exit 592# $ cd linux.git 593# $ rm .config 594# $ make LSMOD=mymods localyesconfig 595# $ grep '^CONFIG' .config > /home/test/config-min 596# 597# If you want even less configs: 598# 599# log in directly to target (do not ssh) 600# 601# $ su 602# # lsmod | cut -d' ' -f1 | xargs rmmod 603# 604# repeat the above several times 605# 606# # lsmod > mymods 607# # reboot 608# 609# May need to reboot to get your network back to copy the mymods 610# to the host, and then remove the previous .config and run the 611# localyesconfig again. The CONFIG_MIN generated like this will 612# not guarantee network activity to the box so the TEST_TYPE of 613# test may fail. 614# 615# You might also want to set: 616# CONFIG_CMDLINE="<your options here>" 617# randconfig may set the above and override your real command 618# line options. 619# (default undefined) 620#MIN_CONFIG = /home/test/config-min 621 622# Sometimes there's options that just break the boot and 623# you do not care about. Here are a few: 624# # CONFIG_STAGING is not set 625# Staging drivers are horrible, and can break the build. 626# # CONFIG_SCSI_DEBUG is not set 627# SCSI_DEBUG may change your root partition 628# # CONFIG_KGDB_SERIAL_CONSOLE is not set 629# KGDB may cause oops waiting for a connection that's not there. 630# This option points to the file containing config options that will be prepended 631# to the MIN_CONFIG (or be the MIN_CONFIG if it is not set) 632# 633# Note, config options in MIN_CONFIG will override these options. 634# 635# (default undefined) 636#ADD_CONFIG = /home/test/config-broken 637 638# The location on the host where to write temp files 639# (default /tmp/ktest/${MACHINE}) 640#TMP_DIR = /tmp/ktest/${MACHINE} 641 642# Optional log file to write the status (recommended) 643# Note, this is a DEFAULT section only option. 644# (default undefined) 645#LOG_FILE = /home/test/logfiles/target.log 646 647# Remove old logfile if it exists before starting all tests. 648# Note, this is a DEFAULT section only option. 649# (default 0) 650#CLEAR_LOG = 0 651 652# Line to define a successful boot up in console output. 653# This is what the line contains, not the entire line. If you need 654# the entire line to match, then use regural expression syntax like: 655# (do not add any quotes around it) 656# 657# SUCCESS_LINE = ^MyBox Login:$ 658# 659# (default "login:") 660#SUCCESS_LINE = login: 661 662# To speed up between reboots, defining a line that the 663# default kernel produces that represents that the default 664# kernel has successfully booted and can be used to pass 665# a new test kernel to it. Otherwise ktest.pl will wait till 666# SLEEP_TIME to continue. 667# (default undefined) 668#REBOOT_SUCCESS_LINE = login: 669 670# In case the console constantly fills the screen, having 671# a specified time to stop the test after success is recommended. 672# (in seconds) 673# (default 10) 674#STOP_AFTER_SUCCESS = 10 675 676# In case the console constantly fills the screen, having 677# a specified time to stop the test after failure is recommended. 678# (in seconds) 679# (default 60) 680#STOP_AFTER_FAILURE = 60 681 682# In case the console constantly fills the screen, having 683# a specified time to stop the test if it never succeeds nor fails 684# is recommended. 685# Note: this is ignored if a success or failure is detected. 686# (in seconds) 687# (default 600, -1 is to never stop) 688#STOP_TEST_AFTER = 600 689 690# Stop testing if a build fails. If set, the script will end if 691# a failure is detected, otherwise it will save off the .config, 692# dmesg and bootlog in a directory called 693# MACHINE-TEST_TYPE_BUILD_TYPE-fail-yyyymmddhhmmss 694# if the STORE_FAILURES directory is set. 695# (default 1) 696# Note, even if this is set to zero, there are some errors that still 697# stop the tests. 698#DIE_ON_FAILURE = 1 699 700# Directory to store failure directories on failure. If this is not 701# set, DIE_ON_FAILURE=0 will not save off the .config, dmesg and 702# bootlog. This option is ignored if DIE_ON_FAILURE is not set. 703# (default undefined) 704#STORE_FAILURES = /home/test/failures 705 706# Directory to store success directories on success. If this is not 707# set, the .config, dmesg and bootlog will not be saved if a 708# test succeeds. 709# (default undefined) 710#STORE_SUCCESSES = /home/test/successes 711 712# Build without doing a make mrproper, or removing .config 713# (default 0) 714#BUILD_NOCLEAN = 0 715 716# As the test reads the console, after it hits the SUCCESS_LINE 717# the time it waits for the monitor to settle down between reads 718# can usually be lowered. 719# (in seconds) (default 1) 720#BOOTED_TIMEOUT = 1 721 722# The timeout in seconds when we consider the box hung after 723# the console stop producing output. Be sure to leave enough 724# time here to get pass a reboot. Some machines may not produce 725# any console output for a long time during a reboot. You do 726# not want the test to fail just because the system was in 727# the process of rebooting to the test kernel. 728# (default 120) 729#TIMEOUT = 120 730 731# The timeout in seconds when to test if the box can be rebooted 732# or not. Before issuing the reboot command, a ssh connection 733# is attempted to see if the target machine is still active. 734# If the target does not connect within this timeout, a power cycle 735# is issued instead of a reboot. 736# CONNECT_TIMEOUT = 25 737 738# In between tests, a reboot of the box may occur, and this 739# is the time to wait for the console after it stops producing 740# output. Some machines may not produce a large lag on reboot 741# so this should accommodate it. 742# The difference between this and TIMEOUT, is that TIMEOUT happens 743# when rebooting to the test kernel. This sleep time happens 744# after a test has completed and we are about to start running 745# another test. If a reboot to the reliable kernel happens, 746# we wait SLEEP_TIME for the console to stop producing output 747# before starting the next test. 748# 749# You can speed up reboot times even more by setting REBOOT_SUCCESS_LINE. 750# (default 60) 751#SLEEP_TIME = 60 752 753# The time in between bisects to sleep (in seconds) 754# (default 60) 755#BISECT_SLEEP_TIME = 60 756 757# The max wait time (in seconds) for waiting for the console to finish. 758# If for some reason, the console is outputting content without 759# ever finishing, this will cause ktest to get stuck. This 760# option is the max time ktest will wait for the monitor (console) 761# to settle down before continuing. 762# (default 1800) 763#MAX_MONITOR_WAIT 764 765# The time in between patch checks to sleep (in seconds) 766# (default 60) 767#PATCHCHECK_SLEEP_TIME = 60 768 769# Reboot the target box on error (default 0) 770#REBOOT_ON_ERROR = 0 771 772# Power off the target on error (ignored if REBOOT_ON_ERROR is set) 773# Note, this is a DEFAULT section only option. 774# (default 0) 775#POWEROFF_ON_ERROR = 0 776 777# Power off the target after all tests have completed successfully 778# Note, this is a DEFAULT section only option. 779# (default 0) 780#POWEROFF_ON_SUCCESS = 0 781 782# Reboot the target after all test completed successfully (default 1) 783# (ignored if POWEROFF_ON_SUCCESS is set) 784#REBOOT_ON_SUCCESS = 1 785 786# In case there are isses with rebooting, you can specify this 787# to always powercycle after this amount of time after calling 788# reboot. 789# Note, POWERCYCLE_AFTER_REBOOT = 0 does NOT disable it. It just 790# makes it powercycle immediately after rebooting. Do not define 791# it if you do not want it. 792# (default undefined) 793#POWERCYCLE_AFTER_REBOOT = 5 794 795# In case there's isses with halting, you can specify this 796# to always poweroff after this amount of time after calling 797# halt. 798# Note, POWEROFF_AFTER_HALT = 0 does NOT disable it. It just 799# makes it poweroff immediately after halting. Do not define 800# it if you do not want it. 801# (default undefined) 802#POWEROFF_AFTER_HALT = 20 803 804# A script or command to power off the box (default undefined) 805# Needed for POWEROFF_ON_ERROR and SUCCESS 806# 807# Example for digital loggers power switch: 808#POWER_OFF = wget --no-proxy -O /dev/null -q --auth-no-challenge 'http://admin:admin@power/outlet?5=OFF' 809# 810# Example for a virtual guest call "Guest". 811#POWER_OFF = virsh destroy Guest 812 813# To have the build fail on "new" warnings, create a file that 814# contains a list of all known warnings (they must match exactly 815# to the line with 'warning:', 'error:' or 'Error:'. If the option 816# WARNINGS_FILE is set, then that file will be read, and if the 817# build detects a warning, it will examine this file and if the 818# warning does not exist in it, it will fail the build. 819# 820# Note, if this option is defined to a file that does not exist 821# then any warning will fail the build. 822# (see make_warnings_file below) 823# 824# (optional, default undefined) 825#WARNINGS_FILE = ${OUTPUT_DIR}/warnings_file 826 827# The way to execute a command on the target 828# (default ssh $SSH_USER@$MACHINE $SSH_COMMAND";) 829# The variables SSH_USER, MACHINE and SSH_COMMAND are defined 830#SSH_EXEC = ssh $SSH_USER@$MACHINE $SSH_COMMAND"; 831 832# The way to copy a file to the target (install and modules) 833# (default scp $SRC_FILE $SSH_USER@$MACHINE:$DST_FILE) 834# The variables SSH_USER, MACHINE are defined by the config 835# SRC_FILE and DST_FILE are ktest internal variables and 836# should only have '$' and not the '${}' notation. 837# (default scp $SRC_FILE ${SSH_USER}@${MACHINE}:$DST_FILE) 838#SCP_TO_TARGET = echo skip scp for $SRC_FILE $DST_FILE 839 840# If install needs to be different than modules, then this 841# option will override the SCP_TO_TARGET for installation. 842# (default ${SCP_TO_TARGET} ) 843#SCP_TO_TARGET_INSTALL = scp $SRC_FILE tftp@tftpserver:$DST_FILE 844 845# The nice way to reboot the target 846# (default ssh $SSH_USER@$MACHINE reboot) 847# The variables SSH_USER and MACHINE are defined. 848#REBOOT = ssh $SSH_USER@$MACHINE reboot 849 850# The way triple faults are detected is by testing the kernel 851# banner. If the kernel banner for the kernel we are testing is 852# found, and then later a kernel banner for another kernel version 853# is found, it is considered that we encountered a triple fault, 854# and there is no panic or callback, but simply a reboot. 855# To disable this (because it did a false positive) set the following 856# to 0. 857# (default 1) 858#DETECT_TRIPLE_FAULT = 0 859 860# All options in the config file should be either used by ktest 861# or could be used within a value of another option. If an option 862# in the config file is not used, ktest will warn about it and ask 863# if you want to continue. 864# 865# If you don't care if there are non-used options, enable this 866# option. Be careful though, a non-used option is usually a sign 867# of an option name being typed incorrectly. 868# (default 0) 869#IGNORE_UNUSED = 1 870 871# When testing a kernel that happens to have WARNINGs, and call 872# traces, ktest.pl will detect these and fail a boot or test run 873# due to warnings. By setting this option, ktest will ignore 874# call traces, and will not fail a test if the kernel produces 875# an oops. Use this option with care. 876# (default 0) 877#IGNORE_ERRORS = 1 878 879#### Per test run options #### 880# The following options are only allowed in TEST_START sections. 881# They are ignored in the DEFAULTS sections. 882# 883# All of these are optional and undefined by default, although 884# some of these options are required for TEST_TYPE of patchcheck 885# and bisect. 886# 887# 888# CHECKOUT = branch 889# 890# If the BUILD_DIR is a git repository, then you can set this option 891# to checkout the given branch before running the TEST. If you 892# specify this for the first run, that branch will be used for 893# all preceding tests until a new CHECKOUT is set. 894# 895# 896# TEST_NAME = name 897# 898# If you want the test to have a name that is displayed in 899# the test result banner at the end of the test, then use this 900# option. This is useful to search for the RESULT keyword and 901# not have to translate a test number to a test in the config. 902# 903# For TEST_TYPE = patchcheck 904# 905# This expects the BUILD_DIR to be a git repository, and 906# will checkout the PATCHCHECK_START commit. 907# 908# The option BUILD_TYPE will be ignored. 909# 910# The MIN_CONFIG will be used for all builds of the patchcheck. The build type 911# used for patchcheck is oldconfig. 912# 913# PATCHCHECK_START is required and is the first patch to 914# test (the SHA1 of the commit). You may also specify anything 915# that git checkout allows (branch name, tage, HEAD~3). 916# 917# PATCHCHECK_END is the last patch to check (default HEAD) 918# 919# PATCHCHECK_CHERRY if set to non zero, then git cherry will be 920# performed against PATCHCHECK_START and PATCHCHECK_END. That is 921# 922# git cherry ${PATCHCHECK_START} ${PATCHCHECK_END} 923# 924# Then the changes found will be tested. 925# 926# Note, PATCHCHECK_CHERRY requires PATCHCHECK_END to be defined. 927# (default 0) 928# 929# PATCHCHECK_TYPE is required and is the type of test to run: 930# build, boot, test. 931# 932# Note, the build test will look for warnings, if a warning occurred 933# in a file that a commit touches, the build will fail, unless 934# IGNORE_WARNINGS is set for the given commit's sha1 935# 936# IGNORE_WARNINGS can be used to disable the failure of patchcheck 937# on a particuler commit (SHA1). You can add more than one commit 938# by adding a list of SHA1s that are space delimited. 939# 940# If BUILD_NOCLEAN is set, then make mrproper will not be run on 941# any of the builds, just like all other TEST_TYPE tests. But 942# what makes patchcheck different from the other tests, is if 943# BUILD_NOCLEAN is not set, only the first and last patch run 944# make mrproper. This helps speed up the test. 945# 946# Example: 947# TEST_START 948# TEST_TYPE = patchcheck 949# CHECKOUT = mybranch 950# PATCHCHECK_TYPE = boot 951# PATCHCHECK_START = 747e94ae3d1b4c9bf5380e569f614eb9040b79e7 952# PATCHCHECK_END = HEAD~2 953# IGNORE_WARNINGS = 42f9c6b69b54946ffc0515f57d01dc7f5c0e4712 0c17ca2c7187f431d8ffc79e81addc730f33d128 954# 955# 956# 957# For TEST_TYPE = bisect 958# 959# You can specify a git bisect if the BUILD_DIR is a git repository. 960# The MIN_CONFIG will be used for all builds of the bisect. The build type 961# used for bisecting is oldconfig. 962# 963# The option BUILD_TYPE will be ignored. 964# 965# BISECT_TYPE is the type of test to perform: 966# build - bad fails to build 967# boot - bad builds but fails to boot 968# test - bad boots but fails a test 969# 970# BISECT_GOOD is the commit (SHA1) to label as good (accepts all git good commit types) 971# BISECT_BAD is the commit to label as bad (accepts all git bad commit types) 972# 973# The above three options are required for a bisect operation. 974# 975# BISECT_REPLAY = /path/to/replay/file (optional, default undefined) 976# 977# If an operation failed in the bisect that was not expected to 978# fail. Then the test ends. The state of the BUILD_DIR will be 979# left off at where the failure occurred. You can examine the 980# reason for the failure, and perhaps even find a git commit 981# that would work to continue with. You can run: 982# 983# git bisect log > /path/to/replay/file 984# 985# The adding: 986# 987# BISECT_REPLAY= /path/to/replay/file 988# 989# And running the test again. The test will perform the initial 990# git bisect start, git bisect good, and git bisect bad, and 991# then it will run git bisect replay on this file, before 992# continuing with the bisect. 993# 994# BISECT_START = commit (optional, default undefined) 995# 996# As with BISECT_REPLAY, if the test failed on a commit that 997# just happen to have a bad commit in the middle of the bisect, 998# and you need to skip it. If BISECT_START is defined, it 999# will checkout that commit after doing the initial git bisect start, 1000# git bisect good, git bisect bad, and running the git bisect replay 1001# if the BISECT_REPLAY is set. 1002# 1003# BISECT_SKIP = 1 (optional, default 0) 1004# 1005# If BISECT_TYPE is set to test but the build fails, ktest will 1006# simply fail the test and end their. You could use BISECT_REPLAY 1007# and BISECT_START to resume after you found a new starting point, 1008# or you could set BISECT_SKIP to 1. If BISECT_SKIP is set to 1, 1009# when something other than the BISECT_TYPE fails, ktest.pl will 1010# run "git bisect skip" and try again. 1011# 1012# BISECT_FILES = <path> (optional, default undefined) 1013# 1014# To just run the git bisect on a specific path, set BISECT_FILES. 1015# For example: 1016# 1017# BISECT_FILES = arch/x86 kernel/time 1018# 1019# Will run the bisect with "git bisect start -- arch/x86 kernel/time" 1020# 1021# BISECT_REVERSE = 1 (optional, default 0) 1022# 1023# In those strange instances where it was broken forever 1024# and you are trying to find where it started to work! 1025# Set BISECT_GOOD to the commit that was last known to fail 1026# Set BISECT_BAD to the commit that is known to start working. 1027# With BISECT_REVERSE = 1, The test will consider failures as 1028# good, and success as bad. 1029# 1030# BISECT_MANUAL = 1 (optional, default 0) 1031# 1032# In case there's a problem with automating the bisect for 1033# whatever reason. (Can't reboot, want to inspect each iteration) 1034# Doing a BISECT_MANUAL will have the test wait for you to 1035# tell it if the test passed or failed after each iteration. 1036# This is basicall the same as running git bisect yourself 1037# but ktest will rebuild and install the kernel for you. 1038# 1039# BISECT_CHECK = 1 (optional, default 0) 1040# 1041# Just to be sure the good is good and bad is bad, setting 1042# BISECT_CHECK to 1 will start the bisect by first checking 1043# out BISECT_BAD and makes sure it fails, then it will check 1044# out BISECT_GOOD and makes sure it succeeds before starting 1045# the bisect (it works for BISECT_REVERSE too). 1046# 1047# You can limit the test to just check BISECT_GOOD or 1048# BISECT_BAD with BISECT_CHECK = good or 1049# BISECT_CHECK = bad, respectively. 1050# 1051# BISECT_TRIES = 5 (optional, default 1) 1052# 1053# For those cases that it takes several tries to hit a bug, 1054# the BISECT_TRIES is useful. It is the number of times the 1055# test is ran before it says the kernel is good. The first failure 1056# will stop trying and mark the current SHA1 as bad. 1057# 1058# Note, as with all race bugs, there's no guarantee that if 1059# it succeeds, it is really a good bisect. But it helps in case 1060# the bug is some what reliable. 1061# 1062# You can set BISECT_TRIES to zero, and all tests will be considered 1063# good, unless you also set BISECT_MANUAL. 1064# 1065# BISECT_RET_GOOD = 0 (optional, default undefined) 1066# 1067# In case the specificed test returns something other than just 1068# 0 for good, and non-zero for bad, you can override 0 being 1069# good by defining BISECT_RET_GOOD. 1070# 1071# BISECT_RET_BAD = 1 (optional, default undefined) 1072# 1073# In case the specificed test returns something other than just 1074# 0 for good, and non-zero for bad, you can override non-zero being 1075# bad by defining BISECT_RET_BAD. 1076# 1077# BISECT_RET_ABORT = 255 (optional, default undefined) 1078# 1079# If you need to abort the bisect if the test discovers something 1080# that was wrong, you can define BISECT_RET_ABORT to be the error 1081# code returned by the test in order to abort the bisect. 1082# 1083# BISECT_RET_SKIP = 2 (optional, default undefined) 1084# 1085# If the test detects that the current commit is neither good 1086# nor bad, but something else happened (another bug detected) 1087# you can specify BISECT_RET_SKIP to an error code that the 1088# test returns when it should skip the current commit. 1089# 1090# BISECT_RET_DEFAULT = good (optional, default undefined) 1091# 1092# You can override the default of what to do when the above 1093# options are not hit. This may be one of, "good", "bad", 1094# "abort" or "skip" (without the quotes). 1095# 1096# Note, if you do not define any of the previous BISECT_RET_* 1097# and define BISECT_RET_DEFAULT, all bisects results will do 1098# what the BISECT_RET_DEFAULT has. 1099# 1100# 1101# Example: 1102# TEST_START 1103# TEST_TYPE = bisect 1104# BISECT_GOOD = v2.6.36 1105# BISECT_BAD = b5153163ed580e00c67bdfecb02b2e3843817b3e 1106# BISECT_TYPE = build 1107# MIN_CONFIG = /home/test/config-bisect 1108# 1109# 1110# 1111# For TEST_TYPE = config_bisect 1112# 1113# In those cases that you have two different configs. One of them 1114# work, the other does not, and you do not know what config causes 1115# the problem. 1116# The TEST_TYPE config_bisect will bisect the bad config looking for 1117# what config causes the failure. 1118# 1119# The way it works is this: 1120# 1121# You can specify a good config with CONFIG_BISECT_GOOD, otherwise it 1122# will use the MIN_CONFIG, and if that's not specified, it will use 1123# the config that comes with "make defconfig". 1124# 1125# It runs both the good and bad configs through a make oldconfig to 1126# make sure that they are set up for the kernel that is checked out. 1127# 1128# It then reads the configs that are set, as well as the ones that are 1129# not set for both the good and bad configs, and then compares them. 1130# It will set half of the good configs within the bad config (note, 1131# "set" means to make the bad config match the good config, a config 1132# in the good config that is off, will be turned off in the bad 1133# config. That is considered a "set"). 1134# 1135# It tests this new config and if it works, it becomes the new good 1136# config, otherwise it becomes the new bad config. It continues this 1137# process until there's only one config left and it will report that 1138# config. 1139# 1140# The "bad config" can also be a config that is needed to boot but was 1141# disabled because it depended on something that wasn't set. 1142# 1143# During this process, it saves the current good and bad configs in 1144# ${TMP_DIR}/good_config and ${TMP_DIR}/bad_config respectively. 1145# If you stop the test, you can copy them to a new location to 1146# reuse them again. 1147# 1148# Although the MIN_CONFIG may be the config it starts with, the 1149# MIN_CONFIG is ignored. 1150# 1151# The option BUILD_TYPE will be ignored. 1152# 1153# CONFIG_BISECT_TYPE is the type of test to perform: 1154# build - bad fails to build 1155# boot - bad builds but fails to boot 1156# test - bad boots but fails a test 1157# 1158# CONFIG_BISECT is the config that failed to boot 1159# 1160# If BISECT_MANUAL is set, it will pause between iterations. 1161# This is useful to use just ktest.pl just for the config bisect. 1162# If you set it to build, it will run the bisect and you can 1163# control what happens in between iterations. It will ask you if 1164# the test succeeded or not and continue the config bisect. 1165# 1166# CONFIG_BISECT_GOOD (optional) 1167# If you have a good config to start with, then you 1168# can specify it with CONFIG_BISECT_GOOD. Otherwise 1169# the MIN_CONFIG is the base, if MIN_CONFIG is not set 1170# It will build a config with "make defconfig" 1171# 1172# CONFIG_BISECT_CHECK (optional) 1173# Set this to 1 if you want to confirm that the config ktest 1174# generates (the bad config with the min config) is still bad. 1175# It may be that the min config fixes what broke the bad config 1176# and the test will not return a result. 1177# Set it to "good" to test only the good config and set it 1178# to "bad" to only test the bad config. 1179# 1180# Example: 1181# TEST_START 1182# TEST_TYPE = config_bisect 1183# CONFIG_BISECT_TYPE = build 1184# CONFIG_BISECT = /home/test/config-bad 1185# MIN_CONFIG = /home/test/config-min 1186# BISECT_MANUAL = 1 1187# 1188# 1189# 1190# For TEST_TYPE = make_min_config 1191# 1192# After doing a make localyesconfig, your kernel configuration may 1193# not be the most useful minimum configuration. Having a true minimum 1194# config that you can use against other configs is very useful if 1195# someone else has a config that breaks on your code. By only forcing 1196# those configurations that are truly required to boot your machine 1197# will give you less of a chance that one of your set configurations 1198# will make the bug go away. This will give you a better chance to 1199# be able to reproduce the reported bug matching the broken config. 1200# 1201# Note, this does take some time, and may require you to run the 1202# test over night, or perhaps over the weekend. But it also allows 1203# you to interrupt it, and gives you the current minimum config 1204# that was found till that time. 1205# 1206# Note, this test automatically assumes a BUILD_TYPE of oldconfig 1207# and its test type acts like boot. 1208# TODO: add a test version that makes the config do more than just 1209# boot, like having network access. 1210# 1211# To save time, the test does not just grab any option and test 1212# it. The Kconfig files are examined to determine the dependencies 1213# of the configs. If a config is chosen that depends on another 1214# config, that config will be checked first. By checking the 1215# parents first, we can eliminate whole groups of configs that 1216# may have been enabled. 1217# 1218# For example, if a USB device config is chosen and depends on CONFIG_USB, 1219# the CONFIG_USB will be tested before the device. If CONFIG_USB is 1220# found not to be needed, it, as well as all configs that depend on 1221# it, will be disabled and removed from the current min_config. 1222# 1223# OUTPUT_MIN_CONFIG is the path and filename of the file that will 1224# be created from the MIN_CONFIG. If you interrupt the test, set 1225# this file as your new min config, and use it to continue the test. 1226# This file does not need to exist on start of test. 1227# This file is not created until a config is found that can be removed. 1228# If this file exists, you will be prompted if you want to use it 1229# as the min_config (overriding MIN_CONFIG) if START_MIN_CONFIG 1230# is not defined. 1231# (required field) 1232# 1233# START_MIN_CONFIG is the config to use to start the test with. 1234# you can set this as the same OUTPUT_MIN_CONFIG, but if you do 1235# the OUTPUT_MIN_CONFIG file must exist. 1236# (default MIN_CONFIG) 1237# 1238# IGNORE_CONFIG is used to specify a config file that has configs that 1239# you already know must be set. Configs are written here that have 1240# been tested and proved to be required. It is best to define this 1241# file if you intend on interrupting the test and running it where 1242# it left off. New configs that it finds will be written to this file 1243# and will not be tested again in later runs. 1244# (optional) 1245# 1246# MIN_CONFIG_TYPE can be either 'boot' or 'test'. With 'boot' it will 1247# test if the created config can just boot the machine. If this is 1248# set to 'test', then the TEST option must be defined and the created 1249# config will not only boot the target, but also make sure that the 1250# config lets the test succeed. This is useful to make sure the final 1251# config that is generated allows network activity (ssh). 1252# (optional) 1253# 1254# USE_OUTPUT_MIN_CONFIG set this to 1 if you do not want to be prompted 1255# about using the OUTPUT_MIN_CONFIG as the MIN_CONFIG as the starting 1256# point. Set it to 0 if you want to always just use the given MIN_CONFIG. 1257# If it is not defined, it will prompt you to pick which config 1258# to start with (MIN_CONFIG or OUTPUT_MIN_CONFIG). 1259# 1260# Example: 1261# 1262# TEST_TYPE = make_min_config 1263# OUTPUT_MIN_CONFIG = /path/to/config-new-min 1264# START_MIN_CONFIG = /path/to/config-min 1265# IGNORE_CONFIG = /path/to/config-tested 1266# MIN_CONFIG_TYPE = test 1267# TEST = ssh ${USER}@${MACHINE} echo hi 1268# 1269# 1270# 1271# 1272# For TEST_TYPE = make_warnings_file 1273# 1274# If you want the build to fail when a new warning is discovered 1275# you set the WARNINGS_FILE to point to a file of known warnings. 1276# 1277# The test "make_warnings_file" will let you create a new warnings 1278# file before you run other tests, like patchcheck. 1279# 1280# What this test does is to run just a build, you still need to 1281# specify BUILD_TYPE to tell the test what type of config to use. 1282# A BUILD_TYPE of nobuild will fail this test. 1283# 1284# The test will do the build and scan for all warnings. Any warning 1285# it discovers will be saved in the WARNINGS_FILE (required) option. 1286# 1287# It is recommended (but not necessary) to make sure BUILD_NOCLEAN is 1288# off, so that a full build is done (make mrproper is performed). 1289# That way, all warnings will be captured. 1290# 1291# Example: 1292# 1293# TEST_TYPE = make_warnings_file 1294# WARNINGS_FILE = ${OUTPUT_DIR} 1295# BUILD_TYPE = useconfig:oldconfig 1296# CHECKOUT = v3.8 1297# BUILD_NOCLEAN = 0 1298# 1299