Results for builtin-bash.test.sh

statusbashdashashzshmkshkshtoyshsushbrushosh
pass 130100010109
N-I 0999900000
FAIL 0434413121334
total13131313131313131313
casebashdashashzshmkshkshtoyshsushbrushoshdescription
0pass FAIL pass FAIL FAIL FAIL pass FAIL pass pass help
detailsdetailsdetailsdetailsdetails
1pass FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL pass bad help topic
detailsdetailsdetailsdetailsdetailsdetailsdetailsdetails
2pass N-I N-I N-I N-I FAIL FAIL FAIL pass pass mapfile
detailsdetailsdetailsdetailsdetailsdetailsdetails
3pass N-I N-I N-I N-I FAIL FAIL FAIL pass pass readarray (synonym for mapfile)
detailsdetailsdetailsdetailsdetailsdetailsdetails
4pass N-I N-I N-I N-I FAIL FAIL FAIL pass pass mapfile (array name): arr
detailsdetailsdetailsdetailsdetailsdetailsdetails
5pass N-I N-I N-I N-I FAIL FAIL FAIL pass FAIL mapfile (delimiter): -d delim
detailsdetailsdetailsdetailsdetailsdetailsdetailsdetails
6pass N-I N-I N-I N-I FAIL FAIL FAIL FAIL FAIL mapfile (delimiter): -d '' (null-separated)
detailsdetailsdetailsdetailsdetailsdetailsdetailsdetailsdetails
7pass N-I N-I N-I N-I FAIL FAIL FAIL pass pass mapfile (truncate delim): -t
detailsdetailsdetailsdetailsdetailsdetailsdetails
8pass N-I N-I N-I N-I FAIL FAIL FAIL pass pass mapfile -t doesn't remove \r
detailsdetailsdetailsdetailsdetailsdetailsdetails
9pass FAIL FAIL FAIL FAIL FAIL FAIL FAIL pass pass mapfile -t bugs (ble.sh)
detailsdetailsdetailsdetailsdetailsdetailsdetails
10pass N-I N-I N-I N-I FAIL FAIL FAIL FAIL FAIL mapfile (store position): -O start
detailsdetailsdetailsdetailsdetailsdetailsdetailsdetailsdetails
11pass N-I N-I N-I N-I FAIL FAIL FAIL pass FAIL mapfile (input range): -s start -n count
detailsdetailsdetailsdetailsdetailsdetailsdetailsdetails
12pass FAIL FAIL FAIL FAIL FAIL FAIL FAIL pass pass mapfile / readarray stdin TODO: Fix me.
detailsdetailsdetailsdetailsdetailsdetailsdetails
34 passed, 0 OK, 36 not implemented, 0 BUG, 60 failed, 0 timeouts, 0 cases skipped
4 failed under osh

Details on runs that didn't PASS

dash0 help

[dash stderr] Expected 'status=0\nstatus=0\nstatus=0\n', got 'dash: 1: help: not found\nstatus=127\ndash: 3: help: not found\nstatus=127\ndash: 5: help: not found\nstatus=127\n'

stdout:
stderr: 
dash: 1: help: not found
status=127
dash: 3: help: not found
status=127
dash: 5: help: not found
status=127
zsh0 help

[zsh stderr] Expected 'status=0\nstatus=0\nstatus=0\n', got 'zsh: command not found: help\nstatus=127\nzsh: command not found: help\nstatus=127\nzsh: command not found: help\nstatus=127\n'

stdout:
stderr: 
zsh: command not found: help
status=127
zsh: command not found: help
status=127
zsh: command not found: help
status=127
mksh0 help

[mksh stderr] Expected 'status=0\nstatus=0\nstatus=0\n', got 'mksh: <stdin>[1]: help: not found\nstatus=127\nmksh: <stdin>[3]: help: not found\nstatus=127\nmksh: <stdin>[5]: help: not found\nstatus=127\n'

stdout:
stderr: 
mksh: <stdin>[1]: help: not found
status=127
mksh: <stdin>[3]: help: not found
status=127
mksh: <stdin>[5]: help: not found
status=127
ksh0 help

[ksh stderr] Expected 'status=0\nstatus=0\nstatus=0\n', got 'E: ksh: <stdin>[1]: help: inaccessible or not found\nstatus=127\nE: ksh: <stdin>[3]: help: inaccessible or not found\nstatus=127\nE: ksh: <stdin>[5]: help: inaccessible or not found\nstatus=127\n'

stdout:
stderr: 
E: ksh: <stdin>[1]: help: inaccessible or not found
status=127
E: ksh: <stdin>[3]: help: inaccessible or not found
status=127
E: ksh: <stdin>[5]: help: inaccessible or not found
status=127
sush0 help

[sush stderr] Expected 'status=0\nstatus=0\nstatus=0\n', got '/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 1: help: command not found\nstatus=127\n/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 3: help: command not found\nstatus=127\n/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 5: help: command not found\nstatus=127\n'

stdout:
stderr: 
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 1: help: command not found
status=127
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 3: help: command not found
status=127
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 5: help: command not found
status=127
dash1 bad help topic

[dash stdout] Expected 'help=1\ngrep=0\n', got 'help=127\ngrep=1\n'

stdout:
help=127
grep=1
stderr:
ash1 bad help topic

[ash stdout] Expected 'help=1\ngrep=0\n', got 'Built-in commands:\n------------------\n\t. : [ [[ alias bg break cd chdir command continue echo eval exec\n\texit export false fg getopts hash help history jobs kill let\n\tlocal printf pwd read readonly return set shift source test times\n\ttrap true type ulimit umask unalias unset wait\nhelp=0\ngrep=1\n'

stdout:
Built-in commands:
------------------
	. : [ [[ alias bg break cd chdir command continue echo eval exec
	exit export false fg getopts hash help history jobs kill let
	local printf pwd read readonly return set shift source test times
	trap true type ulimit umask unalias unset wait
help=0
grep=1
stderr:
zsh1 bad help topic

[zsh stdout] Expected 'help=1\ngrep=0\n', got 'help=127\ngrep=1\n'

stdout:
help=127
grep=1
stderr:
mksh1 bad help topic

[mksh stdout] Expected 'help=1\ngrep=0\n', got 'help=127\ngrep=1\n'

stdout:
help=127
grep=1
stderr:
ksh1 bad help topic

[ksh stdout] Expected 'help=1\ngrep=0\n', got 'help=127\ngrep=1\n'

stdout:
help=127
grep=1
stderr:
toysh1 bad help topic

[toysh stdout] Expected 'help=1\ngrep=0\n', got 'help=1\ngrep=1\n'

stdout:
help=1
grep=1
stderr:
sush1 bad help topic

[sush stdout] Expected 'help=1\ngrep=0\n', got 'help=127\ngrep=1\n'

stdout:
help=127
grep=1
stderr:
brush1 bad help topic

[brush stdout] Expected 'help=1\ngrep=0\n', got 'help=0\ngrep=0\n'

stdout:
help=0
grep=0
stderr:
dash2 mapfile

stdout:
stderr: 
ash2 mapfile

stdout:
stderr: 
zsh2 mapfile

stdout:
stderr: 
mksh2 mapfile

stdout:
stderr: 
ksh2 mapfile

[ksh stdout] Expected 'n=3\n[1\n]\n[3\n]\n[5\n]\n', got ''

stdout:
stderr: 
toysh2 mapfile

[toysh stdout] Expected 'n=3\n[1\n]\n[3\n]\n[5\n]\n', got ''

stdout:
stderr: 
sush2 mapfile

[sush stdout] Expected 'n=3\n[1\n]\n[3\n]\n[5\n]\n', got ''

stdout:
stderr: 
dash3 readarray (synonym for mapfile)

stdout:
stderr: 
ash3 readarray (synonym for mapfile)

stdout:
stderr: 
zsh3 readarray (synonym for mapfile)

stdout:
stderr: 
mksh3 readarray (synonym for mapfile)

stdout:
stderr: 
ksh3 readarray (synonym for mapfile)

[ksh stdout] Expected 'n=3\n[1\n]\n[3\n]\n[5\n]\n', got ''

stdout:
stderr: 
toysh3 readarray (synonym for mapfile)

[toysh stdout] Expected 'n=3\n[1\n]\n[3\n]\n[5\n]\n', got ''

stdout:
stderr: 
sush3 readarray (synonym for mapfile)

[sush stdout] Expected 'n=3\n[1\n]\n[3\n]\n[5\n]\n', got ''

stdout:
stderr: 
dash4 mapfile (array name): arr

stdout:
stderr: 
ash4 mapfile (array name): arr

stdout:
stderr: 
zsh4 mapfile (array name): arr

stdout:
stderr: 
mksh4 mapfile (array name): arr

stdout:
stderr: 
ksh4 mapfile (array name): arr

[ksh stdout] Expected 'n=3\n[1\n]\n[3\n]\n[5\n]\n', got ''

stdout:
stderr: 
toysh4 mapfile (array name): arr

[toysh stdout] Expected 'n=3\n[1\n]\n[3\n]\n[5\n]\n', got ''

stdout:
stderr: 
sush4 mapfile (array name): arr

[sush stdout] Expected 'n=3\n[1\n]\n[3\n]\n[5\n]\n', got ''

stdout:
stderr: 
dash5 mapfile (delimiter): -d delim

stdout:
stderr: 
ash5 mapfile (delimiter): -d delim

stdout:
stderr: 
zsh5 mapfile (delimiter): -d delim

stdout:
stderr: 
mksh5 mapfile (delimiter): -d delim

stdout:
stderr: 
ksh5 mapfile (delimiter): -d delim

[ksh stdout] Expected 'n=3\n[1:]\n[3:]\n[5:]\n', got ''

stdout:
stderr: 
toysh5 mapfile (delimiter): -d delim

[toysh stdout] Expected 'n=3\n[1:]\n[3:]\n[5:]\n', got ''

stdout:
stderr: 
sush5 mapfile (delimiter): -d delim

[sush stdout] Expected 'n=3\n[1:]\n[3:]\n[5:]\n', got ''

stdout:
stderr: 
osh5 mapfile (delimiter): -d delim

[osh stdout] Expected 'n=3\n[1:]\n[3:]\n[5:]\n', got 'n=0\n[]\n'

stdout:
n=0
[]
stderr:
    mapfile -d : arr
            ^~
[ stdin ]:3: 'mapfile' doesn't accept flag -d
dash6 mapfile (delimiter): -d '' (null-separated)

stdout:
stderr: 
ash6 mapfile (delimiter): -d '' (null-separated)

stdout:
stderr: 
zsh6 mapfile (delimiter): -d '' (null-separated)

stdout:
stderr: 
mksh6 mapfile (delimiter): -d '' (null-separated)

stdout:
stderr: 
ksh6 mapfile (delimiter): -d '' (null-separated)

[ksh stdout] Expected 'n=3\n[1]\n[3]\n[5]\n', got ''

stdout:
stderr: 
toysh6 mapfile (delimiter): -d '' (null-separated)

[toysh stdout] Expected 'n=3\n[1]\n[3]\n[5]\n', got ''

stdout:
stderr: 
sush6 mapfile (delimiter): -d '' (null-separated)

[sush stdout] Expected 'n=3\n[1]\n[3]\n[5]\n', got ''

stdout:
stderr: 
brush6 mapfile (delimiter): -d '' (null-separated)

[brush stdout] Expected 'n=3\n[1]\n[3]\n[5]\n', got 'n=1\n[1\x003\x005\x00]\n'

stdout:
n=1
[135]
stderr:
osh6 mapfile (delimiter): -d '' (null-separated)

[osh stdout] Expected 'n=3\n[1]\n[3]\n[5]\n', got 'n=0\n[]\n'

stdout:
n=0
[]
stderr:
    mapfile -d '' arr
            ^~
[ stdin ]:3: 'mapfile' doesn't accept flag -d
dash7 mapfile (truncate delim): -t

stdout:
stderr: 
ash7 mapfile (truncate delim): -t

stdout:
stderr: 
zsh7 mapfile (truncate delim): -t

stdout:
stderr: 
mksh7 mapfile (truncate delim): -t

stdout:
stderr: 
ksh7 mapfile (truncate delim): -t

[ksh stdout] Expected 'n=3\n[1]\n[3]\n[5]\n', got ''

stdout:
stderr: 
toysh7 mapfile (truncate delim): -t

[toysh stdout] Expected 'n=3\n[1]\n[3]\n[5]\n', got ''

stdout:
stderr: 
sush7 mapfile (truncate delim): -t

[sush stdout] Expected 'n=3\n[1]\n[3]\n[5]\n', got ''

stdout:
stderr: 
dash8 mapfile -t doesn't remove \r

stdout:
stderr: 
ash8 mapfile -t doesn't remove \r

stdout:
stderr: 
zsh8 mapfile -t doesn't remove \r

stdout:
stderr: 
mksh8 mapfile -t doesn't remove \r

stdout:
stderr: 
ksh8 mapfile -t doesn't remove \r

[ksh stdout] Expected "['1\\r', '3\\r', '5\\r']\n", got ''

stdout:
stderr: 
toysh8 mapfile -t doesn't remove \r

[toysh stdout] Expected "['1\\r', '3\\r', '5\\r']\n", got ''

stdout:
stderr: 
sush8 mapfile -t doesn't remove \r

[sush stdout] Expected "['1\\r', '3\\r', '5\\r']\n", got ''

stdout:
stderr: 
dash9 mapfile -t bugs (ble.sh)

[dash stdout] Expected 'len=3\nlen=2\nlen=2\n', got ''
[dash status] Expected 0, got 2

stdout:
stderr: 
dash: 1: Syntax error: redirection unexpected
ash9 mapfile -t bugs (ble.sh)

[ash stdout] Expected 'len=3\nlen=2\nlen=2\n', got ''
[ash status] Expected 0, got 2

stdout:
stderr: 
ash: syntax error: unexpected redirection
zsh9 mapfile -t bugs (ble.sh)

[zsh stdout] Expected 'len=3\nlen=2\nlen=2\n', got 'len=0\nlen=0\nlen=0\n'

stdout:
len=0
len=0
len=0
stderr:
zsh: command not found: mapfile
zsh: command not found: mapfile
zsh: command not found: mapfile
mksh9 mapfile -t bugs (ble.sh)

[mksh stdout] Expected 'len=3\nlen=2\nlen=2\n', got 'len=0\nlen=0\nlen=0\n'

stdout:
len=0
len=0
len=0
stderr:
mksh: <stdin>[1]: mapfile: not found
mksh: <stdin>[4]: mapfile: not found
mksh: <stdin>[7]: mapfile: not found
ksh9 mapfile -t bugs (ble.sh)

[ksh stdout] Expected 'len=3\nlen=2\nlen=2\n', got 'len=0\nlen=0\nlen=0\n'

stdout:
len=0
len=0
len=0
stderr:
E: ksh: <stdin>[1]: mapfile: inaccessible or not found
E: ksh: <stdin>[4]: mapfile: inaccessible or not found
E: ksh: <stdin>[7]: mapfile: inaccessible or not found
toysh9 mapfile -t bugs (ble.sh)

[toysh stdout] Expected 'len=3\nlen=2\nlen=2\n', got ''
[toysh status] Expected 0, got 1

stdout:
stderr: 
sh: mapfile: No such file or directory
main: line 2: sh: lines: [@]}
sh: mapfile: No such file or directory
main: line 5: sh: lines: [@]}
sh: mapfile: No such file or directory
main: line 8: sh: lines: [@]}
sush9 mapfile -t bugs (ble.sh)

[sush stdout] Expected 'len=3\nlen=2\nlen=2\n', got 'len=0\nlen=0\nlen=0\n'

stdout:
len=0
len=0
len=0
stderr:
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 1: mapfile: command not found
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 4: mapfile: command not found
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 7: mapfile: command not found
dash10 mapfile (store position): -O start

stdout:
stderr: 
ash10 mapfile (store position): -O start

stdout:
stderr: 
zsh10 mapfile (store position): -O start

stdout:
stderr: 
mksh10 mapfile (store position): -O start

stdout:
stderr: 
ksh10 mapfile (store position): -O start

[ksh stdout] Expected 'n=5\n[x]\n[y]\n[a0]\n[a1]\n[a2]\n', got ''

stdout:
stderr: 
toysh10 mapfile (store position): -O start

[toysh stdout] Expected 'n=5\n[x]\n[y]\n[a0]\n[a1]\n[a2]\n', got ''

stdout:
stderr: 
sush10 mapfile (store position): -O start

[sush stdout] Expected 'n=5\n[x]\n[y]\n[a0]\n[a1]\n[a2]\n', got ''

stdout:
stderr: 
brush10 mapfile (store position): -O start

[brush stdout] Expected 'n=5\n[x]\n[y]\n[a0]\n[a1]\n[a2]\n', got 'n=3\n[x]\n[y]\n[z]\n'

stdout:
n=3
[x]
[y]
[z]
stderr:
 WARN not yet implemented: mapfile -O is not yet implemented
osh10 mapfile (store position): -O start

[osh stdout] Expected 'n=5\n[x]\n[y]\n[a0]\n[a1]\n[a2]\n', got 'n=3\n[x]\n[y]\n[z]\n'

stdout:
n=3
[x]
[y]
[z]
stderr:
    mapfile -O 2 -t arr
            ^~
[ stdin ]:4: 'mapfile' doesn't accept flag -O
dash11 mapfile (input range): -s start -n count

stdout:
stderr: 
ash11 mapfile (input range): -s start -n count

stdout:
stderr: 
zsh11 mapfile (input range): -s start -n count

stdout:
stderr: 
mksh11 mapfile (input range): -s start -n count

stdout:
stderr: 
ksh11 mapfile (input range): -s start -n count

[ksh stdout] Expected 'n=3\n[a5]\n[a6]\n[a7]\n', got ''

stdout:
stderr: 
toysh11 mapfile (input range): -s start -n count

[toysh stdout] Expected 'n=3\n[a5]\n[a6]\n[a7]\n', got ''

stdout:
stderr: 
sush11 mapfile (input range): -s start -n count

[sush stdout] Expected 'n=3\n[a5]\n[a6]\n[a7]\n', got ''

stdout:
stderr: 
osh11 mapfile (input range): -s start -n count

[osh stdout] Expected 'n=3\n[a5]\n[a6]\n[a7]\n', got 'n=0\n[]\n'

stdout:
n=0
[]
stderr:
    mapfile -s 5 -n 3 -t arr
            ^~
[ stdin ]:3: 'mapfile' doesn't accept flag -s
dash12 mapfile / readarray stdin TODO: Fix me.

[dash stdout] Expected '2\n3\n', got '0\n0\n'

stdout:
0
0
stderr:
dash: 1: shopt: not found
dash: 3: mapfile: not found
seq: write error: Broken pipe
dash: 4: readarray: not found
seq: write error: Broken pipe
ash12 mapfile / readarray stdin TODO: Fix me.

[ash stdout] Expected '2\n3\n', got ''
[ash status] Expected 0, got 2

stdout:
stderr: 
ash: shopt: not found
ash: mapfile: not found
ash: readarray: not found
seq: write error: Broken pipe
ash: syntax error: bad substitution
zsh12 mapfile / readarray stdin TODO: Fix me.

[zsh stdout] Expected '2\n3\n', got '0\n0\n'

stdout:
0
0
stderr:
zsh: command not found: shopt
zsh: command not found: mapfile
zsh: command not found: readarray
mksh12 mapfile / readarray stdin TODO: Fix me.

[mksh stdout] Expected '2\n3\n', got '0\n0\n'

stdout:
0
0
stderr:
mksh: <stdin>[1]: shopt: not found
mksh: <stdin>[3]: mapfile: not found
seq: write error: Broken pipe
mksh: <stdin>[4]: readarray: not found
seq: write error: Broken pipe
ksh12 mapfile / readarray stdin TODO: Fix me.

[ksh stdout] Expected '2\n3\n', got '0\n0\n'

stdout:
0
0
stderr:
E: ksh: <stdin>[1]: shopt: inaccessible or not found
E: ksh: <stdin>[3]: mapfile: inaccessible or not found
seq: write error: Broken pipe
E: ksh: <stdin>[4]: readarray: inaccessible or not found
seq: write error: Broken pipe
toysh12 mapfile / readarray stdin TODO: Fix me.

[toysh stdout] Expected '2\n3\n', got ''
[toysh status] Expected 0, got 1

stdout:
stderr: 
sh: shopt: No such file or directory
sh: mapfile: No such file or directory
sh: readarray: No such file or directory
main: line 5: sh: m: [@]}
main: line 6: sh: r: [@]}
sush12 mapfile / readarray stdin TODO: Fix me.

[sush stdout] Expected '2\n3\n', got '0\n0\n'

stdout:
0
0
stderr:
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 3: mapfile: command not found
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 4: readarray: command not found