Results for builtin-eval-source.test.sh

statusbashdashashzshmkshkshtoyshsushbrushosh
pass 198121312139151422
ok 0506500000
N-I 1702200000
BUG 0201300000
FAIL 201000913780
total22222222222222222222
casebashdashashzshmkshkshtoyshsushbrushoshdescription
0pass pass pass pass pass pass pass pass pass pass Eval
1pass BUG FAIL pass pass pass FAIL pass pass pass eval accepts/ignores --
detailsdetailsdetails
2pass ok FAIL ok ok FAIL FAIL FAIL FAIL pass eval usage
detailsdetailsdetailsdetailsdetailsdetailsdetailsdetails
3pass pass pass pass BUG pass FAIL FAIL FAIL pass eval string with 'break continue return error'
detailsdetailsdetailsdetails
4N-I N-I FAIL N-I N-I FAIL FAIL FAIL FAIL pass eval YSH block with 'break continue return error'
detailsdetailsdetailsdetailsdetailsdetailsdetailsdetailsdetails
5pass pass pass pass pass pass pass pass FAIL pass exit within eval (regression)
details
6pass pass pass pass pass pass pass pass FAIL pass exit within source (regression)
details
7pass pass pass pass pass pass pass pass pass pass Source
8pass N-I pass pass pass pass pass FAIL pass pass source accepts/ignores --
detailsdetails
9pass ok FAIL ok pass pass pass pass pass pass Source nonexistent
detailsdetailsdetails
10pass N-I pass ok ok FAIL FAIL pass pass pass Source with no arguments
detailsdetailsdetailsdetailsdetails
11pass N-I pass pass pass pass FAIL pass pass pass Source with arguments
detailsdetails
12pass N-I pass pass pass pass FAIL FAIL FAIL pass Source from a function, mutating argv and defining a local var
detailsdetailsdetailsdetails
13FAIL ok FAIL ok ok FAIL FAIL pass pass pass Source with syntax error
detailsdetailsdetailsdetailsdetailsdetailsdetails
14FAIL ok FAIL ok ok FAIL FAIL pass pass pass Eval with syntax error
detailsdetailsdetailsdetailsdetailsdetailsdetails
15pass BUG FAIL pass BUG FAIL FAIL pass pass pass Eval in does tilde expansion
detailsdetailsdetailsdetailsdetails
16pass N-I FAIL BUG BUG FAIL FAIL pass pass pass Eval in bash does tilde expansion in array
detailsdetailsdetailsdetailsdetailsdetails
17pass N-I FAIL N-I N-I FAIL pass pass pass pass source works for files in current directory (bash only)
detailsdetailsdetailsdetailsdetails
18pass pass pass pass pass pass pass FAIL FAIL pass source looks in PATH for files
detailsdetails
19pass pass pass pass pass pass FAIL FAIL FAIL pass source finds files in PATH before current dir
detailsdetailsdetails
20pass pass pass pass pass pass pass pass pass pass source works for files in subdirectory
21pass ok FAIL ok ok FAIL FAIL pass pass pass source doesn't crash when targeting a directory
detailsdetailsdetailsdetailsdetailsdetails
137 passed, 16 OK, 12 not implemented, 6 BUG, 49 failed, 0 timeouts, 0 cases skipped

Details on runs that didn't PASS

dash1 eval accepts/ignores --

stdout: 
stderr: 


dash: 1: eval: --: not found

ash1 eval accepts/ignores --


[ash stdout] Expected 'hi\n', got ''

[ash status] Expected 0, got 127



stdout: 


stderr: 


ash: eval: line 1: --: not found

toysh1 eval accepts/ignores --


[toysh stdout] Expected 'hi\n', got ''

[toysh status] Expected 0, got 127



stdout: 


stderr: 


sh: --: No such file or directory

dash2 eval usage


stdout: 


127
127

stderr: 


dash: 1: eval: -: not found
dash: 1: eval: -z: not found

ash2 eval usage


[ash stdout] Expected '127\n2\n', got '127\n127\n'



stdout: 


127
127

stderr: 


ash: eval: line 1: -: not found
ash: eval: line 3: -z: not found

zsh2 eval usage


stdout: 


0
127

stderr: 


zsh: command not found: -z

mksh2 eval usage


stdout: 


127

stderr: 


mksh: -: not found
mksh: <stdin>[3]: eval: -z: unknown option

ksh2 eval usage


[ksh stdout] Expected '127\n2\n', got '127\n'

[ksh status] Expected 0, got 1



stdout: 


127

stderr: 


E: ksh: -: inaccessible or not found
E: ksh: <stdin>[3]: eval: -z: unknown option

toysh2 eval usage


[toysh stdout] Expected '127\n2\n', got '127\n127\n'



stdout: 


127
127

stderr: 


sh: -: No such file or directory
sh: -z: No such file or directory

sush2 eval usage


[sush stdout] Expected '127\n2\n', got '127\n127\n'



stdout: 


127
127

stderr: 


/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 1: -: command not found
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 1: -z: command not found

brush2 eval usage


[brush stdout] Expected '127\n2\n', got '127\n127\n'



stdout: 


127
127

stderr: 


-: command not found
-z: command not found

mksh3 eval string with 'break continue return error'


stdout: 


--- break
1
2
end func
--- continue
1
2
end func
--- return
1
--- false
1

stderr: 


mksh: break: can't break
mksh: break: can't break
mksh: continue: can't continue
mksh: continue: can't continue

toysh3 eval string with 'break continue return error'



[toysh stdout]
Expected '--- break\n1\nend func\n--- continue\n1\n2\nend func\n--- return\n1\n--- false\n1\n'
Got      '--- break\n1\n'


[toysh status] Expected 1, got -11



stdout: 


--- break
1

stderr: 


set: bad -e

sush3 eval string with 'break continue return error'



[sush stdout]
Expected '--- break\n1\nend func\n--- continue\n1\n2\nend func\n--- return\n1\n--- false\n1\n'
Got      '--- break\n1\nend func\n--- continue\n1\nend func\n--- return\n1\n'




stdout: 


--- break
1
end func
--- continue
1
end func
--- return
1

stderr: 


brush3 eval string with 'break continue return error'



[brush stdout]
Expected '--- break\n1\nend func\n--- continue\n1\n2\nend func\n--- return\n1\n--- false\n1\n'
Got      '--- break\n1\n2\nend func\n--- continue\n1\n2\nend func\n--- return\n1\n2\nend func\n--- false\n1\n2\nend func\nstatus=0\n'


[brush status] Expected 1, got 0



stdout: 


--- break
1
2
end func
--- continue
1
2
end func
--- return
1
2
end func
--- false
1
2
end func
status=0

stderr: 


bash4 eval YSH block with 'break continue return error'


stdout: 


stderr: 


dash4 eval YSH block with 'break continue return error'


stdout: 


stderr: 


ash4 eval YSH block with 'break continue return error'



[ash stdout]
Expected '--- break\n1\nend func\n--- continue\n1\n2\nend func\n--- return\n1\n--- false\n1\n'
Got      ''


[ash status] Expected 1, got 2



stdout: 


stderr: 


ash: shopt: not found
ash: syntax error: unexpected "("

zsh4 eval YSH block with 'break continue return error'


stdout: 


stderr: 


mksh4 eval YSH block with 'break continue return error'


stdout: 


stderr: 


ksh4 eval YSH block with 'break continue return error'



[ksh stdout]
Expected '--- break\n1\nend func\n--- continue\n1\n2\nend func\n--- return\n1\n--- false\n1\n'
Got      ''




stdout: 


stderr: 


E: ksh: <stdin>[3]: shopt: inaccessible or not found
E: ksh: <stdin>[5]: syntax error: unexpected '('

toysh4 eval YSH block with 'break continue return error'



[toysh stdout]
Expected '--- break\n1\nend func\n--- continue\n1\n2\nend func\n--- return\n1\n--- false\n1\n'
Got      ''


[toysh status] Expected 1, got -6



stdout: 


stderr: 


munmap_chunk(): invalid pointer

sush4 eval YSH block with 'break continue return error'



[sush stdout]
Expected '--- break\n1\nend func\n--- continue\n1\n2\nend func\n--- return\n1\n--- false\n1\n'
Got      'end func\n--- \nstatus=2\n'


[sush status] Expected 1, got 0



stdout: 


end func
--- 
status=2

stderr: 


/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 3: shopt: ysh:all: not supported yet
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 6: Unexpected token: (;
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 9: Unexpected token: (b)

/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 10: Unexpected token: done

/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 12: Unexpected token: }

/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 13: var: command not found
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 15: Unexpected token: (break)],

/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 16: Unexpected token: (continue)],

/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 17: Unexpected token: (return)],

/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 18: Unexpected token: (false)],

/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 18: ]: command not found
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 21: Unexpected token: (cases)
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 21: var: command not found
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 24: Unexpected token: (;
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 25: Unexpected token: }


brush4 eval YSH block with 'break continue return error'



[brush stdout]
Expected '--- break\n1\nend func\n--- continue\n1\n2\nend func\n--- return\n1\n--- false\n1\n'
Got      'end func\n--- \nstatus=2\n'


[brush status] Expected 1, got 0



stdout: 


end func
--- 
status=2

stderr: 


shopt: ysh:all: invalid shell option name
ERROR main: syntax error near token `;' (line 1 col 22)
ERROR main: syntax error near token `(' (line 3 col 18)
ERROR main: syntax error near token `
' (line 1 col 7)
ERROR main: syntax error near token `
' (line 1 col 2)
var: command not found
ERROR main: syntax error near token `],' (line 1 col 21)
ERROR main: syntax error near token `],' (line 1 col 27)
ERROR main: syntax error near token `],' (line 1 col 23)
ERROR main: syntax error near token `],' (line 1 col 21)
]: command not found
ERROR main: syntax error near token `(' (line 1 col 18)
var: command not found
ERROR main: syntax error near token `;' (line 1 col 20)
ERROR main: syntax error near token `
' (line 1 col 2)

brush5 exit within eval (regression)


[brush stdout] Expected u'', got 'should not get here\n'

[brush status] Expected 42, got 0



stdout: 


should not get here

stderr: 


brush6 exit within source (regression)


[brush stdout] Expected u'', got 'should not get here\n'

[brush status] Expected 42, got 0



stdout: 


should not get here

stderr: 


dash8 source accepts/ignores --


stdout: 


stderr: 


dash: 2: source: not found

sush8 source accepts/ignores --


[sush stdout] Expected 'foo\n', got ''

[sush status] Expected 0, got 1



stdout: 


stderr: 


/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 2: --: No such file or directory

dash9 Source nonexistent


stdout: 


status=127

stderr: 


dash: 1: source: not found

ash9 Source nonexistent


[ash stdout] Expected 'status=1\n', got ''

[ash status] Expected 0, got 2



stdout: 


stderr: 


ash: source: line 1: can't open '/nonexistent/path': No such file or directory

zsh9 Source nonexistent


stdout: 


status=127

stderr: 


source: no such file or directory: /nonexistent/path

dash10 Source with no arguments


stdout: 


status=127

stderr: 


dash: 1: source: not found

zsh10 Source with no arguments


stdout: 


status=1

stderr: 


source: not enough arguments

mksh10 Source with no arguments


stdout: 


status=1

stderr: 


mksh: <stdin>[1]: source: missing argument

ksh10 Source with no arguments


[ksh stdout] Expected 'status=2\n', got 'status=1\n'



stdout: 


status=1

stderr: 


E: ksh: <stdin>[1]: source: missing argument

toysh10 Source with no arguments


[toysh stdout] Expected 'status=2\n', got 'status=1\n'



stdout: 


status=1

stderr: 


source: Needs 1 argument (see "source --help")

dash11 Source with arguments


stdout: 


show-argv:

stderr: 


toysh11 Source with arguments


[toysh stdout] Expected 'show-argv: foo bar\n', got 'show-argv: /home/andy/git/oils-for-unix/oils/spec/testdata/show-argv.sh foo bar\n'



stdout: 


show-argv: /home/andy/git/oils-for-unix/oils/spec/testdata/show-argv.sh foo bar

stderr: 


dash12 Source from a function, mutating argv and defining a local var


stdout: 


source-argv: args to func
source-argv: to func
func
foo=foo_val
foo=

stderr: 


toysh12 Source from a function, mutating argv and defining a local var



[toysh stdout]
Expected 'source-argv: args to func\nsource-argv: args to src\nto func\nfoo=foo_val\nfoo=\n'
Got      'source-argv: /home/andy/git/oils-for-unix/oils/spec/testdata/source-argv.sh\nsource-argv: /home/andy/git/oils-for-unix/oils/spec/testdata/source-argv.sh args to src\nargs to func\nfoo=foo_val\nfoo=\n'




stdout: 


source-argv: /home/andy/git/oils-for-unix/oils/spec/testdata/source-argv.sh
source-argv: /home/andy/git/oils-for-unix/oils/spec/testdata/source-argv.sh args to src
args to func
foo=foo_val
foo=

stderr: 


sush12 Source from a function, mutating argv and defining a local var



[sush stdout]
Expected 'source-argv: args to func\nsource-argv: args to src\nto func\nfoo=foo_val\nfoo=\n'
Got      'source-argv:\nsource-argv: args to src\nargs to func\nfoo=\nfoo=\n'




stdout: 


source-argv:
source-argv: args to src
args to func
foo=
foo=

stderr: 


brush12 Source from a function, mutating argv and defining a local var



[brush stdout]
Expected 'source-argv: args to func\nsource-argv: args to src\nto func\nfoo=foo_val\nfoo=\n'
Got      'source-argv:\nsource-argv: args to src\nargs to func\nfoo=foo_val\nfoo=\n'




stdout: 


source-argv:
source-argv: args to src
args to func
foo=foo_val
foo=

stderr: 


bash13 Source with syntax error


[bash stdout] Expected 'status=1\n', got 'status=2\n'



stdout: 


status=2

stderr: 


/home/andy/git/oils-for-unix/oils/_tmp/spec-tmp/builtin-eval-source.test.sh/13-bash/syntax-error.sh: line 1: syntax error near unexpected token `newline'
/home/andy/git/oils-for-unix/oils/_tmp/spec-tmp/builtin-eval-source.test.sh/13-bash/syntax-error.sh: line 1: `echo >'

dash13 Source with syntax error


stdout: 


stderr: 


dash: 2: /home/andy/git/oils-for-unix/oils/_tmp/spec-tmp/builtin-eval-source.test.sh/13-dash/syntax-error.sh: Syntax error: newline unexpected

ash13 Source with syntax error


[ash stdout] Expected 'status=2\n', got ''

[ash status] Expected 0, got 2



stdout: 


stderr: 


ash: /home/andy/git/oils-for-unix/oils/_tmp/spec-tmp/builtin-eval-source.test.sh/13-ash/syntax-error.sh: line 2: syntax error: unexpected newline

zsh13 Source with syntax error


stdout: 


status=126

stderr: 


/home/andy/git/oils-for-unix/oils/_tmp/spec-tmp/builtin-eval-source.test.sh/13-zsh/syntax-error.sh:2: parse error near `\n'

mksh13 Source with syntax error


stdout: 


status=1

stderr: 


mksh: /home/andy/git/oils-for-unix/oils/_tmp/spec-tmp/builtin-eval-source.test.sh/13-mksh/syntax-error.sh[1]: syntax error: 'newline' unexpected

ksh13 Source with syntax error


[ksh stdout] Expected 'status=2\n', got 'status=1\n'



stdout: 


status=1

stderr: 


E: ksh: /home/andy/git/oils-for-unix/oils/_tmp/spec-tmp/builtin-eval-source.test.sh/13-ksh/syntax-error.sh[1]: syntax error: unexpected 'newline'

toysh13 Source with syntax error


[toysh stdout] Expected 'status=2\n', got ''

[toysh status] Expected 0, got 2



stdout: 


stderr: 


/home/andy/git/oils-for-unix/oils/_tmp/spec-tmp/builtin-eval-source.test.sh/13-toysh/syntax-error.sh: line 1: sh: syntax error: \n

bash14 Eval with syntax error


[bash stdout] Expected 'status=1\n', got 'status=2\n'



stdout: 


status=2

stderr: 


bash: eval: line 1: syntax error near unexpected token `newline'
bash: eval: line 1: `echo >'

dash14 Eval with syntax error


stdout: 


stderr: 


dash: 1: eval: Syntax error: end of file unexpected

ash14 Eval with syntax error


[ash stdout] Expected 'status=2\n', got ''

[ash status] Expected 0, got 2



stdout: 


stderr: 


ash: eval: line 1: syntax error: unexpected end of file

zsh14 Eval with syntax error


stdout: 


status=1

stderr: 


zsh: parse error near `>'

mksh14 Eval with syntax error


stdout: 


stderr: 


mksh: syntax error: 'newline' unexpected

ksh14 Eval with syntax error


[ksh stdout] Expected 'status=2\n', got ''

[ksh status] Expected 0, got 1



stdout: 


stderr: 


E: ksh: syntax error: unexpected 'newline'

toysh14 Eval with syntax error


[toysh stdout] Expected 'status=2\n', got ''

[toysh status] Expected 0, got 2



stdout: 


stderr: 


main: line 1: sh: syntax error: \n

dash15 Eval in does tilde expansion


stdout: 


FALSE

stderr: 


dash: 4: [[: not found
dash: 5: [[: not found

ash15 Eval in does tilde expansion


[ash stdout] Expected 'FALSE\nFALSE\nTRUE\n', got 'FALSE\n'

[ash status] Expected 0, got 2



stdout: 


FALSE

stderr: 


ash: /boot: unknown operand
ash: /boot: unknown operand

mksh15 Eval in does tilde expansion


stdout: 


FALSE

stderr: 


ksh15 Eval in does tilde expansion


[ksh stdout] Expected 'FALSE\nFALSE\nTRUE\n', got 'FALSE\n'

[ksh status] Expected 0, got 1



stdout: 


FALSE

stderr: 


toysh15 Eval in does tilde expansion


[toysh stdout] Expected 'FALSE\nFALSE\nTRUE\n', got 'FALSE\n'

[toysh status] Expected 0, got 1



stdout: 


FALSE

stderr: 


dash16 Eval in bash does tilde expansion in array


stdout: 


stderr: 


dash: 1: eval: Syntax error: "(" unexpected

ash16 Eval in bash does tilde expansion in array


[ash stdout] Expected 'FALSE\nFALSE\nTRUE\n', got ''

[ash status] Expected 0, got 2



stdout: 


stderr: 


ash: eval: line 6: syntax error: unexpected "("

zsh16 Eval in bash does tilde expansion in array


stdout: 


FALSE
FALSE

stderr: 


mksh16 Eval in bash does tilde expansion in array


stdout: 


FALSE

stderr: 


ksh16 Eval in bash does tilde expansion in array


[ksh stdout] Expected 'FALSE\nFALSE\nTRUE\n', got 'FALSE\n'

[ksh status] Expected 0, got 1



stdout: 


FALSE

stderr: 


toysh16 Eval in bash does tilde expansion in array


[toysh stdout] Expected 'FALSE\nFALSE\nTRUE\n', got ''

[toysh status] Expected 0, got 2



stdout: 


stderr: 


main: line 6: sh: syntax error: ~

dash17 source works for files in current directory (bash only)


stdout: 


stderr: 


dash: 3: .: cmd: not found

ash17 source works for files in current directory (bash only)


[ash stdout] Expected 'current dir\nstatus=0\n', got ''

[ash status] Expected 0, got 2



stdout: 


stderr: 


ash: .: line 3: cmd: not found

zsh17 source works for files in current directory (bash only)


stdout: 


status=127

stderr: 


.: no such file or directory: cmd

mksh17 source works for files in current directory (bash only)


stdout: 


stderr: 


mksh: <stdin>[3]: .: cmd: No such file or directory

ksh17 source works for files in current directory (bash only)


[ksh stdout] Expected 'current dir\nstatus=0\n', got ''

[ksh status] Expected 0, got 1



stdout: 


stderr: 


E: ksh: <stdin>[3]: .: cmd: No such file or directory

sush18 source looks in PATH for files


[sush stdout] Expected 'hi\n', got ''



stdout: 


stderr: 


/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 4: cmd: No such file or directory

brush18 source looks in PATH for files


[brush stdout] Expected 'hi\n', got ''



stdout: 


stderr: 


ERROR failed to source file: cmd; i/o error: No such file or directory (os error 2)

toysh19 source finds files in PATH before current dir


[toysh stdout] Expected 'path\nstatus=0\n', got 'current dir\nstatus=0\n'



stdout: 


current dir
status=0

stderr: 


sush19 source finds files in PATH before current dir


[sush stdout] Expected 'path\nstatus=0\n', got 'current dir\nstatus=0\n'



stdout: 


current dir
status=0

stderr: 


brush19 source finds files in PATH before current dir


[brush stdout] Expected 'path\nstatus=0\n', got 'current dir\nstatus=0\n'



stdout: 


current dir
status=0

stderr: 


dash21 source doesn't crash when targeting a directory


stdout: 


status=0

stderr: 


ash21 source doesn't crash when targeting a directory


[ash stdout] Expected 'status=1\n', got 'status=0\n'



stdout: 


status=0

stderr: 


zsh21 source doesn't crash when targeting a directory


stdout: 


status=0

stderr: 


mksh21 source doesn't crash when targeting a directory


stdout: 


status=0

stderr: 


ksh21 source doesn't crash when targeting a directory


[ksh stdout] Expected 'status=1\n', got 'status=0\n'



stdout: 


status=0

stderr: 


toysh21 source doesn't crash when targeting a directory


[toysh stdout] Expected 'status=1\n', got 'status=0\n'



stdout: 


status=0

stderr: