Results for var-op-len.test.sh

statusbashmkshkshtoyshsushbrushosh
pass 5342428
ok 1100000
N-I 0400000
BUG 2000000
FAIL 0046460
total8888888
casebashmkshkshtoyshsushbrushoshdescription
0pass pass pass pass pass pass pass String length
1pass N-I pass FAIL pass FAIL pass Unicode string length (UTF-8)
detailsdetailsdetails
2pass N-I FAIL FAIL pass FAIL pass Unicode string length (spec/testdata/utf8-chars.txt)
detailsdetailsdetailsdetails
3BUG N-I FAIL FAIL FAIL FAIL pass String length with incomplete utf-8
detailsdetailsdetailsdetailsdetailsdetails
4BUG N-I FAIL FAIL FAIL FAIL pass String length with invalid utf-8 continuation bytes
detailsdetailsdetailsdetailsdetailsdetails
5pass pass pass pass pass pass pass Length of undefined variable
6pass pass pass FAIL FAIL FAIL pass Length of undefined variable with nounset
detailsdetailsdetails
7ok ok FAIL FAIL FAIL FAIL pass Length operator can't be followed by test operator
detailsdetailsdetailsdetailsdetailsdetails
28 passed, 2 OK, 4 not implemented, 2 BUG, 20 failed, 0 timeouts, 0 cases skipped

Details on runs that didn't PASS

mksh1 Unicode string length (UTF-8)

stdout: 
4
stderr: 
toysh1 Unicode string length (UTF-8)


[toysh stdout] Expected '3\n', got '4\n'



stdout: 


4

stderr: 


brush1 Unicode string length (UTF-8)


[brush stdout] Expected '3\n', got '4\n'



stdout: 


4

stderr: 


mksh2 Unicode string length (spec/testdata/utf8-chars.txt)


stdout: 


13

stderr: 


ksh2 Unicode string length (spec/testdata/utf8-chars.txt)


[ksh stdout] Expected '7\n', got '10\n'



stdout: 


10

stderr: 


toysh2 Unicode string length (spec/testdata/utf8-chars.txt)


[toysh stdout] Expected '7\n', got '13\n'



stdout: 


13

stderr: 


brush2 Unicode string length (spec/testdata/utf8-chars.txt)


[brush stdout] Expected '7\n', got '13\n'



stdout: 


13

stderr: 


bash3 String length with incomplete utf-8


stdout: 


0
1
2
3
3
4
5
6
5
6
7
8
9
7

stderr: 


mksh3 String length with incomplete utf-8


stdout: 


0
1
2
3
4
5
6
7
8
9
10
11
12
13

stderr: 


ksh3 String length with incomplete utf-8



[ksh stdout]
Expected '0\n1\n2\n-1\n3\n4\n-1\n-1\n5\n6\n-1\n-1\n-1\n7\n[ stdin ]:3: warning: UTF-8 decode: Truncated bytes at offset 2 in string of 3 bytes\n[ stdin ]:3: warning: UTF-8 decode: Truncated bytes at offset 5 in string of 6 bytes\n[ stdin ]:3: warning: UTF-8 decode: Truncated bytes at offset 5 in string of 7 bytes\n[ stdin ]:3: warning: UTF-8 decode: Truncated bytes at offset 9 in string of 10 bytes\n[ stdin ]:3: warning: UTF-8 decode: Truncated bytes at offset 9 in string of 11 bytes\n[ stdin ]:3: warning: UTF-8 decode: Truncated bytes at offset 9 in string of 12 bytes\n'
Got      '0\n1\n2\n3\n3\n4\n5\n6\n5\n6\n7\n8\n9\n10\n'




stdout: 


0
1
2
3
3
4
5
6
5
6
7
8
9
10

stderr: 


toysh3 String length with incomplete utf-8



[toysh stdout]
Expected '0\n1\n2\n-1\n3\n4\n-1\n-1\n5\n6\n-1\n-1\n-1\n7\n[ stdin ]:3: warning: UTF-8 decode: Truncated bytes at offset 2 in string of 3 bytes\n[ stdin ]:3: warning: UTF-8 decode: Truncated bytes at offset 5 in string of 6 bytes\n[ stdin ]:3: warning: UTF-8 decode: Truncated bytes at offset 5 in string of 7 bytes\n[ stdin ]:3: warning: UTF-8 decode: Truncated bytes at offset 9 in string of 10 bytes\n[ stdin ]:3: warning: UTF-8 decode: Truncated bytes at offset 9 in string of 11 bytes\n[ stdin ]:3: warning: UTF-8 decode: Truncated bytes at offset 9 in string of 12 bytes\n'
Got      '0\n1\n2\n3\n4\n5\n6\n7\n8\n9\n10\n11\n12\n13\n'




stdout: 


0
1
2
3
4
5
6
7
8
9
10
11
12
13

stderr: 


sush3 String length with incomplete utf-8



[sush stdout]
Expected '0\n1\n2\n-1\n3\n4\n-1\n-1\n5\n6\n-1\n-1\n-1\n7\n[ stdin ]:3: warning: UTF-8 decode: Truncated bytes at offset 2 in string of 3 bytes\n[ stdin ]:3: warning: UTF-8 decode: Truncated bytes at offset 5 in string of 6 bytes\n[ stdin ]:3: warning: UTF-8 decode: Truncated bytes at offset 5 in string of 7 bytes\n[ stdin ]:3: warning: UTF-8 decode: Truncated bytes at offset 9 in string of 10 bytes\n[ stdin ]:3: warning: UTF-8 decode: Truncated bytes at offset 9 in string of 11 bytes\n[ stdin ]:3: warning: UTF-8 decode: Truncated bytes at offset 9 in string of 12 bytes\n'
Got      '0\n1\n2\n0\n3\n4\n0\n0\n5\n6\n0\n0\n0\n7\n'




stdout: 


0
1
2
0
3
4
0
0
5
6
0
0
0
7

stderr: 


brush3 String length with incomplete utf-8



[brush stdout]
Expected '0\n1\n2\n-1\n3\n4\n-1\n-1\n5\n6\n-1\n-1\n-1\n7\n[ stdin ]:3: warning: UTF-8 decode: Truncated bytes at offset 2 in string of 3 bytes\n[ stdin ]:3: warning: UTF-8 decode: Truncated bytes at offset 5 in string of 6 bytes\n[ stdin ]:3: warning: UTF-8 decode: Truncated bytes at offset 5 in string of 7 bytes\n[ stdin ]:3: warning: UTF-8 decode: Truncated bytes at offset 9 in string of 10 bytes\n[ stdin ]:3: warning: UTF-8 decode: Truncated bytes at offset 9 in string of 11 bytes\n[ stdin ]:3: warning: UTF-8 decode: Truncated bytes at offset 9 in string of 12 bytes\n'
Got      '0\n1\n2\n'




stdout: 


0
1
2

stderr: 


ERROR error: i/o error: stream did not contain valid UTF-8

bash4 String length with invalid utf-8 continuation bytes


stdout: 


1
2
3
4
4
5
6
7
6
7
8
9
10
8
8

stderr: 


mksh4 String length with invalid utf-8 continuation bytes


stdout: 


1
2
3
4
5
6
7
8
9
10
11
12
13
14
14

stderr: 


ksh4 String length with invalid utf-8 continuation bytes



[ksh stdout]
Expected '-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 0 in string of 1 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 1 in string of 2 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 2 in string of 3 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 2 in string of 4 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 4 in string of 5 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 5 in string of 6 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 5 in string of 7 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 5 in string of 8 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 8 in string of 9 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 9 in string of 10 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 9 in string of 11 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 9 in string of 12 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 9 in string of 13 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 13 in string of 14 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 13 in string of 14 bytes\n'
Got      '1\n2\n3\n4\n4\n5\n6\n7\n6\n7\n8\n9\n10\n11\n11\n'




stdout: 


1
2
3
4
4
5
6
7
6
7
8
9
10
11
11

stderr: 


toysh4 String length with invalid utf-8 continuation bytes



[toysh stdout]
Expected '-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 0 in string of 1 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 1 in string of 2 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 2 in string of 3 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 2 in string of 4 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 4 in string of 5 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 5 in string of 6 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 5 in string of 7 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 5 in string of 8 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 8 in string of 9 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 9 in string of 10 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 9 in string of 11 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 9 in string of 12 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 9 in string of 13 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 13 in string of 14 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 13 in string of 14 bytes\n'
Got      '2\n3\n4\n5\n6\n7\n8\n9\n10\n11\n12\n13\n14\n15\n15\n'




stdout: 


2
3
4
5
6
7
8
9
10
11
12
13
14
15
15

stderr: 


sush4 String length with invalid utf-8 continuation bytes



[sush stdout]
Expected '-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 0 in string of 1 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 1 in string of 2 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 2 in string of 3 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 2 in string of 4 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 4 in string of 5 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 5 in string of 6 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 5 in string of 7 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 5 in string of 8 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 8 in string of 9 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 9 in string of 10 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 9 in string of 11 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 9 in string of 12 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 9 in string of 13 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 13 in string of 14 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 13 in string of 14 bytes\n'
Got      '0\n1\n2\n0\n3\n4\n0\n0\n5\n6\n0\n0\n0\n7\n7\n'




stdout: 


0
1
2
0
3
4
0
0
5
6
0
0
0
7
7

stderr: 


brush4 String length with invalid utf-8 continuation bytes



[brush stdout]
Expected '-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n-1\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 0 in string of 1 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 1 in string of 2 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 2 in string of 3 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 2 in string of 4 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 4 in string of 5 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 5 in string of 6 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 5 in string of 7 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 5 in string of 8 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 8 in string of 9 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 9 in string of 10 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 9 in string of 11 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 9 in string of 12 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 9 in string of 13 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 13 in string of 14 bytes\n[ stdin ]:3: warning: UTF-8 decode: Bad encoding at offset 13 in string of 14 bytes\n'
Got      '3\n4\n5\n'




stdout: 


3
4
5

stderr: 


ERROR error: i/o error: stream did not contain valid UTF-8

toysh6 Length of undefined variable with nounset


[toysh status] Expected 1, got 0



stdout: 


0

stderr: 


set: bad -o nounset

sush6 Length of undefined variable with nounset


[sush status] Expected 1, got 0



stdout: 


0

stderr: 


/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 1: set: nounset: invalid option name

brush6 Length of undefined variable with nounset


[brush status] Expected 1, got 0



stdout: 


0

stderr: 


bash7 Length operator can't be followed by test operator


stdout: 


stderr: 


bash: line 1: ${#x-default}: bad substitution
bash: line 4: ${#x-default}: bad substitution
bash: line 7: ${#x-default}: bad substitution

mksh7 Length operator can't be followed by test operator


stdout: 


stderr: 


mksh: <stdin>[1]: ${#x-default}: bad substitution

ksh7 Length operator can't be followed by test operator


[ksh status] Expected 2, got 1



stdout: 


stderr: 


E: ksh: <stdin>[1]: ${#x-default}: bad substitution

toysh7 Length operator can't be followed by test operator


[toysh stdout] Expected u'', got '0\n0\n3\n'

[toysh status] Expected 2, got 0



stdout: 


0
0
3

stderr: 


sush7 Length operator can't be followed by test operator


[sush stdout] Expected u'', got 'default\n0\n3\n'

[sush status] Expected 2, got 0



stdout: 


default
0
3

stderr: 


brush7 Length operator can't be followed by test operator


[brush stdout] Expected u'', got '${#x-default}\n${#x-default}\n${#x-default}\n'

[brush status] Expected 2, got 0



stdout: 


${#x-default}
${#x-default}
${#x-default}

stderr: