| status | bash | mksh | ksh | toysh | sush | brush | osh | |
| pass | 7 | 3 | 3 | 0 | 0 | 2 | 7 | |
| BUG | 0 | 4 | 0 | 0 | 0 | 0 | 0 | |
| FAIL | 0 | 0 | 4 | 7 | 7 | 5 | 0 | |
| total | 7 | 7 | 7 | 7 | 7 | 7 | 7 | |
| case | bash | mksh | ksh | toysh | sush | brush | osh | description |
| 0 | pass | pass | pass | FAIL | FAIL | FAIL | pass | OSH source code doesn't have to be valid Unicode (like other shells) |
| details | details | details | ||||||
| 1 | pass | pass | pass | FAIL | FAIL | pass | pass | Unicode escapes \u03bc \U000003bc in $'', echo -e, printf |
| details | details | |||||||
| 2 | pass | BUG | FAIL | FAIL | FAIL | pass | pass | Max code point U+10ffff can escaped with $'' printf echo -e |
| details | details | details | details | |||||
| 3 | pass | BUG | FAIL | FAIL | FAIL | FAIL | pass | $'' does NOT check that 0x110000 is too big at parse time |
| details | details | details | details | details | ||||
| 4 | pass | pass | pass | FAIL | FAIL | FAIL | pass | $'' does not check for surrogate range at parse time |
| details | details | details | ||||||
| 5 | pass | BUG | FAIL | FAIL | FAIL | FAIL | pass | printf / echo -e do NOT check max code point at runtime |
| details | details | details | details | details | ||||
| 6 | pass | BUG | FAIL | FAIL | FAIL | FAIL | pass | printf / echo -e do NOT check surrogates at runtime |
| details | details | details | details | details |
22 passed, 0 OK, 0 not implemented, 4 BUG, 23 failed, 0 timeouts, 0 cases skipped
| toysh | 0 OSH source code doesn't have to be valid Unicode (like other shells) [toysh stdout] Expected '\xce\xbc \xce\xbc \xce\xbc \xce\xbc\n--\n bc 20 bc 20 bc 20 bc 0a\n' Got '\xce\xbc \xce\xbc \xce\xbc \xc3\x8e\xc2\xbc\n\n' stdout: μ μ μ μstderr: not-unicode.sh: line 1: sh: 'not-unicode.sh' is binary |
| sush | 0 OSH source code doesn't have to be valid Unicode (like other shells) [sush stdout] Expected '\xce\xbc \xce\xbc \xce\xbc \xce\xbc\n--\n bc 20 bc 20 bc 20 bc 0a\n' Got '\xce\xbc \xce\xbc \xce\xbc \xce\xbc\n--\n' stdout: μ μ μ μ --stderr: |
| brush | 0 OSH source code doesn't have to be valid Unicode (like other shells) [brush stdout] Expected '\xce\xbc \xce\xbc \xce\xbc \xce\xbc\n--\n bc 20 bc 20 bc 20 bc 0a\n' Got '\xce\xbc \xce\xbc \xce\xbc \xce\xbc\n--\n' stdout: μ μ μ μ --stderr: [31mERROR[0m not-unicode.sh: failed to decode UTF-8 characters (detected near line 1 column 6) |
| toysh | 1 Unicode escapes \u03bc \U000003bc in $'', echo -e, printf [toysh stdout] Expected '\xce\xbc \xce\xbc\n\xce\xbc \xce\xbc\n\xce\xbc \xce\xbc\n', got '' [toysh status] Expected 0, got -6 stdout: stderr: munmap_chunk(): invalid pointer |
| sush | 1 Unicode escapes \u03bc \U000003bc in $'', echo -e, printf [sush stdout] Expected '\xce\xbc \xce\xbc\n\xce\xbc \xce\xbc\n\xce\xbc \xce\xbc\n', got '\xce\xbc \xce\xbc\n\\u03bc \\U000003bc\n\\u03bc \\U000003bc\n' stdout: μ μ \u03bc \U000003bc \u03bc \U000003bcstderr: |
| mksh | 2 Max code point U+10ffff can escaped with $'' printf echo -e stdout: '\xef\xbf\xbd' '\xef\xbf\xbd' '\xf4\x8f\xbf\xbf'stderr: |
| ksh | 2 Max code point U+10ffff can escaped with $'' printf echo -e [ksh stdout] Expected "'\\xf4\\x8f\\xbf\\xbf'\n'\\xf4\\x8f\\xbf\\xbf'\n'\\xf4\\x8f\\xbf\\xbf'\n" Got "'\\xef\\xbf\\xbd'\n'\\xef\\xbf\\xbd'\n'\\xf4\\x8f\\xbf\\xbf'\n" stdout: '\xef\xbf\xbd' '\xef\xbf\xbd' '\xf4\x8f\xbf\xbf'stderr: |
| toysh | 2 Max code point U+10ffff can escaped with $'' printf echo -e [toysh stdout] Expected "'\\xf4\\x8f\\xbf\\xbf'\n'\\xf4\\x8f\\xbf\\xbf'\n'\\xf4\\x8f\\xbf\\xbf'\n" Got '' [toysh status] Expected 0, got -6 stdout: stderr: munmap_chunk(): invalid pointer |
| sush | 2 Max code point U+10ffff can escaped with $'' printf echo -e [sush stdout] Expected "'\\xf4\\x8f\\xbf\\xbf'\n'\\xf4\\x8f\\xbf\\xbf'\n'\\xf4\\x8f\\xbf\\xbf'\n" Got '' [sush status] Expected 0, got 127 [sush stderr] Found 'Traceback (most recent' stdout: stderr: /home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 4: Unexpected token: () Traceback (most recent call last): File "<string>", line 1, in <module> IndexError: list index out of range /home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 6: Unexpected token: } /home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 7: py-repr: command not found /home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 8: py-repr: command not found /home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 9: py-repr: command not found |
| mksh | 3 $'' does NOT check that 0x110000 is too big at parse time stdout: '\xef\xbf\xbd'stderr: |
| ksh | 3 $'' does NOT check that 0x110000 is too big at parse time [ksh stdout] Expected "'\\xf4\\x90\\x80\\x80'\n", got "'\\xef\\xbf\\xbd'\n" stdout: '\xef\xbf\xbd'stderr: |
| toysh | 3 $'' does NOT check that 0x110000 is too big at parse time [toysh stdout] Expected "'\\xf4\\x90\\x80\\x80'\n", got "'\\xe1\\x84\\x8000'\n" stdout: '\xe1\x84\x8000'stderr: |
| sush | 3 $'' does NOT check that 0x110000 is too big at parse time [sush stdout] Expected "'\\xf4\\x90\\x80\\x80'\n", got '' [sush status] Expected 0, got 127 [sush stderr] Found 'Traceback (most recent' stdout: stderr: /home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 2: Unexpected token: () Traceback (most recent call last): File "<string>", line 1, in <module> IndexError: list index out of range /home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 4: Unexpected token: } /home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 5: py-repr: command not found |
| brush | 3 $'' does NOT check that 0x110000 is too big at parse time [brush stdout] Expected "'\\xf4\\x90\\x80\\x80'\n", got "'\\\\\\\\'\n" stdout: '\\\\'stderr: |
| toysh | 4 $'' does not check for surrogate range at parse time [toysh stdout] Expected "'\\xed\\xb0\\x80'\n'\\xed\\xb0\\x80'\n", got "''\n'\\xc3\\x9c00'\n" stdout: '' '\xc3\x9c00'stderr: |
| sush | 4 $'' does not check for surrogate range at parse time [sush stdout] Expected "'\\xed\\xb0\\x80'\n'\\xed\\xb0\\x80'\n", got '' [sush status] Expected 0, got 127 [sush stderr] Found 'Traceback (most recent' stdout: stderr: /home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 2: Unexpected token: () Traceback (most recent call last): File "<string>", line 1, in <module> IndexError: list index out of range /home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 4: Unexpected token: } /home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 5: py-repr: command not found /home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 7: py-repr: command not found |
| brush | 4 $'' does not check for surrogate range at parse time [brush stdout] Expected "'\\xed\\xb0\\x80'\n'\\xed\\xb0\\x80'\n", got "'\\\\\\\\'\n'\\\\\\\\'\n" stdout: '\\\\' '\\\\'stderr: |
| mksh | 5 printf / echo -e do NOT check max code point at runtime stdout: stderr: |
| ksh | 5 printf / echo -e do NOT check max code point at runtime [ksh stdout] Expected "status=0\n'\\xf4\\x90\\x80\\x80'\nstatus=0\n'\\xf4\\x90\\x80\\x80'\n" Got "status=0\n'\\xef\\xbf\\xbd'\nstatus=0\n'\\\\U00110000'\n" stdout: status=0 '\xef\xbf\xbd' status=0 '\\U00110000'stderr: |
| toysh | 5 printf / echo -e do NOT check max code point at runtime [toysh stdout] Expected "status=0\n'\\xf4\\x90\\x80\\x80'\nstatus=0\n'\\xf4\\x90\\x80\\x80'\n" Got '' [toysh status] Expected 0, got -6 stdout: stderr: munmap_chunk(): invalid pointer |
| sush | 5 printf / echo -e do NOT check max code point at runtime [sush stdout] Expected "status=0\n'\\xf4\\x90\\x80\\x80'\nstatus=0\n'\\xf4\\x90\\x80\\x80'\n" Got 'status=0\nstatus=0\n' [sush status] Expected 0, got 127 [sush stderr] Found 'Traceback (most recent' stdout: status=0 status=0stderr: /home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 4: Unexpected token: () Traceback (most recent call last): File "<string>", line 1, in <module> IndexError: list index out of range /home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 6: Unexpected token: } /home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 9: py-repr: command not found /home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 13: py-repr: command not found |
| brush | 5 printf / echo -e do NOT check max code point at runtime [brush stdout] Expected "status=0\n'\\xf4\\x90\\x80\\x80'\nstatus=0\n'\\xf4\\x90\\x80\\x80'\n" Got "status=0\n'\\\\\\\\'\nstatus=1\n''\n" stdout: status=0 '\\\\' status=1 ''stderr: [31mERROR[0m printf: printf parsing error: invalid universal character name \U00110000 |
| mksh | 6 printf / echo -e do NOT check surrogates at runtime stdout: stderr: |
| ksh | 6 printf / echo -e do NOT check surrogates at runtime [ksh stdout] Expected "status=0\n'\\xed\\xb0\\x80'\nstatus=0\n'\\xed\\xb0\\x80'\nstatus=0\n'\\xed\\xb0\\x80'\nstatus=0\n'\\xed\\xb0\\x80'\n" Got "status=0\n'\\xed\\xb0\\x80'\nstatus=0\n'\\xed\\xb0\\x80'\nstatus=1\n''\nstatus=1\n''\n" stdout: status=0 '\xed\xb0\x80' status=0 '\xed\xb0\x80' status=1 '' status=1 ''stderr: printf: invalid universal character name \udc00 printf: invalid universal character name \U0000dc00 |
| toysh | 6 printf / echo -e do NOT check surrogates at runtime [toysh stdout] Expected "status=0\n'\\xed\\xb0\\x80'\nstatus=0\n'\\xed\\xb0\\x80'\nstatus=0\n'\\xed\\xb0\\x80'\nstatus=0\n'\\xed\\xb0\\x80'\n" Got '' [toysh status] Expected 0, got -6 stdout: stderr: munmap_chunk(): invalid pointer |
| sush | 6 printf / echo -e do NOT check surrogates at runtime [sush stdout] Expected "status=0\n'\\xed\\xb0\\x80'\nstatus=0\n'\\xed\\xb0\\x80'\nstatus=0\n'\\xed\\xb0\\x80'\nstatus=0\n'\\xed\\xb0\\x80'\n" Got 'status=0\nstatus=0\nstatus=0\nstatus=0\n' [sush status] Expected 0, got 127 [sush stderr] Found 'Traceback (most recent' stdout: status=0 status=0 status=0 status=0stderr: /home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 4: Unexpected token: () Traceback (most recent call last): File "<string>", line 1, in <module> IndexError: list index out of range /home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 6: Unexpected token: } /home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 9: py-repr: command not found /home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 13: py-repr: command not found /home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 17: py-repr: command not found /home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 21: py-repr: command not found |
| brush | 6 printf / echo -e do NOT check surrogates at runtime [brush stdout] Expected "status=0\n'\\xed\\xb0\\x80'\nstatus=0\n'\\xed\\xb0\\x80'\nstatus=0\n'\\xed\\xb0\\x80'\nstatus=0\n'\\xed\\xb0\\x80'\n" Got "status=0\n'\\\\\\\\'\nstatus=0\n'\\\\\\\\'\nstatus=1\n''\nstatus=1\n''\n" stdout: status=0 '\\\\' status=0 '\\\\' status=1 '' status=1 ''stderr: [31mERROR[0m printf: printf parsing error: invalid universal character name \udc00 [31mERROR[0m printf: printf parsing error: invalid universal character name \U0000dc00 |