Need to see if your shared folder is taking up space on your dropbox ๐Ÿ‘จโ€๐Ÿ’ป? Find out how to check here.

Forum Discussion

nyanta's avatar
nyanta
Explorer | Level 3
3 years ago
Solved

~(TLIDE) in Japanese Shift-JIS text changes to โ€พ(OVERLINE)

When saving a .txt file with Shift_JIS text editor encoding in Windows 11, ~(TLIDE) is modified to โ€พ(OVERLINE) in Dropbox on iOS. This is a Dropbox bug specific to Japanese.   I would like you to f...
Preview
View
  • zacw's avatar
    zacw
    3 years ago

    I believe this is authoritatively correct depending on how you are inserting the tilde. For example, given this file:

    ใ“ใ‚Œใฏใƒ†ใ‚นใƒˆใงใ™ใ€‚ ใ“ใ‚Œใ‚‰ใฏใ„ใใคใ‹ใฎใƒฉใƒณใƒ€ใƒ ใชๆ–‡็ซ ใงใ™ใ€‚
    ~ <- tilde

    With this hex representation:

    โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
    โ”‚00000000โ”‚ 82 b1 82 ea 82 cd 83 65 โ”Š 83 58 83 67 82 c5 82 b7 โ”‚ร—ร—ร—ร—ร—ร—ร—eโ”Šร—Xร—gร—ร—ร—ร—โ”‚
    โ”‚00000010โ”‚ 81 42 20 82 b1 82 ea 82 โ”Š e7 82 cd 82 a2 82 ad 82 โ”‚ร—B ร—ร—ร—ร—ร—โ”Šร—ร—ร—ร—ร—ร—ร—ร—โ”‚
    โ”‚00000020โ”‚ c2 82 a9 82 cc 83 89 83 โ”Š 93 83 5f 83 80 82 c8 95 โ”‚ร—ร—ร—ร—ร—ร—ร—ร—โ”Šร—ร—_ร—ร—ร—ร—ร—โ”‚
    โ”‚00000030โ”‚ b6 8f cd 82 c5 82 b7 81 โ”Š 42 0a 7e 20 3c 2d 20 74 โ”‚ร—ร—ร—ร—ร—ร—ร—ร—โ”ŠB_~ <- tโ”‚
    โ”‚00000040โ”‚ 69 6c 64 65 0a          โ”Š                         โ”‚ilde_   โ”Š        โ”‚
    โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜

    Running this through iconv produces:

    > iconv -f shift-jis -t utf-8 file.txt
    ใ“ใ‚Œใฏใƒ†ใ‚นใƒˆใงใ™ใ€‚ ใ“ใ‚Œใ‚‰ใฏใ„ใใคใ‹ใฎใƒฉใƒณใƒ€ใƒ ใชๆ–‡็ซ ใงใ™ใ€‚
    โ€พ <- tilde

    However, given a UTF-8 encoded version (note this has an actual ~ in it, not the output above):

    โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
    โ”‚00000000โ”‚ e3 81 93 e3 82 8c e3 81 โ”Š af e3 83 86 e3 82 b9 e3 โ”‚ร—ร—ร—ร—ร—ร—ร—ร—โ”Šร—ร—ร—ร—ร—ร—ร—ร—โ”‚
    โ”‚00000010โ”‚ 83 88 e3 81 a7 e3 81 99 โ”Š e3 80 82 20 e3 81 93 e3 โ”‚ร—ร—ร—ร—ร—ร—ร—ร—โ”Šร—ร—ร— ร—ร—ร—ร—โ”‚
    โ”‚00000020โ”‚ 82 8c e3 82 89 e3 81 af โ”Š e3 81 84 e3 81 8f e3 81 โ”‚ร—ร—ร—ร—ร—ร—ร—ร—โ”Šร—ร—ร—ร—ร—ร—ร—ร—โ”‚
    โ”‚00000030โ”‚ a4 e3 81 8b e3 81 ae e3 โ”Š 83 a9 e3 83 b3 e3 83 80 โ”‚ร—ร—ร—ร—ร—ร—ร—ร—โ”Šร—ร—ร—ร—ร—ร—ร—ร—โ”‚
    โ”‚00000040โ”‚ e3 83 a0 e3 81 aa e6 96 โ”Š 87 e7 ab a0 e3 81 a7 e3 โ”‚ร—ร—ร—ร—ร—ร—ร—ร—โ”Šร—ร—ร—ร—ร—ร—ร—ร—โ”‚
    โ”‚00000050โ”‚ 81 99 e3 80 82 0a 7e 20 โ”Š 3c 2d 20 74 69 6c 64 65 โ”‚ร—ร—ร—ร—ร—_~ โ”Š<- tildeโ”‚
    โ”‚00000060โ”‚ 0a                      โ”Š                         โ”‚_       โ”Š        โ”‚
    โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜

    This produces an error when trying to convert:

    > iconv -f utf-8 -t shift-jis test-utf8.txt
    ๏ฟฝ๏ฟฝ๏ฟฝ๏ฟฝอƒe๏ฟฝX๏ฟฝg๏ฟฝล‚๏ฟฝ๏ฟฝB ๏ฟฝ๏ฟฝ๏ฟฝ๏ฟฝ๏ฟฝอ‚๏ฟฝ๏ฟฝ๏ฟฝ๏ฟฝ‚๏ฟฝ๏ฟฝฬƒ๏ฟฝ๏ฟฝ๏ฟฝ๏ฟฝ_๏ฟฝ๏ฟฝ๏ฟฝศ•๏ฟฝ๏ฟฝอ‚ล‚๏ฟฝ๏ฟฝB
    iconv: test-utf8.txt:2:0: cannot convert

    According to this StackOverflow post, it seems like there is not a canonical tilde representation of the ~ character in Shift_JIS, so the app is doing its best to try and preserve as much of your content as possible, even if it can't be encoded. This is also my experience when using other macOS tools that can interpret Shift_JIS, though some will preserve the invalid character I'm not sure that's always the desired behavior.

nyanta's avatar
nyanta
Explorer | Level 3
3 years ago

iOS16.71(iPhone8)
The same issue occurs with the latest version of Dropbox, 350.3.

zacw's avatar
zacw
Icon for Dropbox Engineer rankDropbox Engineer
3 years ago

I believe this is authoritatively correct depending on how you are inserting the tilde. For example, given this file:

ใ“ใ‚Œใฏใƒ†ใ‚นใƒˆใงใ™ใ€‚ ใ“ใ‚Œใ‚‰ใฏใ„ใใคใ‹ใฎใƒฉใƒณใƒ€ใƒ ใชๆ–‡็ซ ใงใ™ใ€‚
~ <- tilde

With this hex representation:

โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
โ”‚00000000โ”‚ 82 b1 82 ea 82 cd 83 65 โ”Š 83 58 83 67 82 c5 82 b7 โ”‚ร—ร—ร—ร—ร—ร—ร—eโ”Šร—Xร—gร—ร—ร—ร—โ”‚
โ”‚00000010โ”‚ 81 42 20 82 b1 82 ea 82 โ”Š e7 82 cd 82 a2 82 ad 82 โ”‚ร—B ร—ร—ร—ร—ร—โ”Šร—ร—ร—ร—ร—ร—ร—ร—โ”‚
โ”‚00000020โ”‚ c2 82 a9 82 cc 83 89 83 โ”Š 93 83 5f 83 80 82 c8 95 โ”‚ร—ร—ร—ร—ร—ร—ร—ร—โ”Šร—ร—_ร—ร—ร—ร—ร—โ”‚
โ”‚00000030โ”‚ b6 8f cd 82 c5 82 b7 81 โ”Š 42 0a 7e 20 3c 2d 20 74 โ”‚ร—ร—ร—ร—ร—ร—ร—ร—โ”ŠB_~ <- tโ”‚
โ”‚00000040โ”‚ 69 6c 64 65 0a          โ”Š                         โ”‚ilde_   โ”Š        โ”‚
โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜

Running this through iconv produces:

> iconv -f shift-jis -t utf-8 file.txt
ใ“ใ‚Œใฏใƒ†ใ‚นใƒˆใงใ™ใ€‚ ใ“ใ‚Œใ‚‰ใฏใ„ใใคใ‹ใฎใƒฉใƒณใƒ€ใƒ ใชๆ–‡็ซ ใงใ™ใ€‚
โ€พ <- tilde

However, given a UTF-8 encoded version (note this has an actual ~ in it, not the output above):

โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
โ”‚00000000โ”‚ e3 81 93 e3 82 8c e3 81 โ”Š af e3 83 86 e3 82 b9 e3 โ”‚ร—ร—ร—ร—ร—ร—ร—ร—โ”Šร—ร—ร—ร—ร—ร—ร—ร—โ”‚
โ”‚00000010โ”‚ 83 88 e3 81 a7 e3 81 99 โ”Š e3 80 82 20 e3 81 93 e3 โ”‚ร—ร—ร—ร—ร—ร—ร—ร—โ”Šร—ร—ร— ร—ร—ร—ร—โ”‚
โ”‚00000020โ”‚ 82 8c e3 82 89 e3 81 af โ”Š e3 81 84 e3 81 8f e3 81 โ”‚ร—ร—ร—ร—ร—ร—ร—ร—โ”Šร—ร—ร—ร—ร—ร—ร—ร—โ”‚
โ”‚00000030โ”‚ a4 e3 81 8b e3 81 ae e3 โ”Š 83 a9 e3 83 b3 e3 83 80 โ”‚ร—ร—ร—ร—ร—ร—ร—ร—โ”Šร—ร—ร—ร—ร—ร—ร—ร—โ”‚
โ”‚00000040โ”‚ e3 83 a0 e3 81 aa e6 96 โ”Š 87 e7 ab a0 e3 81 a7 e3 โ”‚ร—ร—ร—ร—ร—ร—ร—ร—โ”Šร—ร—ร—ร—ร—ร—ร—ร—โ”‚
โ”‚00000050โ”‚ 81 99 e3 80 82 0a 7e 20 โ”Š 3c 2d 20 74 69 6c 64 65 โ”‚ร—ร—ร—ร—ร—_~ โ”Š<- tildeโ”‚
โ”‚00000060โ”‚ 0a                      โ”Š                         โ”‚_       โ”Š        โ”‚
โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜

This produces an error when trying to convert:

> iconv -f utf-8 -t shift-jis test-utf8.txt
๏ฟฝ๏ฟฝ๏ฟฝ๏ฟฝอƒe๏ฟฝX๏ฟฝg๏ฟฝล‚๏ฟฝ๏ฟฝB ๏ฟฝ๏ฟฝ๏ฟฝ๏ฟฝ๏ฟฝอ‚๏ฟฝ๏ฟฝ๏ฟฝ๏ฟฝ‚๏ฟฝ๏ฟฝฬƒ๏ฟฝ๏ฟฝ๏ฟฝ๏ฟฝ_๏ฟฝ๏ฟฝ๏ฟฝศ•๏ฟฝ๏ฟฝอ‚ล‚๏ฟฝ๏ฟฝB
iconv: test-utf8.txt:2:0: cannot convert

According to this StackOverflow post, it seems like there is not a canonical tilde representation of the ~ character in Shift_JIS, so the app is doing its best to try and preserve as much of your content as possible, even if it can't be encoded. This is also my experience when using other macOS tools that can interpret Shift_JIS, though some will preserve the invalid character I'm not sure that's always the desired behavior.

About View, download, and export

Node avatar for View, download, and export
Need support with viewing, downloading, and exporting files and folders from your Dropbox account? Find help from the Dropbox Community.

The Dropbox Community team is active from Monday to Friday. We try to respond to you as soon as we can, usually within 2 hours.

If you need more help you can view your support options (expected response time for an email or ticket is 24 hours), or contact us on X, Facebook or Instagram.

For more info on available support options for your Dropbox plan, see this article.

If you found the answer to your question in this Community thread, please 'like' the post to say thanks and to let us know it was useful!