[Q] Force SMS encoding from Unicode to ISO - Android Q&A, Help & Troubleshooting

Hey there.
I'm from Portugal and here we have some accentuated letters like "à á é ç ã õ".
When the system language is set to English and we insert one of these letters the SMS limit falls down from 160 charachters to 70 because it changes the encoding of the SMS .
What I would like to know is if it's possible to come with an hack to force the system to encode the SMS in a particular way so these kind of letters don't cut us 90 characters off the message please.
Actually this is a problem in a lot of countries. Spain, France, Portugal, Italy, Brazil, Mexico, Argentina and the list goes on... Any country that speeks a latin language really.
So, can anyone help us out?
PS: I own a Samsung Galaxy S at the moment

Same problem here
Got a Magic 32A from Portuguese operator TMN
I'm running CyanogenMod 6.0.0 RC3
What happens is that if i set Android in Portuguese language the SMS's work as expected.
If you change the language to English, when writing an SMS, if a character like "á" "é" is used you end having only 70 characters available.
My interest was to use Android in English but send SMS's with latin characters whithout having only 70 characters available per SMS.
In Windows Mobile 5/6 there was an option to disable unicode.
Any help? Thanks in advance

This problem also happens with CyanogenMod 5.0.8

anyone? please?

Samsung Galaxy has the problem solved.
I guess that they solved it by themselves. Neither Google nor HTC give a $hit about it. For instance, HTC still has this problem on all android devices.
I owned a Legend with Android 2.2, and the problem persisted. As it was still in warranty, I returned it to the store, got refunded, and bought a Samsung Galaxy

you should feel fortunate that at least you can send the unicoded characters here in the US, most carriers do not properly send unicoded characters, and instead they arrive as BLOCKS on the recipient phone. So imagine wanting to send an SMS with a foreign language that contains accents or unicoded characters when living in the US. You really can't.
To that end, it'd be nice if one of the SMS programs had an option to convert all Unicoded text messages to ASCII prior to sending. This way you can continue to use your foreign language keyboard and dictionaries with accents and unicoded characters and be confident that the message will not be corrupted when sent. And it'd allow a 160 character ASCII message as well.

this is native issue of the SMS, not the phone or OS issue
if you want to force encoding without Unicode, characters like à á é ç ã õ will convert to a a a c a o accordingly.

Still have the same issue. This is stupid really

Please use the Q&A Forum for questions Thanks
Moving to Q&A

Anyone? I have the same problem in runnymede.

Samsung Galaxy 3 on Froyo has solved that...
EDITI've heard also about Samsung Galaxy Ace, both in Poland.)

Use Handcent SMS app
I had the same problem. I am a spanish native speaker, hence my SMS are sent in spanish. Due to autocorrection, some words automatically add the accent in some words. I had not found any solution to the native application for SMS, however I noticed that using "Hancent SMS" app, although the accents are added, the number of characters are still 160!

some temporary solution
Some letters are included in english character set, which you can use without the automatic change of the character set, so the sms will remain 160 chars, instead of 60 or something like that.
these characters are definitely included:
(à,ä,æ,å,é,è,ü,ú,ö,ò,ß,...)
You can try out when you start writing an sms, and turn on the "remaining characters counter" and try it for your self which characters you could use.
for example you can use "à" instead of "á" it still stays 160 chars.

The feature "Strip Unicode" for CM http://review.cyanogenmod.org/#/c/19381 solves the problem. Well, not quite like in Nokia and many other phones (they let you write diacritics but strip them only after you click "send" – and they send pure GSM chars) but it changes every char right at the moment of input:
– if you type letter by letter: when you type the diacritic (e.g. "ć" or "Ü") it instantly changes into its GSM alternative ("c" or "U");
- if you use dictionary: you type in letters, dictionary shows you propositions but when you choose the proposition(word) (by tapping it or typing space) it inserts the word with Unicode chars changed into their GSM alternatives.

Related

SMS problem. 1 sms sent and it charged me 4 sms's

Hi all. I've been looking for this issue around the net and haven't found anything.
I've sent 1 sms with 175 letters (it's not much) and the phone divided it in 4 and charged me for 4 sms's. I have the maximum size for messages set on 300k (I guess it means 300 letters or dots or whatever).
Does anyone gets this in their HERO?
Anyone has a solution?
Thanks in advance
sms messages contain a maximum of 160 characters including spaces, if you sent 175 characters including spaces you would have been charged for 2 sms messages.
The 300k limit you are talking about is for mms messages. If you sent the sms as a mms then the charges you would incur would be dependant on your provider.
You have to pick either sms or mms depending on what your sending the software will not guess for you.
Also if you sent an SMS containing any 'special' characters it would have been sent in Unicode which in this case each character will occupy 2 bytes. I can see how you ended up with 4 messages.
by your user name, i suppose your Polish? Using Polish characters (ąęółńżź) uses up more "sms space" just like TheBrit wrote.
I didn't use any special characters, only letters, dots, spaces and comas. I'm Portuguese, so I use regular characters.
I would accept to be charged for 2 sms´s, but 4?? it's ridiculous.
This must be some kind of a bug, this has happened before, but only now I realised something was wrong.
Thanks for the replies.
I have a similar problem... when I type normal sentences, the letter-count is ok.. but when I type a letter that you can select when holding a letter (e.g. you hold the letter "o" and you select ô) the message-count jumps automatically to 2 or 3... it's really annoying... is this also a bug?
No, it is correct behaviour if you are using a character that isn't represented in the 8-bit ASCII character set. As has been previously mentioned, unicode characters effectively take up more "space" than a regular character - the SMS 160 character limit is based on using 8-bit characters.
Regards,
Dave
that's pretty sh**y
thanks anyway
I found out that the limit in my Hero is 145 characters, but if I type only 3 special characters like é â ç, the limit drops to 63 characters in 1 sms. Just by typing 3 letters like those (ê ç ô) I lose 82 characters. Could this be a network provider limitation for sms's when using non 8-bit ASCII characters? Or is it the phone?
Anyway, this very annoying we have to type incorrectly to be able to send a bigger sms.
zbrinski said:
I found out that the limit in my Hero is 145 characters, but if I type only 3 special characters like é â ç, the limit drops to 63 characters in 1 sms. Just by typing 3 letters like those (ê ç ô) I lose 82 characters. Could this be a network provider limitation for sms's when using non 8-bit ASCII characters? Or is it the phone?
Anyway, this very annoying we have to type incorrectly to be able to send a bigger sms.
Click to expand...
Click to collapse
Because they are non-ascii characters the whole message has to be in unicode. Unicode can have characters up to 8 bytes to cope with things like chinese or japanese charcters. When using the extra characters used in some european languages the character set uses all 2 byte characters - even for 'normal' ascii chacters. The 2 byte charcter set is part of Unicode and is known as UTF-16. Normal ascii is also known as UTF-8.
This is not your phone's fault or even the network's fault. It's just the way things are. Read about it here.
In my hero i dont see the number of characters during I write the SMS!!!
Why? Where is the settings to show it??
Bye
TheBrit said:
Because they are non-ascii characters the whole message has to be in unicode. Unicode can have characters up to 8 bytes to cope with things like chinese or japanese charcters. When using the extra characters used in some european languages the character set uses all 2 byte characters - even for 'normal' ascii chacters. The 2 byte charcter set is part of Unicode and is known as UTF-16. Normal ascii is also known as UTF-8.
This is not your phone's fault or even the network's fault. It's just the way things are. Read about it here.
Click to expand...
Click to collapse
No, it's not. With other terminals this isn't happening. It's a bug in Android code and it's supposed to be fixed in donut. Let's see when the fix arrives to the Hero.
More info here: http://code.google.com/p/android/issues/detail?id=2719
That is *not* the same issue! Related in a way, yes, but otherwise different.
The point that "TheBrit" and others are making is that use of a unicode character set effectively means each SMS is going to be less than 160 characters. The fact that there is a bug in Android when a long SMS message is split is a different issue.
Regards,
Dave
I think it's the same issue.
http://code.google.com/p/android/issues/detail?id=2600
This one is merged with issue 2719. Two different problems only one Android bug.The SMS application does not manage extended characters (accented chars, ñ
char and others) correctly. A extended character takes more space than a
normal character. Don't know how other handsets do this, but you can use extended characters and be within 160 chars! No need for unicode eating the chars.
ssj5trunks said:
In my hero i dont see the number of characters during I write the SMS!!!
Why? Where is the settings to show it??
Bye
Click to expand...
Click to collapse
The phone only shows the number of characters left, when you are near the limit of the number of characters the message has , it shows the count of the last 10 characters to make a total of 145.
If you pass the 145 ch it will always show the the character counter in the up right corner of the typing box.(but if you type in landscape mode, it doesn't show the count)

(Q) Special characters in sms

Hi,
My wife's x10 mini is not displaying special characters in received sms. She can write them and see them when she is writing sms but received sms with special characters only show a blank space in their place.
For instance, she can write "praça", and see it correctly. If I send her the same word in an sms she only sees "pra a".
Does anybody have an idea on what I can do to help solve this problem?
The phone is configured as Portuguese (Portugal).
Any help is appreciated.
Try to change keyboard layout or system language or app language. Or Maybe your ROM can't read characters like "ç"

SlideIT -unicode- problem

Hi all,
I am typing my SMS with SlideIT in Croatian, of course with unicode special characters. I need a fix which will send the text without these special unicode signs to send it like a normal 160 characters instead of 70 characters SMS (i read somewere there existis an app for that, but can' find it)
I tried to switch off the UNICODE selection in the message´s option, but the result is a sms with "?" instead of the special characters.
A possible solution is to have the Croatian dictionary without special characters, but I couldn't find any editor of it.
So has any one an idea?

Sony Ericsson Xperia Mini ST15i sms characters limit

Hi guys, I just got my new Xperia Mini ST15i and I can say I couldn't be happier with it. I only have one problem. When I want to send a sms, when I type characters that are the same in greek and english alphabet (like A or B), my character liimt drops to 70 chars per sms. However if I use greek only letters (like Γ or Ω) it keeps the 160 chars limit. How can this be fixed? Please let me note that this happens with small and capital letters too. Thanks
It's a GSM limitation. Not your phone's. When you type in multi-languages, the SMS app automatically encodes the message in UCS2. UCS2 needs twice space to encode a character.
Thank you for your reply.I understand. But how come my old k770i send normally text messages without this limit, with same greek chars? Is there a way to change this encoding?
You don't have such an option in the build-in sms app. You may try handcent sms, it has a greek sms mode.
Thanks, I have already tried this app. But unfortunately it does not have greek contact sorting.... If you knew a way to fix this I would be grateful.
Is your phone language set to Greek?
Yes, it is set to Greek. The android default messaging app sorts the contacts correctly. But Handcent doesn't
Try "GO Sms", any luck with that?
Yes I have tried that too. It also supports the 160 sms limit but no greek contact sorting.
If the new mini runs on gingerbread, check this link:
http://www.myphone.gr/forum/showthread.php?t=311728
I hadn't seen that! Thank you my friend. I will give it a try and tell... Although I have to root first since i haven't done so yet....

[Q] SMS Input Mode - Wrongful GSM to Unicode conversion

Hey folks,
I experience this random issue where the stock SMS app (on MC3) decide to use the unicode character set, instead of the GSM character set.
At first it shows the correct character count, then suddenly the characters available drop to very low.
Please note that I did not use any special characters.
Perhaps this can be explained?
Thanx!

Categories

Resources