Rails Forum - Ruby on Rails Help and Discussion Forum - UTF-8 encoding issue

Re: UTF-8 encoding issue

dummy@example.com (semaphore.v) — Wed, 13 Mar 2013 11:16:43 +0000

UTF-8 has become the dominant character encoding for the World-Wide Web, accounting for more than half of all Web pages.The Internet Engineering Task Force (IETF) requires all Internet protocols to identify the encoding used for character data, and the supported character encodings must include UTF-8.The Internet Mail Consortium (IMC) recommends that all e-mail programs be able to display and create mail using UTF-8.UTF-8 is also increasingly being used as the default character encoding in operating systems, programming languages, APIs, and software applications.

Re: UTF-8 encoding issue

dummy@example.com (mikefela) — Tue, 11 Dec 2012 09:29:06 +0000

I am confused after reading your issue , i can not provide you the solution .

UTF-8 encoding issue

dummy@example.com (silversurfer) — Fri, 30 Nov 2012 23:22:25 +0000

I'm working on a support issue where users enter text into a form and it should update an objects attributes in the database by calling update_attributes
The issue I'm having seems to be some kind of encoding problem - When a certain set of japanese characters are entered:
グーグル
はい

with the carriage return, it returns this error:

PG::Error: ERROR: invalid byte sequence for encoding "UTF8": 0xe3283f
: UPDATE "monitor_lists" SET "updated_at" = '2012-11-30 23:20:40.698964', "regexp" = '\bã(?:‚°ãƒ¼ã‚°ãƒ«|¯ã„)\b', "list" = 'ã‚°ãƒ¼ã‚°ãƒ«
ã¯ã„' WHERE "monitor_lists"."id" = 1

but I've checked and the front end site and back end DB both use UTF8, so there's no reason I can find why there should be an issue there. I did wonder if it could be something to do with the regex being generated for the japanese phrases - the error doesn't occur if you try either on their own or without the new line - but the hex code in the error line converts back to ?ã(? and that phrase isn't in the regex. I'm at a loss, so any suggestions would be appreciated.

Thanks in advance.