Alex Rivera | Logout

How to detect malformed UTF characters

Asked 2008-10-15T09:57:28.977
12

I want to detect and replace malformed UTF-8 characters with blank space using a Perl script while loading the data using SQL*Loader. How can I do this?

Edit
Report

1 Answer

1

EDIT: (Removed bit about SQL Loader as it seems to no longer be relevant.)

One problem is going to be working out what counts as the "end" of a malformed UTF-8 character. It's easy to say what's illegal, but it may not be obvious where the next legal character starts.

answered 2008-10-15T10:07:32.140

Your Answer