method

tidy_bytes

v2.3.8 - Show latest stable - 0 notes - Class: ActiveSupport::Multibyte::Chars

1.0.0
1.1.6
1.2.6
2.0.3
2.1.0
2.2.1 (0)
2.3.2 (0)
2.3.8 (0)
3.0.0
3.0.9
3.1.0
3.2.1
3.2.8
3.2.13
4.0.2
4.1.8
4.2.1
4.2.7
4.2.9
5.0.0.1
5.1.7
5.2.3
6.0.0
6.1.3.1
What's this?

tidy_bytes(string) public

Replaces all ISO-8859-1 or CP1252 characters by their UTF-8 equivalent resulting in a valid UTF-8 string.

# File activesupport/lib/active_support/multibyte/chars.rb, line 636
        def tidy_bytes(string)
          string.split(//u).map do |c|
            c.force_encoding(Encoding::ASCII) if c.respond_to?(:force_encoding)

            if !ActiveSupport::Multibyte::VALID_CHARACTER['UTF-8'].match(c)
              n = c.unpack('C')[0]
              n < 128 ? n.chr :
              n < 160 ? [UCD.cp1252[n] || n].pack('U') :
              n < 192 ? "\xC2" + n.chr : "\xC3" + (n-64).chr
            else
              c
            end
          end.join
        end

tidy_bytes

Related methods

Flowdock - Team Inbox With Chat for Software Developers