method

tidy_bytes

v2.1.0 - Show latest stable - 0 notes - Class: ActiveSupport::Multibyte::Handlers::UTF8Handler

1.0.0
1.1.6
1.2.6 (0)
2.0.3 (0)
2.1.0 (0)
2.2.1
2.3.8
3.0.0
3.0.9
3.1.0
3.2.1
3.2.8
3.2.13
4.0.2
4.1.8
4.2.1
4.2.7
4.2.9
5.0.0.1
5.1.7
5.2.3
6.0.0
6.1.3.1
6.1.7.7
7.0.0
7.1.3.2
What's this?

tidy_bytes(str) public

Replaces all the non-utf-8 bytes by their iso-8859-1 or cp1252 equivalent resulting in a valid utf-8 string

# File activesupport/lib/active_support/multibyte/handlers/utf8_handler.rb, line 359
      def tidy_bytes(str)
        str.split(//u).map do |c|
          if !UTF8_PAT.match(c)
            n = c.unpack('C')[0]
            n < 128 ? n.chr :
            n < 160 ? [UCD.cp1252[n] || n].pack('U') :
            n < 192 ? "\xC2" + n.chr : "\xC3" + (n-64).chr
          else
            c
          end
        end.join
      end

tidy_bytes

Related methods

Flowdock - Team Inbox With Chat