method

normalize

v2.1.0 - Show latest stable - 0 notes - Class: ActiveSupport::Multibyte::Handlers::UTF8Handler

1.0.0
1.1.6
1.2.6 (0)
2.0.3 (0)
2.1.0 (10)
2.2.1
2.3.8
3.0.0
3.0.9
3.1.0
3.2.1
3.2.8
3.2.13
4.0.2
4.1.8
4.2.1
4.2.7
4.2.9
5.0.0.1
5.1.7
5.2.3
6.0.0
6.1.3.1
6.1.7.7
7.0.0
7.1.3.2
What's this?

normalize(str, form=ActiveSupport::Multibyte::DEFAULT_NORMALIZATION_FORM) public

Returns the KC normalization of the string by default. NFKC is considered the best normalization form for passing strings to databases and validations.

str - The string to perform normalization on.
form - The form you want to normalize in. Should be one of the following: :c, :kc, :d, or :kd. Default is ActiveSupport::Multibyte::DEFAULT_NORMALIZATION_FORM.

Show source

# File activesupport/lib/active_support/multibyte/handlers/utf8_handler.rb, line 289
      def normalize(str, form=ActiveSupport::Multibyte::DEFAULT_NORMALIZATION_FORM)
        # See http://www.unicode.org/reports/tr15, Table 1
        codepoints = u_unpack(str)
        case form
          when :d
            reorder_characters(decompose_codepoints(:canonical, codepoints))
          when :c
            compose_codepoints reorder_characters(decompose_codepoints(:canonical, codepoints))
          when :kd
            reorder_characters(decompose_codepoints(:compatability, codepoints))
          when :kc
            compose_codepoints reorder_characters(decompose_codepoints(:compatability, codepoints))
          else
            raise ArgumentError, "#{form} is not a valid normalization variant", caller
        end.pack('U*')
      end

normalize

Related methods

Flowdock - Team Inbox With Chat