<html><head><meta name="color-scheme" content="light dark"></head><body><pre style="word-wrap: break-word; white-space: pre-wrap;"># NAME

Lingua::JA::NormalizeText - All-in-One Japanese text normalizer

# SYNOPSIS

    use Lingua::JA::NormalizeText;
    use utf8;

    my @options = ( qw/nfkc decode_entities/, \&amp;dearinsu_to_desu );
    my $normalizer = Lingua::JA::NormalizeText-&gt;new(@options);

    my $text = $normalizer-&gt;normalize('йіҐгЃЊгЊ§гЊ¦гЃ§гЃ‚г‚Љг‚“гЃ™&amp;hearts;'); # =&gt; 'йіҐгЃЊгѓ€гѓігѓ‰гѓ«гЃ§гЃ™в™Ґ'

    sub dearinsu_to_desu
    {
        my $text = shift;
        $text =~ s/гЃ§гЃ‚г‚Љг‚“гЃ™/гЃ§гЃ™/g;

        return $text;
    }

\# or

    use Lingua::JA::NormalizeText qw/old2new_kanji/;
    use utf8;

    my $text = old2new_kanji('жѓЎгЃ®иЏЇ'); # =&gt; 'ж‚ЄгЃ®иЏЇ'



# DESCRIPTION

All-in-One Japanese text normalizer.

# METHODS

## new(@options)

Creates a new Lingua::JA::NormalizeText instance.

The following options are available:

    OPTION                 SAMPLE INPUT           OUTPUT FOR SAMPLE INPUT
    ---------------------  ---------------------  -----------------------
    lc                     DdD                    ddd
    uc                     DdD                    DDD
    nfkc                   пЅ¶пѕћ                     г‚¬ (U+30AC)
    nfkd                   пЅ¶пѕћ                     г‚«г‚™ (U+30AB. U+3099)
    nfc                    гѓ‰                     гѓ‰ (U+30C9)
    nfd                    гѓ‰                     гѓ€г‚™ (U+30C8, U+3099)
    decode_entities        &amp;hearts;               в™Ґ
    strip_html             &lt;em&gt;гЃ‚&lt;/em&gt;            гЃ‚
    alnum_z2h              пјЎпјўпјЈпј‘пј’пј“           ABC123
    alnum_h2z              ABC123                 пјЎпјўпјЈпј‘пј’пј“
    space_z2h              \x{3000}               \x{0020}
    space_h2z              \x{0020}               \x{3000}
    katakana_z2h           гѓЏг‚ЎгѓЏг‚Ў               пѕЉпЅ§пѕЉпЅ§
    katakana_h2z           пЅЅпЅ°пѕЉпЅ°пЅЅпЅ°пѕЉпЅ°               г‚№гѓјгѓЏгѓјг‚№гѓјгѓЏгѓј
    katakana2hiragana      гѓ‘гѓігѓ„                 гЃ±г‚“гЃ¤
    hiragana2katakana      гЃ±г‚“гЃ¤                 гѓ‘гѓігѓ„
    wave2tilde             гЂњ, гЂ°                 пЅћ
    tilde2wave             пЅћ                     гЂњ
    wavetilde2long         гЂњ, гЂ°, пЅћ             гѓј
    wave2long              гЂњ, гЂ°                 гѓј
    tilde2long             пЅћ                     гѓј
    fullminus2long         пјЌ                     гѓј
    dashes2long            вЂ”                      гѓј
    drawing_lines2long     в”Ђ                      гѓј
    unify_long_repeats     гѓґг‚Ўгѓјгѓјгѓј             гѓґг‚Ўгѓј
    nl2space               (LF)(CR)(CRLF}         (space)(space)(space)
    unify_nl               (LF)(CR)(CRLF)         \n\n\n
    unify_long_spaces      гЃ‚(space)(space)гЃ‚     гЃ‚(space)гЃ‚
    unify_whitespaces      \x{00A0}               (space)
    trim                   (space)гЃ‚(space)гЃ‚(space)  гЃ‚(space)гЃ‚
    ltrim                  (space)гЃ‚(space)       гЃ‚(space)
    rtrim                  гЃ‚гЃ‚(space)(space)     гЃ‚гЃ‚
    old2new_kana           г‚ђгѓ°г‚‘гѓ±гѓёгѓ№           гЃ„г‚¤гЃ€г‚Ёг‚¤г‚™г‚Ёг‚™
    old2new_kanji          дєћп©§й¬­                 дєњйЂёй—
    tab2space              (tab)(tab)             (space)(space)
    remove_controls        гЃ‚\x{0000}гЃ‚           гЃ‚гЃ‚
    remove_DFC             \x{202E}HOGE           HOGE
    remove_spaces          \x{0020}гЃ‚\x{3000}гЃ‚\x{0020}  гЃ‚гЃ‚
    dakuon_normalize       гЃ•\x{3099}             гЃ– (U+3056)
    handakuon_normalize    гЃЇ\x{309A}             гЃ± (U+3071)
    all_dakuon_normalize   гЃ•\x{3099}гЃЇ\x{309A}   гЃ–гЃ± (U+3056, U+3071)
    square2katakana        гЊў                     г‚»гѓігѓЃ
    circled2kana           г‹™г‹›г‹‘г‹џг‹‘             г‚іг‚·г‚¤г‚їг‚¤
    circled2kanji          гЉ©гЉ«гЉљгЉ’гЉ–             еЊ»е­¦з”·жњ‰иІЎ
    decompose_parenthesized_kanji  г€±             (ж&nbsp;Є)

The order in which these options are applied is according to the order of
the elements of @options.
(i.e., The first element is applied first, and the last element is applied last.)

External functions can be added.
(See dearinsu\_to\_desu function of the SYNOPSIS section.)



## normalize($text)

normalizes $text.



# OPTIONS

## lc, uc

These options are the same as CORE::lc and CORE::uc.

## nfkc, nfkd, nfc, nfd

See [Unicode::Normalize](https://metacpan.org/pod/Unicode::Normalize).

## decode\_entities

See [HTML::Entities](https://metacpan.org/pod/HTML::Entities).

## strip\_html

Strips HTML tags.

## alnum\_z2h, alnum\_h2z

Converts English alphabet, numbers and symbols ZENKAKU &lt;-&gt; HANKAKU.

ZENKAKU:

    пј‡пј»пЅ–пЅЏпјЊпЅћпј”пЅѓпј™пј¦пЅ•пјїпј­пј§пјґпј·пј°пЅ‘пїЈпЅ&nbsp;пј¶пЅ‰пј©пЅ’пјљпјєпјёпјЅпЅЊпјћ
    пЅќпї¦пјЃпЅњпЅпј–пј…пЅ”пјѕпјпЅ…пј¤пј«пј•пЅЉпјЌпї&nbsp;пЅ€пј‘пЅ›пјµпј’пј®пјЁпј†пјђпјѓпјЇпЅЋпїў
    пј&nbsp;пЅџпЅ†пј“пј±пЅЃпЅђпјЄпїҐпјџпјЎпЅ—пјјпј„пј‚пјўпЅЌпјЈпј—пј›пї¤пјќпЅ™пј‹пЅ‡пј№пјІпЅ‚пј¬пЅ‹
    пј‰пјіпЅЂпјҐпј€пїЎпјЉпјЋпЅљпЅ“пјЏпјњпЅ„

HANKAKU:

    '[vo,~4c9Fu_MGTWPqВЇв¦†ViIr:ZX]l&gt;
    }в‚©!|x6%t^8eDK5j-Вўh1{U2NH&amp;0#OnВ¬
    @в¦…f3QapJВҐ?Aw\$"BmC7;В¦=y+gYRbLk
    )S`E(ВЈ*.zs/&lt;d



## space\_z2h, space\_h2z

SPACE (U+0020) &lt;-&gt; IDEOGRAPHIC SPACE (U+3000)

## katakana\_z2h, katakana\_h2z

Converts katakanas ZENKAKU &lt;-&gt; HANKAKU.

See [Lingua::JA::Regular::Unicode](https://metacpan.org/pod/Lingua::JA::Regular::Unicode).



## hiragana2katakana

INPUT:

    гЃ·г‚”гЃ«г‚ЂгЃ¦гЃ„гЃ§гЃ№г‚ћг‚ђгЃµгЃЁгЃЉг‚ЉгЃ’гЃќгЃҐг‚€гЃЇгЃ¤гЃ–гЃ—г‚ѓгЃ®гЃЈгЃ­гЃІгЃѓгЃџг‚‡
    гЃ‘гЃѕг‚ЊгЃіг‚„гЃЊгЃЅгЃ¬гЃєгЃЏгЃћгЃ±гЃ”г‚’гЃёгЃљгЃ‹гЃґг‚…г‚ЋгЃ‚гЃЌг‚–гЃ‡гЃ©гЃ&nbsp;г‚Ќг‚‚гЃ€г‚Џ
    г‚“гЃ¶гЃњг‚ЃгЃЄгЃЎгЃ°гЃўг‚‹гЃ™гЃЃг‚•гЃјг‚‰гЃ‰г‚ќгЃђгЃ»гЃ•г‚‘гЃЋгЃїгЃ›гЃгЃ“гЃ…г‚†гЃ†

OUTPUT FOR INPUT:

    гѓ—гѓґгѓ‹гѓ&nbsp;гѓ†г‚¤гѓ‡гѓ™гѓѕгѓ°гѓ•гѓ€г‚ЄгѓЄг‚Іг‚Ѕгѓ…гѓЁгѓЏгѓ„г‚¶г‚·гѓЈгѓЋгѓѓгѓЌгѓ’г‚Јг‚їгѓ§
    г‚±гѓћгѓ¬гѓ“гѓ¤г‚¬гѓќгѓЊгѓљг‚Їг‚ѕгѓ‘г‚ґгѓІгѓг‚єг‚«гѓ”гѓҐгѓ®г‚ўг‚­гѓ¶г‚§гѓ‰гѓЂгѓ­гѓўг‚ЁгѓЇ
    гѓігѓ–г‚јгѓЎгѓЉгѓЃгѓђгѓ‚гѓ«г‚№г‚Ўгѓµгѓњгѓ©г‚©гѓЅг‚°гѓ›г‚µгѓ±г‚®гѓџг‚»г‚ёг‚іг‚Ґгѓ¦г‚¦



## katakana2hiragana

INPUT:

    пѕгѓњг‚єг‚·пЅ·пЅ­пѕ™пѕ€г‚°гѓЌг‚­пЅЄгѓ±гѓ†пЅёгѓ‹пѕ„пѕ›гѓ‰г‚§г‚ігѓЅпѕЃг‚¬пѕЌгѓ€пЅ©гѓЂгѓ¤гѓ¬
    пѕ†гѓЃг‚ЅгѓЋпЅїпЅ»гѓ‘гѓЁпЅ§пѕ‰пѕЉг‚ґг‚ІпЅ«гѓ®гѓўгѓ°гѓ«гѓІгѓ&nbsp;пЅ±пѕѓг‚јгѓќгѓ•гѓЏгѓЈг‚µгѓѓгѓ©
    пѕЏг‚ўг‚Јгѓ§пЅіпЅµг‚Єг‚ЇгѓЎпѕ•г‚Ґгѓ‚г‚®пѕ’г‚¦пѕ…г‚№пЅЅпѕ—пЅѕг‚¶гѓ–пѕЊгѓпЅєпЅ¶гѓљг‚«пЅІгѓѕ
    г‚ЁпѕњгѓґгѓіпѕЂпЅ¬пѕЋпЅ®пѕ–гѓ„г‚ѕгѓђгѓ—пѕ“г‚»пѕ‘пЅ№гѓЄгѓ‡пѕђгѓџгѓ›г‚±г‚¤гѓ’пЅЇгѓ¦пѕ‚гѓћгѓµ
    г‚їпѕљгѓ”г‚ёпЅјпѕ‡гѓ“гѓ…гѓЊпЅЁпѕќпЅґг‚Ўг‚©гѓ¶гѓЉпЅ¦гѓҐпѕ”гѓ­пѕ‹гѓ™гѓЇ

OUTPUT FOR INPUT:

    г‚ЉгЃјгЃљгЃ—гЃЌг‚…г‚‹гЃ­гЃђгЃ­гЃЌгЃ‡г‚‘гЃ¦гЃЏгЃ«гЃЁг‚ЌгЃ©гЃ‡гЃ“г‚ќгЃЎгЃЊгЃёгЃЁгЃ…гЃ&nbsp;г‚„г‚Њ
    гЃ«гЃЎгЃќгЃ®гЃќгЃ•гЃ±г‚€гЃЃгЃ®гЃЇгЃ”гЃ’гЃ‰г‚Ћг‚‚г‚ђг‚‹г‚’г‚ЂгЃ‚гЃ¦гЃњгЃЅгЃµгЃЇг‚ѓгЃ•гЃЈг‚‰
    гЃѕгЃ‚гЃѓг‚‡гЃ†гЃЉгЃЉгЃЏг‚Ѓг‚†гЃ…гЃўгЃЋг‚ЃгЃ†гЃЄгЃ™гЃ™г‚‰гЃ›гЃ–гЃ¶гЃµгЃёгЃ“гЃ‹гЃєгЃ‹гЃ„г‚ћ
    гЃ€г‚Џг‚”г‚“гЃџг‚ѓгЃ»г‚‡г‚€гЃ¤гЃћгЃ°гЃ·г‚‚гЃ›г‚ЂгЃ‘г‚ЉгЃ§гЃїгЃїгЃ»гЃ‘гЃ„гЃІгЃЈг‚†гЃ¤гЃѕг‚•
    гЃџг‚ЊгЃґгЃгЃ—гЃ¬гЃігЃҐгЃ¬гЃѓг‚“гЃ€гЃЃгЃ‰г‚–гЃЄг‚’г‚…г‚„г‚ЌгЃІгЃ№г‚Џ



## wave2tilde

Converts WAVE DASH (U+301C) and WAVY DASH (U+3030) into tilde (U+FF5E).

## tilde2wave

Converts tilde (U+FF5E) into wave (U+301C).

## wavetilde2long

Converts WAVE DASH (U+301C), WAVY DASH (U+3030) and tilde (U+FF5E) into long (U+30FC).

## wave2long

Converts WAVE DASH (U+301C) and WAVY DASH (U+3030) into long (U+30FC).

## tilde2long

Converts tilde (U+FF5E) into long (U+30FC).

## fullminus2long

Converts FULLWIDTH HYPHEN-MINUS (U+FF0D) into long (U+30FC).

## dashes2long

Converts the following characters into long (U+30FC).

    U+2012  FIGURE DASH
    U+2013  EN DASH
    U+2014  EM DASH
    U+2015  HORIZONTAL BAR

Note that this option does not convert hyphens into long.



## drawing\_line2long

Converts the following characters into long (U+30FC).

    U+2500  BOX DRAWINGS LIGHT HORIZONTAL
    U+2501  BOX DRAWINGS HEAVY HORIZONTAL
    U+254C  BOX DRAWINGS LIGHT DOUBLE DASH HORIZONTAL
    U+254D  BOX DRAWINGS HEAVY DOUBLE DASH HORIZONTAL
    U+2574  BOX DRAWINGS LIGHT LEFT
    U+2576  BOX DRAWINGS LIGHT RIGHT
    U+2578  BOX DRAWINGS HEAVY LEFT
    U+257A  BOX DRAWINGS HEAVY RIGHT



## unify\_long\_repeats

Unifies long (U+30FC) repeats.

## nl2space

Converts new lines (LF, CR, CRLF) into SPACE (U+0020).

## unify\_nl

Unifies new lines.

## unify\_long\_spaces

Unifies long spaces (U+0020 and U+3000).

## unify\_whitespaces

Converts the following characters into SPACE (U+0020).

    U+000B  LINE TABULATION
    U+000C  FORM FEED
    U+0085  NEXT LINE
    U+00A0  NO-BREAK SPACE
    U+1680  OGHAM SPACE MARK
    U+180E  MONGOLIAN VOWEL SEPARATOR
    U+2000  EN QUAD
    U+2001  EM QUAD
    U+2002  EN SPACE
    U+2003  EM SPACE
    U+2004  THREE-PER-EM SPACE
    U+2005  FOUR-PER-EM SPACE
    U+2006  SIX-PER-EM SPACE
    U+2007  FIGURE SPACE
    U+2008  PUNCTUATION SPACE
    U+2009  THIN SPACE
    U+200A  HAIR SPACE
    U+2028  LINE SEPARATOR
    U+2029  PARAGRAPH SEPARATOR
    U+202F  NARROW NO-BREAK SPACE
    U+205F  MEDIUM MATHEMATICAL SPACE

Note that this option does not convert the following characters:

    U+0009  CHARACTER TABULATION
    U+000A  LINE FEED
    U+000D  CARRIAGE RETURN
    U+3000  IDEOGRAPHIC SPACE



## trim

Removes leading and trailing whitespace.

## ltrim

Removes only leading whitespace.

## rtrim

Removes only trailing whitespace.

## old2new\_kana

    INPUT  OUTPUT FOR INPUT
    -----  --------------------
    г‚ђ     гЃ„
    гѓ°     г‚¤
    г‚‘     гЃ€
    гѓ±     г‚Ё
    гѓё     г‚¤г‚™ (U+30A4, U+3099)
    гѓ№     г‚Ёг‚™ (U+30A8, U+3099)



## old2new\_kanji

INPUT:

    дєћжѓЎеЈ“ењЌз€Ій†«еЈ№п©§зЁ»йЈ®йљ±з‡џж¦®иЎћй©›п©ўењ“з·Ји‰·й№ЅеҐ§ж‡‰ж©«ж­ђжЇ†й»ѓжє«з©©еЃ‡еѓ№
    п©’з•«жњѓеЈћпЁЅж‡·п©…з№ЄпЁѕж§Єж“ґж®ји¦єе­ёе¶ЅжЁ‚пЁ¶жёґп©&nbsp;е‹ёеЌ·еЇ¬ж­Ўп©‡зЅђи§Ђй—њй™·йЎЏпЁё
    п©‚ж­ёж°Јп©Ћйѕњеѓћж€ІзЉ§и€Љж“љж“§и™›еіЅжЊѕз‹№й„•п©©ж›‰пЁґп©ЈеЌЂй©…е‹іи–°еѕ‘жѓ&nbsp;жЏ­жєЄз¶“з№ј
    иЋ–ићўиј•й·„и—ќж“Љзјєе„‰еЉЌењ€жЄўж¬ЉзЌ»зЎЏзёЈйљЄйЎЇй©—ељґж•€е»ЈжЃ†й‘›и™џењ‹п©”й»‘жїџзўЋйЅ‹
    еЉ‘ж«»е†ЊпҐ°й›њеЏѓж…жЈ§и&nbsp;¶иґЉж®п©ЌзµІп©ЎйЅ’е…’иѕ­жї•еЇ¦и€ЌеЇ«п©€п©Њп©›й‡‹еЈЅж”¶п©њеѕћжѕЃ
    зЌёзё±п©‘и‚…и™•п©ѓз·–п©љпЁўж•ЌеҐ¬е°‡ж¶‰з‡’пЁљзЁ±и­‰д№е‰©еЈ¤е­ѓжўќж·Ёз‹Ђз–Љи®“й‡Ђе›‘и§ёеЇў
    ж„јзњћпЁ™з›Ўењ–зІ№й†‰йљЁй«“ж•ёжЁћзЂЁиЃІйќњйЅЉж”ќз«Љп©–е°€ж€°ж·єжЅ›зє–иёђйЊўз¦Єж›ѕп©ђпЁ±й›™
    еЈЇпЁ»жђњжЏ’е·ўз€­з¦зёЅиЋЉиЈќйЁ·еўћпЁїи‡џи—Џп©ҐеЌЅе±¬зєЊеў®й«”е°Ќеё¶ж»Їи‡єзЂ§ж“‡жѕ¤е–®пЁ·
    ж“”и†ЅењеЅ€ж–·з™ЎйЃІж™ќиџІй‘„п©џе»іеѕµп©ЂиЃЅж••йЋ­пЁђйЃћйђµиЅ‰й»ће‚іпЁ¦й»Ёз›њз‡€з•¶й¬­еѕ·
    зЌЁи®Ђп©•е±†з№©п©ЁиІіжѓ±и…¦йњёе»ўж‹њп©„иіЈйєҐз™јй«®ж‹”п©™ж™љи&nbsp;»пЁµп©‹зҐ•жї±п©¤п©Єп©Ѓз”ЃпЁ°
    пЁ›ж‹‚дЅ›еЂ‚пЁ№з«ќи®Љй‚ЉпЁіиѕЁз“ЈиѕЇи€–ж­Ґз©—еЇ¶иҐѓи±ђпЁєжІ’йЈњжЇЏиђ¬ж»їпЁІйєµй»й¤&nbsp;ж€ѕеЅЊ
    и—Ґи­Їи±«й¤и€‡и­Ѕжђ–жЁЈи¬&nbsp;дѕ†иіґдє‚п¤ќи¦Ѕп§њйѕЌп¤¶е…©зЌµз¶&nbsp;еЈж·љп§ђе‹µз¦®йљёйќ€йЅЎж›†ж­·
    ж€Ђп©—йЌЉз€ђе‹ћп¤Ёп¤©жЁ“йѓћйЊ„зЃЈе&nbsp;Їе·–ж™‰ж§‡п©†пЁ–п©Љз‘¤п©ЏзҐїп©“з©°иЃ°йЃ™

OUTPUT FOR INPUT:

    дєњж‚Єењ§е›Із‚єеЊ»еЈ±йЂёзЁІйЈІйљ&nbsp;е–¶ж&nbsp;„иЎ›й§…и¬Ѓе††зёЃи‰¶еЎ©еҐҐеїњжЁЄж¬§ж®ґй»„жё©з©Џд»®дѕЎ
    з¦Ќз”»дјљеЈЉж‚”ж‡ђжµ·зµµж…Ёж¦‚ж‹Ўж®»и¦ље­¦еІіжҐЅе–ќжё‡и¤ђе‹§е·»еЇ›ж­“жјўзј¶и¦ій–ўй™ҐйЎ”е™Ё
    ж—ўеё°ж°—зҐ€дєЂеЃЅж€ЇзЉ&nbsp;ж—§ж‹&nbsp;жЊ™и™љеіЎжЊџз‹­йѓ·йџїжљЃе‹¤и¬№еЊєй§†е‹Іи–«еѕ„жЃµжЋІжё“зµЊз¶™
    иЊЋи›Ќи»Ѕй¶ЏиЉёж’ѓж¬&nbsp;еЂ№е‰ЈењЏж¤њжЁ©зЊ®з&nbsp;”зњЊй™єйЎ•йЁ“еЋіеЉ№еєѓжЃ’й‰±еЏ·е›Ѕз©Ђй»’жё€з&nbsp;•ж–Ћ
    е‰¤жЎње†Љж®єй›‘еЏ‚жѓЁжЎџиљ•иі›ж®‹зҐ‰зіёи¦–ж­Їе…ђиѕћж№їе®џи€Ће†™з…®з¤ѕиЂ…й‡€еЇїеЏЋи‡­еѕ“жё‹
    зЌЈзё¦зҐќзІ›е‡¦жљ‘з·’зЅІи«ёеЏ™еҐЁе°†жё‰з„јзҐҐз§°иЁјд№—е‰°еЈЊе¬ўжќЎжµ„зЉ¶з•іи­Ій†ёе±и§¦еЇќ
    ж…ЋзњџзҐће°Ѕе›ізІ‹й…”йљЏй«„ж•°жћўзЂ¬еЈ°йќ™ж–‰ж‘‚зЄѓзЇЂе°‚ж€¦жµ…жЅњз№Љи·µйЉ­з¦…ж›ЅзҐ–еѓ§еЏЊ
    еЈ®е±¤жЌњжЊїе·Јдє‰з—©з·ЏиЌиЈ…йЁ’еў—ж†Ћи‡“и”µиґ€еЌіе±ћз¶ље&nbsp;•дЅ“еЇѕеёЇж»ћеЏ°ж»ќжЉћжІўеЌе†
    ж‹…иѓ†е›Јејѕж–­з—ґйЃ…жји™«й‹іи‘—еєЃеѕґж‡ІиЃґе‹…йЋ®еЎљйЂ“й‰„и»ўз‚№дјќйѓЅе…љз›—зЃЇеЅ“й—еѕі
    з‹¬иЄ­зЄЃе±Љзё„й›Јејђж‚©и„іи¦‡е»ѓж‹ќжў…еЈІйє¦з™єй«ЄжЉњз№Ѓж™©и›®еЌ‘зў‘з§жµњиі“й&nbsp;»ж•Џз“¶дѕ®
    з¦Џж‰•д»ЏдЅµеЎЂдё¦е¤‰иѕєе‹‰ејЃејЃејЃи€—ж­©з©‚е®ќи¤’и±ЉеўЁжІЎзї»жЇЋдё‡жєЂе…Ќйєєй»™й¤…ж€»ејҐ
    и–¬иЁідє€дЅ™дёЋиЄ‰жЏєж§и¬ЎжќҐй&nbsp;јд№±ж¬„и¦§йљ†з«њи™њдёЎзЊџз·‘еЎЃж¶™йЎћеЉ±з¤јйљ·йњЉйЅўжљ¦ж­ґ
    жЃ‹з·ґйЊ¬з‚‰еЉґе»Љжњ—жҐјйѓЋйЊІж№ѕе°­е·Њж™‹ж§™жёљзЊЄзђўз‘¶зҐђз¦„з¦Ћз©ЈиЃЎйЃҐ



## tab2space

Converts CHARACTER TABULATION (U+0009) into SPACE (U+0020).

## remove\_controls

Removes the following characters:

    U+0000 .. U+0008
    U+000B
    U+000C
    U+000E .. U+001F
    U+007F .. U+009F

Note that this option does not remove the following characters:

    U+0009  CHARACTER TABULATION
    U+000A  LINE FEED
    U+000D  CARRIAGE RETURN



## remove\_DFC

Removes the following Directional Formatting Characters:

    U+061C  ARABIC LETTER MARK
    U+2066  LEFT-TO-RIGHT ISOLATE
    U+2067  RIGHT-TO-LEFT ISOLATE
    U+2068  FIRST STRONG ISOLATE
    U+2069  POP DIRECTIONAL ISOLATE
    U+200E  LEFT-TO-RIGHT MARK
    U+200F  RIGHT-TO-LEFT MARK
    U+202A  LEFT-TO-RIGHT EMBEDDING
    U+202B  RIGHT-TO-LEFT EMBEDDING
    U+202C  POP DIRECTIONAL FORMATTING
    U+202D  LEFT-TO-RIGHT OVERRIDE
    U+202E  RIGHT-TO-LEFT OVERRIDE



See [http://www.unicode.org/reports/tr9/](http://www.unicode.org/reports/tr9/) for more information about Directional Formatting Characters.



## remove\_spaces

Removes SPACE (U+0020) and IDEOGRAPHIC SPACE (U+3000).

## dakuon\_normalize, handakuon\_normalize, all\_dakuon\_normalize

See [Lingua::JA::Dakuon](https://metacpan.org/pod/Lingua::JA::Dakuon).

## square2katakana, circled2kana, circled2kanji

See [Lingua::JA::Moji](https://metacpan.org/pod/Lingua::JA::Moji).

## decompose\_parenthesized\_kanji

Decomposes the following parenthesized kanji:

    г€&nbsp;г€Ўг€ўг€Јг€¤г€Ґг€¦г€§г€Ёг€©г€Єг€«г€¬г€­г€®г€Їг€°г€±г€Іг€іг€ґг€µг€¶г€·г€ёг€№г€єг€»г€јг€Ѕг€ѕг€їг‰Ђг‰Ѓг‰‚г‰ѓ



# AUTHOR

pawa &lt;pawapawa@cpan.org&gt;

# SEE ALSO

ж–°ж—§е­—дЅ“иЎЁ: [http://www.asahi-net.or.jp/~ax2s-kmtn/ref/old_chara.html](http://www.asahi-net.or.jp/~ax2s-kmtn/ref/old_chara.html)

[Lingua::JA::Regular::Unicode](https://metacpan.org/pod/Lingua::JA::Regular::Unicode)

[Lingua::JA::Dakuon](https://metacpan.org/pod/Lingua::JA::Dakuon)

[Lingua::JA::Moji](https://metacpan.org/pod/Lingua::JA::Moji)

[Unicode::Normalize](https://metacpan.org/pod/Unicode::Normalize)

[Unicode::Number](https://metacpan.org/pod/Unicode::Number)

[HTML::Entities](https://metacpan.org/pod/HTML::Entities)

[HTML::Scrubber](https://metacpan.org/pod/HTML::Scrubber)

# LICENSE

This library is free software; you can redistribute it and/or modify
it under the same terms as Perl itself.
</pre></body></html>