ruby - Regex error: too many multibyte code ranges are specified -


i have regex needs match bunch of characters. code has no problem ruby 1.8.7 in 1.9 kills over. guess has encoding, i've done chunk of google searches maybe can enlighten me.

code:

# encoding: utf-8 non_latin_hashtag_chars = [   (0xa960..0xa97f).to_a, # hangul jamo extended-a   (0xac00..0xd7af).to_a, # hangul syllables   (0xd7b0..0xd7ff).to_a  # hangul jamo extended-b ].flatten.pack('u*').freeze  e = /[a-z_#{non_latin_hashtag_chars}]/io

error:

~/desktop: ruby regex_test.rb  regex_test.rb:13:in `<main>': many multibyte code ranges specified: /[a-z_가각갂갃간갅갆갇갈갉갊갋갌갍갎갏감갑값갓갔강갖갗갘같갚갛개객갞갟갠갡갢갣갤갥갦갧갨갩갪갫갬갭갮갯갰갱갲갳갴갵갶갷갸갹갺갻갼갽갾갿걀걁걂걃걄걅걆걇걈걉걊걋걌걍......

as twehad points out, there 10k limit in regexp.

in anycase, should use unicode ranges within regexp:

/[a-z_\ua960-\ua97f\uac00-\ud7af\ud7b0-\ud7ff]/io

i'm not expert in korean don't know if equivalent, if want match hangul characters, should use class instead:

/[a-z_\p{hangul}]/io

Comments

Post a Comment

Popular posts from this blog

c++ - Is it possible to compile a VST on linux? -

for class project i'm attempting write vst plugin backed cuda. current cuda workflow on linux box, i'd prefer compile , link there. according wikipedia , should possible (i couldn't find steinberg documentation relevant linux) can't find makefile or instructions on how build if aren't using xcode or visual studio. i'm vst 3 sdk doesn't support linux. when try compile plugin under linux, error: ./base/source/fatomic.cpp:39:30: fatal error: libkern/osatomic.h: no such file or directory this issue caused following code in "vst3 sdk/base/source/fatomic.cpp" #if mac #include <libkern/osatomic.h> #if mac_os_x_version_min_required > mac_os_x_version_10_4 #define native_atomic_type (volatile int32_t*) #else #define native_atomic_type (int32_t*) #endif #elif windows #include <windows.h> #endif but hope compiling under linux work vst sdk 2.4. reading. jvstwrapper seems run on lin...
Read more

java - Output of Eclipse is rubbish -

i want write program in eclipse language different english. when display output using system.out program, displays output correctly in console editor. when accept input console , output it, output rubbish. how can solve it. many thnaks i'm not sure if problem, have character encoding problem. make sure you're using unicode, utf-8. you can read more @ official docs converting non-unicode text .
Read more

jquery - Confused with JSON data and normal data in Django ajax request -

i read json internet still have not got grasp of it. reading article http://webcloud.se/log/ajax-in-django-with-jquery/ i not understood first part function using json def xhr_test(request, format): if request.is_ajax(): if format == 'xml': mimetype = 'application/xml' if format == 'json': mimetype = 'application/javascript' data = serializers.serialize(format, examplemodel.objects.all()) return httpresponse(data,mimetype) # if want prevent non xhr calls else: return httpresponse(status=400) my main problems are from function getting format variable does format json mean data given function json or data recived json can give me simple example ouput of function data = serializers.serialize(format, examplemodel.objects.all()) how use data when response in jquery function if don't use json in above function how input , response chnage thanks ...
Read more