[ruby-core:20226] \b and \B with Unicode

[ruby-core:20226] \b and \B with Unicode

[Dave Thomas]

#encoding: utf-8
p "  ∂og ".match(/\b./u)    # =>  #<MatchData "o">


I was surprised that \b didn't find the boundary between the space and  
the Unicode ∂ character. Is that correct?


Dave

[ruby-core:20227] Re: \b and \B with Unicode

[Radosław Bułat]

On Wed, Dec 3, 2008 at 12:46 AM, Dave Thomas <dave@pragprog.com> wrote:
> #encoding: utf-8
> p "  ∂og ".match(/\b./u)    # =>  #<MatchData "o">
>
>
> I was surprised that \b didn't find the boundary between the space and the
> Unicode ∂ character. Is that correct?

Maybe ∂ isn't treat as word character?
"  ∂og ".match(/\w/) => #<MatchData "o">
I don't know if it should or not.

-- 
Pozdrawiam

Radosław Bułat
http://radarek.jogger.pl - mój blog

[ruby-core:20228] Re: \b and \B with Unicode

[Yukihiro Matsumoto]

Hi,

In message "Re: [ruby-core:20227] Re: \b and \B with Unicode"
    on Wed, 3 Dec 2008 09:06:55 +0900, "=?ISO-8859-2?Q?Rados=B3aw_Bu=B3at?=" <radek.bulat@gmail.com> writes:
|
|On Wed, Dec 3, 2008 at 12:46 AM, Dave Thomas <dave@pragprog.com> wrote:
|> #encoding: utf-8
|> p "  ∂og ".match(/\b./u)    # =>  #<MatchData "o">
|>
|> I was surprised that \b didn't find the boundary between the space and the
|> Unicode ∂ character. Is that correct?
|
|Maybe ∂ isn't treat as word character?
|"  ∂og ".match(/\w/) => #<MatchData "o">
|I don't know if it should or not.

I think it should.  I suspect it's a bug in Oniguruma.  I will inspect
it later.

							matz.

[ruby-core:20229] Re: \b and \B with Unicode

[Michael Selig]

On Wed, 03 Dec 2008 11:06:55 +1100, Radosław Bułat <radek.bulat@gmail.com>  
wrote:

> On Wed, Dec 3, 2008 at 12:46 AM, Dave Thomas <dave@pragprog.com> wrote:
>> #encoding: utf-8
>> p "  ∂og ".match(/\b./u)    # =>  #<MatchData "o">
>>
>>
>> I was surprised that \b didn't find the boundary between the space and  
>> the
>> Unicode ∂ character. Is that correct?
>
> Maybe ∂ isn't treat as word character?
> "  ∂og ".match(/\w/) => #<MatchData "o">
> I don't know if it should or not.
>

The character in question is Unicode U+2202 which is "Partial  
Differential". Though it looks like it might be a letter, it is NOT  
defined as a letter in Unicode (it is part of the "mathematical operators"  
block). So I think Ruby is correct here!

Cheers
Mike

[ruby-core:20234] Re: \b and \B with Unicode

[Dave Thomas]

On Dec 2, 2008, at 6:30 PM, Michael Selig wrote:

> The character in question is Unicode U+2202 which is "Partial  
> Differential". Though it looks like it might be a letter, it is NOT  
> defined as a letter in Unicode (it is part of the "mathematical  
> operators" block). So I think Ruby is correct here!

Ouch: I just used Option-D on the Mac to generate it.

I'll try again.


Thanks


Dave