pub struct RuleBreakData<'data> {
pub property_table: CodePointTrie<'data, u8>,
pub break_state_table: ZeroVec<'data, BreakState>,
pub word_type_table: ZeroVec<'data, WordType>,
pub property_count: u8,
pub last_codepoint_property: u8,
pub sot_property: u8,
pub eot_property: u8,
pub complex_property: u8,
}
Expand description
Pre-processed Unicode data in the form of tables to be used for rule-based breaking.
๐ง This code is considered unstable; it may change at any time, in breaking or non-breaking ways,
including in SemVer minor releases. While the serde representation of data structs is guaranteed
to be stable, their Rust representation might not be. Use with caution.
Fieldsยง
ยงproperty_table: CodePointTrie<'data, u8>
Property table.
break_state_table: ZeroVec<'data, BreakState>
Break state table.
word_type_table: ZeroVec<'data, WordType>
Word type table. Only used for word segmenter.
property_count: u8
Number of properties; should be the square root of the length of Self::break_state_table
.
last_codepoint_property: u8
The index of the last simple state for Self::break_state_table
. (A simple state has no
left
nor right
in SegmenterProperty).
sot_property: u8
The index of SOT (start of text) state for Self::break_state_table
.
eot_property: u8
The index of EOT (end of text) state Self::break_state_table
.
complex_property: u8
The index of โSAโ state (or 127 if the complex language isnโt handled) for
Self::break_state_table
.
Trait Implementationsยง
Sourceยงimpl<'data> Clone for RuleBreakData<'data>
impl<'data> Clone for RuleBreakData<'data>
Sourceยงfn clone(&self) -> RuleBreakData<'data>
fn clone(&self) -> RuleBreakData<'data>
Returns a copy of the value. Read more
1.0.0 ยท Sourceยงfn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source
. Read moreSourceยงimpl<'data> Debug for RuleBreakData<'data>
impl<'data> Debug for RuleBreakData<'data>
Sourceยงimpl<'de, 'data> Deserialize<'de> for RuleBreakData<'data>where
'de: 'data,
impl<'de, 'data> Deserialize<'de> for RuleBreakData<'data>where
'de: 'data,
Sourceยงfn deserialize<__D>(
__deserializer: __D,
) -> Result<RuleBreakData<'data>, <__D as Deserializer<'de>>::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(
__deserializer: __D,
) -> Result<RuleBreakData<'data>, <__D as Deserializer<'de>>::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Sourceยงimpl MaybeAsVarULE for RuleBreakData<'_>
impl MaybeAsVarULE for RuleBreakData<'_>
Sourceยงimpl<'data> PartialEq for RuleBreakData<'data>
impl<'data> PartialEq for RuleBreakData<'data>
Sourceยงimpl<'a> Yokeable<'a> for RuleBreakData<'static>
impl<'a> Yokeable<'a> for RuleBreakData<'static>
Sourceยงtype Output = RuleBreakData<'a>
type Output = RuleBreakData<'a>
This type MUST be
Self
with the 'static
replaced with 'a
, i.e. Self<'a>
Sourceยงfn transform_owned(self) -> <RuleBreakData<'static> as Yokeable<'a>>::Output
fn transform_owned(self) -> <RuleBreakData<'static> as Yokeable<'a>>::Output
Sourceยงunsafe fn make(
this: <RuleBreakData<'static> as Yokeable<'a>>::Output,
) -> RuleBreakData<'static>
unsafe fn make( this: <RuleBreakData<'static> as Yokeable<'a>>::Output, ) -> RuleBreakData<'static>
This method can be used to cast away
Self<'a>
โs lifetime. Read moreSourceยงfn transform_mut<F>(&'a mut self, f: F)
fn transform_mut<F>(&'a mut self, f: F)
This method must cast
self
between &'a mut Self<'static>
and &'a mut Self<'a>
,
and pass it to f
. Read moreSourceยงimpl<'zf, 'zf_inner> ZeroFrom<'zf, RuleBreakData<'zf_inner>> for RuleBreakData<'zf>
impl<'zf, 'zf_inner> ZeroFrom<'zf, RuleBreakData<'zf_inner>> for RuleBreakData<'zf>
Sourceยงfn zero_from(this: &'zf RuleBreakData<'zf_inner>) -> RuleBreakData<'zf>
fn zero_from(this: &'zf RuleBreakData<'zf_inner>) -> RuleBreakData<'zf>
Clone the other
C
into a struct that may retain references into C
.impl<'data> StructuralPartialEq for RuleBreakData<'data>
Auto Trait Implementationsยง
impl<'data> Freeze for RuleBreakData<'data>
impl<'data> RefUnwindSafe for RuleBreakData<'data>
impl<'data> Send for RuleBreakData<'data>
impl<'data> Sync for RuleBreakData<'data>
impl<'data> Unpin for RuleBreakData<'data>
impl<'data> UnwindSafe for RuleBreakData<'data>
Blanket Implementationsยง
Sourceยงimpl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Sourceยงfn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Sourceยงimpl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Sourceยงimpl<T> IntoEither for T
impl<T> IntoEither for T
Sourceยงfn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self
into a Left
variant of Either<Self, Self>
if into_left
is true
.
Converts self
into a Right
variant of Either<Self, Self>
otherwise. Read moreSourceยงfn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self
into a Left
variant of Either<Self, Self>
if into_left(&self)
returns true
.
Converts self
into a Right
variant of Either<Self, Self>
otherwise. Read more