Struct RuleBreakData

pub struct RuleBreakData<'data> {
    pub property_table: CodePointTrie<'data, u8>,
    pub break_state_table: ZeroVec<'data, BreakState>,
    pub word_type_table: ZeroVec<'data, WordType>,
    pub property_count: u8,
    pub last_codepoint_property: u8,
    pub sot_property: u8,
    pub eot_property: u8,
    pub complex_property: u8,
}

Pre-processed Unicode data in the form of tables to be used for rule-based breaking.

🚧 This code is considered unstable; it may change at any time, in breaking or non-breaking ways, including in SemVer minor releases. While the serde representation of data structs is guaranteed to be stable, their Rust representation might not be. Use with caution.

Fields

property_table: CodePointTrie<'data, u8>

Property table.

break_state_table: ZeroVec<'data, BreakState>

Break state table.

word_type_table: ZeroVec<'data, WordType>

Word type table. Only used for word segmenter.

property_count: u8

Number of properties; should be the square root of the length of Self::break_state_table.

last_codepoint_property: u8

The index of the last simple state for Self::break_state_table. (A simple state has no left nor right in SegmenterProperty).

sot_property: u8

The index of SOT (start of text) state for Self::break_state_table.

eot_property: u8

The index of EOT (end of text) state Self::break_state_table.

complex_property: u8

The index of “SA” state (or 127 if the complex language isn’t handled) for Self::break_state_table.

Trait Implementations

impl<'data> Clone for RuleBreakData<'data>

fn clone(&self) -> RuleBreakData<'data>

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'data> Debug for RuleBreakData<'data>

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl<'de, 'data> Deserialize<'de> for RuleBreakData<'data>

where 'de: 'data,

fn deserialize<__D>( __deserializer: __D, ) -> Result<RuleBreakData<'data>, <__D as Deserializer<'de>>::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl MaybeAsVarULE for RuleBreakData<'_>

type EncodedStruct = [()]

The VarULE type for this data struct, or [()] if it cannot be represented as VarULE.

impl<'data> PartialEq for RuleBreakData<'data>

fn eq(&self, other: &RuleBreakData<'data>) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl<'a> Yokeable<'a> for RuleBreakData<'static>

type Output = RuleBreakData<'a>

This type MUST be Self with the 'static replaced with 'a, i.e. Self<'a>

fn transform(&'a self) -> &'a <RuleBreakData<'static> as Yokeable<'a>>::Output

This method must cast self between &'a Self<'static> and &'a Self<'a>.

fn transform_owned(self) -> <RuleBreakData<'static> as Yokeable<'a>>::Output

This method must cast self between Self<'static> and Self<'a>.

unsafe fn make( this: <RuleBreakData<'static> as Yokeable<'a>>::Output, ) -> RuleBreakData<'static>

This method can be used to cast away Self<'a>’s lifetime.

fn transform_mut<F>(&'a mut self, f: F)

where F: 'static + for<'b> FnOnce(&'b mut <RuleBreakData<'static> as Yokeable<'a>>::Output),

This method must cast self between &'a mut Self<'static> and &'a mut Self<'a>, and pass it to f.

impl<'zf, 'zf_inner> ZeroFrom<'zf, RuleBreakData<'zf_inner>> for RuleBreakData<'zf>

fn zero_from(this: &'zf RuleBreakData<'zf_inner>) -> RuleBreakData<'zf>

Clone the other C into a struct that may retain references into C.

impl<'data> StructuralPartialEq for RuleBreakData<'data>