Tokens are simple classes that return a regular expression (pattern to match). You should write a test in test_resolver.rb before defining a token. Remember to register tokens in lists at the bottom of this file.
All tokens.
# File lib/splitter/tokens.rb, line 286 def self.global_token_list [ Taxonifi::Splitter::Tokens::Quadrinomial, Taxonifi::Splitter::Tokens::LeftParen, Taxonifi::Splitter::Tokens::Year, Taxonifi::Splitter::Tokens::Comma, Taxonifi::Splitter::Tokens::RightParen, Taxonifi::Splitter::Tokens::AuthorYear, Taxonifi::Splitter::Tokens::Authors, Taxonifi::Splitter::Tokens::VolumeNumber, Taxonifi::Splitter::Tokens::Pages, ] end
Tokens used in breaking down page ranges.
# File lib/splitter/tokens.rb, line 308 def self.pages [ Taxonifi::Splitter::Tokens::Pages ] end
Tokens used in breaking down species names.
# File lib/splitter/tokens.rb, line 315 def self.species_name [ Taxonifi::Splitter::Tokens::Quadrinomial, Taxonifi::Splitter::Tokens::AuthorYear, ] end
Tokens used in breaking down volume/number ranges.
# File lib/splitter/tokens.rb, line 301 def self.volume_number [ Taxonifi::Splitter::Tokens::VolumeNumber ] end