Labyricorn/liquid
1
0
Fork 0
mirror of https://github.com/Shopify/liquid.git synced 2026-10-04 01:25:14 -07:00
Code Issues Packages Projects Releases Wiki Activity

Descriptive comment for lexer

Browse Source
This commit is contained in:
Tristan Hume
2013-07-24 12:00:51 -04:00
parent ee14775f83
commit 61a6deb43b
1 changed files with 1 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
lib/liquid/parser.rb
+1
View File
@@ -8,6 +8,7 @@ module Liquid
end end
def tokenize(input) def tokenize(input)
# "foo.bar | filter: baz, qux" becomes ["foo", ".", "bar", "|", "filter", ":", "baz", ",", "qux"]
input.split(/\b/).map {|tok| tok.strip} input.split(/\b/).map {|tok| tok.strip}
end end
end end