aboutsummaryrefslogtreecommitdiff
path: root/test/Tests/Readers
AgeCommit message (Collapse)AuthorFilesLines
2017-07-21Muse reader: fix reading of lists inside tags (#3802)Alexander Krotov1-0/+28
2017-07-07Rewrote LaTeX reader with proper tokenization.John MacFarlane1-1/+2
This rewrite is primarily motivated by the need to get macros working properly. A side benefit is that the reader is significantly faster (27s -> 19s in one benchmark, and there is a lot of room for further optimization). We now tokenize the input text, then parse the token stream. Macros modify the token stream, so they should now be effective in any context, including math. Thus, we no longer need the clunky macro processing capacities of texmath. A custom state LaTeXState is used instead of ParserState. This, plus the tokenization, will require some rewriting of the exported functions rawLaTeXInline, inlineCommand, rawLaTeXBlock. * Added Text.Pandoc.Readers.LaTeX.Types (new exported module). Exports Macro, Tok, TokType, Line, Column. [API change] * Text.Pandoc.Parsing: adjusted type of `insertIncludedFile` so it can be used with token parser. * Removed old texmath macro stuff from Parsing. Use Macro from Text.Pandoc.Readers.LaTeX.Types instead. * Removed texmath macro material from Markdown reader. * Changed types for Text.Pandoc.Readers.LaTeX's rawLaTeXInline and rawLaTeXBlock. (Both now return a String, and they are polymorphic in state.) * Added orgMacros field to OrgState. [API change] * Removed readerApplyMacros from ReaderOptions. Now we just check the `latex_macros` reader extension. * Allow `\newcommand\foo{blah}` without braces. Fixes #1390. Fixes #2118. Fixes #3236. Fixes #3779. Fixes #934. Fixes #982.
2017-06-28Muse reader: parse indented blockquotes (#3769)Alexander Krotov1-1/+6
2017-06-27HTML reader: Use the lang value of <html> to set the lang meta value. (#3765)bucklereed1-0/+6
* HTML reader: Use the lang value of <html> to set the lang meta value. * Fix for pre-AMP environments.
2017-06-26Muse reader: fix horizontal rule parsing (#3762)Alexander Krotov1-1/+12
Do not parse 3 dashes as horizontal rule and allow whitespace after rule
2017-06-25Muse reader: Require space before and after '=' for code (#3758)Alexander Krotov1-0/+8
2017-06-20Muse reader: check that headers start at the first column (#3749)Alexander Krotov1-0/+17
2017-06-19Muse reader: fix list item continuation parsing (#3747)Alexander Krotov1-0/+13
2017-06-19Add Muse reader (#3620)Alexander Krotov1-0/+264
2017-06-11Switched Writer types to use Text.John MacFarlane3-3/+6
* XML.toEntities: changed type to Text -> Text. * Shared.tabFilter -- fixed so it strips out CRs as before. * Modified writers to take Text. * Updated tests, benchmarks, trypandoc. [API change] Closes #3731.
2017-06-10Changed all readers to take Text instead of String.John MacFarlane8-573/+588
Readers: Renamed StringReader -> TextReader. Updated tests. API change.
2017-05-31Org reader: respect export option for tagsAlbert Krewinkel1-0/+6
Tags are appended to headlines by default, but will be omitted when the `tags` export option is set to nil. Closes: #3713
2017-05-31Org reader: include tags in headlinesAlbert Krewinkel1-17/+19
The Emacs default is to include tags in the headline when exporting. Instead of just empty spans, which contain the tag name as attribute, tags are rendered as small caps and wrapped in those spans. Non-breaking spaces serve as separators for multiple tags.
2017-05-28Org reader: Fix cite parsing behaviourHerwig Stuetz1-0/+36
Until now, org-ref cite keys included special characters also at the end. This caused problems when citations occur right before colons or at the end of a sentence. With this change, all non alphanumeric characters at the end of a cite key are ignored. This also adds `,` to the list of special characters that are legal in cite keys to better mirror the behaviour of org-export.
2017-05-27Org reader: subject full doc tree to headline transformationsAlbert Krewinkel1-2/+16
Emacs parses org documents into a tree structure, which is then post-processed during exporting. The reader is changed to do the same, turning the document into a single tree of headlines starting at levelĀ 0. Fixes: #3695
2017-05-18Org reader: fix smart parsing behaviorAlbert Krewinkel1-2/+2
Parsing of smart quotes and special characters can either be enabled via the `smart` language extension or the `'` and `-` export options. Smart parsing is active if either the extension or export option is enabled. Only smart parsing of special characters (like ellipses and en and em dashes) is enabled by default, while smart quotes are disabled. This means that all smart parsing features will be enabled by adding the `smart` language extension. Fine-grained control is possible by leaving the language extension disabled. In that case, smart parsing is controlled via the aforementioned export OPTIONS only. Previously, all smart parsing was disabled unless the language extension was enabled.
2017-05-12Replace `repeat' and `take' with `replicate'Alexander Krotov1-1/+1
2017-05-06Org reader: support macrosAlbert Krewinkel1-0/+18
Closes: #3401
2017-04-23Org reader: allow multi-word arguments to src block paramsAlbert Krewinkel1-0/+9
The reader now correctly parses src block parameter list even if parameter arguments contain multiple words. Closes: #3477
2017-04-23Org reader: stop adding rundoc prefix to src paramsAlbert Krewinkel1-33/+26
Source block parameter names are no longer prefixed with *rundoc*. This was intended to simplify working with the rundoc project, a babel runner. However, the rundoc project is unmaintained, and adding those markers is not the reader's job anyway. The original language that is specified for a source element is now retained as the `data-org-language` attribute and only added if it differs from the translated language.
2017-04-23Org reader: handle line numbering switch for src blocksAlbert Krewinkel1-0/+9
The line-numbering switch that can be given to source blocks (`-n` with an start number as an optional parameter) is parsed and translated to a class/key-value combination used by highlighting and other readers and writers.
2017-04-16Org reader: allow emphasized text to be followed by `[`Albert Krewinkel1-0/+10
Closes: #3577
2017-04-16Org reader: convert markup at beginning of footnotesAlbert Krewinkel1-0/+10
Closes: #3576
2017-03-14Got rid of distracting warning in test output.John MacFarlane1-2/+2
2017-03-14Use tasty for tests rather than test-framework.John MacFarlane9-47/+47
2017-03-07Small change to unbalanced bracket test to speed up test suite.John MacFarlane1-1/+1
2017-03-04Stylish-haskell automatic formatting changes.John MacFarlane9-38/+32
2017-02-11Use new warnings throughout the code base.John MacFarlane1-1/+1
2017-02-04Moved tests/ -> test/.John MacFarlane9-0/+3602