pandoc - Conversion between markup formats

Age	Commit message (Collapse)	Author	Files	Lines
2017-02-11	Use new warnings throughout the code base.	John MacFarlane	1	-32/+21

2017-02-10	Added Text.Pandoc.Logging (exported module).	John MacFarlane	1	-2/+2
	This now contains the Verbosity definition previously in Options, as well as a new LogMessage datatype that will eventually be used instead of raw strings for warnings. This will enable us, among other things, to provide machine-readable warnings if desired. See #3392.
2017-02-09	LaTeX reader: Issue warnings when skipping unknown latex commands.	John MacFarlane	1	-1/+1
	See #3392.
2017-02-09	Reverted deferred media bag code.	John MacFarlane	1	-51/+6
	This was not actually being used. Since it adds considerable complexity, it's best not to include it unless we are actually going to use it. The original thought was that we could do all loading in the readers, always deferred and thus costless. This was supposed to eliminate the need to traverse trees loading resources in the docx, epub, odt writers and in PDF and SelfContained. (It would also have the side effect that --extract-media could be used with all input formats. This wasn't an intended side effect, and it could be debated whether it's desirable, since --extract-media was originally designed to extract the media contained in a docx or odt or epub container.) However, we never actually took the step of moving all of this work to the readers, for a couple of reasons. The main reason is that we'd still need to fetch resources in the docx, epub, odt, pdf and self-contained writers, since the Pandoc AST might have been built programatically and hence not generated by a reader. So it's not clear that doing lazy loading in the readers would have any real advantage. I'm still not completely sure about this --- if we change our minds it would be easy to undo this commit. @jkr comments welcome.
2017-02-07	Refactored some files formerly in LaTeX reader.	John MacFarlane	1	-4/+4
	* Export readFileFromDirs from Class. * Export insertIncludedFile from Parsing. Simplified code in LaTeX/RST readers.
2017-02-07	Moved readFileFromDirs to Text.Pandoc.Class.	John MacFarlane	1	-0/+10
	This can be used in several different modules, not just LaTeX reader.
2017-01-27	Expose FileTree in Class	John MacFarlane	1	-0/+1

2017-01-25	Fixed small mistake in instance for logOutput.	John MacFarlane	1	-1/+1

2017-01-25	More logging-related changes.	John MacFarlane	1	-23/+22
	Class: * Removed getWarnings, withWarningsToStderr * Added report * Added logOutput to PandocMonad * Make logOutput streaming in PandocIO monad * Properly reverse getLog output Readers: * Replaced use of trace with report DEBUG. TWiki Reader: Put everything inside PandocMonad m. API changes.
2017-01-25	Class: Changes around logging.	John MacFarlane	1	-27/+45
	* Export getLog, setVerbosity * Add report to PandocMonad methods. * Redefine warning and getWarnings in terms of getLog and report. * Remove stWarnings from CommonState, add stLog and stVerbosity.
2017-01-25	Class: Warn instead or erroring if we can't fetch media	Jesse Rosenthal	1	-5/+18
	If deferred media can't be fetched, we catch the error and warn instead. We add an internal function for fetching which returns a Maybe value, and then run catMaybes to only keep the Just's.
2017-01-25	Class: Refactor fetchItem.	Jesse Rosenthal	1	-38/+44
	Move the downloading/reading-in logic out of fetchItem, so we can use it to fill the MediaBag. Now when other modules use `fetchItem` it will fill the MediaBag as expected.
2017-01-25	Class: Add insertDeferredMedia function.	Jesse Rosenthal	1	-0/+7

2017-01-25	Integrate DeferredMediaBag into CommonState	Jesse Rosenthal	1	-10/+17
	The DeferredMediaBag is now the object that is held in state. It should not be visible to users, who will still deal with MediaBag through exported getters and setters. We now have a function `fetchDeferredMedia` which returns () but downloads/reads in all of the deferred media. Note that getMediaBag first fetches all deferred media.
2017-01-25	Introduce DeferredMediaBag.	Jesse Rosenthal	1	-0/+24
	This is a lazy MediaBag, that will only be evaluated (downloaded/read in) upon demand. Note that we use fetchItem in getDefferedMedia at the moment to read in/download. This means that we don't need to distinguish between URIs and FilePaths. But there is an inefficiency here: `fetchItem` will pull an item out of the mediaBag if it's already there, and then we'll reinsert it. We could separate out `fetchItem` into the function that checks the MediaBag and the underlying downloader/read-inner.
2017-01-25	Class: have pure instance of openURL throw an error, for now.	John MacFarlane	1	-1/+1
	Later we may want to include a map of URLs and mime type, bytestring pairs in pure state to serve as a fake internet.
2017-01-25	Add openURL and readFileStrict to PandocMonad.	John MacFarlane	1	-38/+98
	Removed fetchItem and fetchItem'. Provide fetchItem in PandocMonad (it uses openURL and readFileStrict). TODO: - PandocPure instance for openURL. - Fix places where fetchItem is used so that we trap the exception instead of checking for a Left value. (At least in the places where we want a warning rather than a failure.)
2017-01-25	Class: Removed getDefaultReferenceDocx/ODT from PandocMonad.	John MacFarlane	1	-22/+2
	We don't need these, since the default docx and odt can be retrieved using `readDataFile datadir "reference.docx"` (or odt).
2017-01-25	Removed commented-out vestigaes of fail in Class.	John MacFarlane	1	-8/+0

2017-01-25	Class: removed 'fail' from PandocMonad.	John MacFarlane	1	-12/+12
	Do we need this? I don't see why. There's a name clash which would better be avoided.
2017-01-25	Removed unneeded pragmas.	John MacFarlane	1	-2/+1

2017-01-25	Instances of PandocMonad for common transformers.	John MacFarlane	1	-2/+79

2017-01-25	Class: no more MonadState CommonState.	John MacFarlane	1	-14/+23
	- Added getCommonState, putCommonState, getsCommonState, modifyCommonState to PandocMonad interface. - Removed MonadState CommonState instances.
2017-01-25	Whitespace.	John MacFarlane	1	-3/+3

2017-01-25	Add PandocMonad m instance for ParserT based on PandocMonad.	John MacFarlane	1	-6/+4
	This will avoid the need for lift.
2017-01-25	Have warningWithPos take a SourcePos rather than Maybe SourcePos.	John MacFarlane	1	-12/+22
	After all, we have warning if you don't want the source pos info.
2017-01-25	Class: Functions for dealing with PureState	Jesse Rosenthal	1	-23/+42
	There are two states in PandocPure, but it is only easy to deal with CommonState. In the past, to do state monad operations on PureState (the state specific to PandocPure) you had to add (lift . lift) to the monadic operation and then rewrap in the newtype. This adds four functions ({get,gets,put,modify}PureState) corresponding to normal state monad operations. This allows the user to modify PureState in PandocPure without worrying about where it sits in the monad stack or rewrapping the newtype.
2017-01-25	Class: rename env* prefixed fields to st*.	Jesse Rosenthal	1	-28/+28
	This was left over from when they were part of an environment.
2017-01-25	Error: change type of handleError.	John MacFarlane	1	-1/+1
	It now lives in IO and gives a proper message + exit instead of calling 'error'. We shouldn't be making it easier for people to raise error on pure code. And this is better for the main application in IO.
2017-01-25	Class: rename addWarning[WithPos] to warning[WithPos].	John MacFarlane	1	-12/+10
	There's already a function addWarning in Parsing! Maybe we can dispense with that now, but I still like 'warning' better as a name.
2017-01-25	Class: Renamed 'warn' to 'addWarning' and consolidated RTF writer.	John MacFarlane	1	-7/+5
	* Renaming Text.Pandoc.Class.warn to addWarning avoids conflict with Text.Pandoc.Shared.warn. * Removed writeRTFWithEmbeddedImages from Text.Pandoc.Writers.RTF. This is no longer needed; we automatically handle embedded images using the PandocM functions. [API change]
2017-01-25	New withWarningsToStderr exported from Text.Pandoc.Class.	John MacFarlane	1	-1/+11
	And use this in pandoc.hs so that messages actually get printed.
2017-01-25	Class: cleanup and clarification.	Jesse Rosenthal	1	-22/+6

2017-01-25	Remove reader from PandocPure.	Jesse Rosenthal	1	-50/+43
	Make it all state. This will make it easier to set things.
2017-01-25	Make Txt2Tags test pass.	Jesse Rosenthal	1	-0/+1
	We don't have a good way to set things that aren't in the common state. That will be the next order of business.
2017-01-25	Have a common state for all PandocMonad instances.	Jesse Rosenthal	1	-81/+63

2017-01-25	Unify Errors.	Jesse Rosenthal	1	-25/+16

2017-01-25	Finish converting readers over.	Jesse Rosenthal	1	-0/+12

2017-01-25	Add input and output filepaths to PandocMonad.	Jesse Rosenthal	1	-12/+48
	We'll want these in a number of places, but right now it will be necessary for the macros in T2T.
2017-01-25	Add Zoned time to class.	Jesse Rosenthal	1	-1/+15

2017-01-25	Class: Add getModificationTime	Jesse Rosenthal	1	-9/+37
	This is to enable macros in T2T, but can be used for other stuff in the future, I imagine. This requires building up the info in our fake file trees. Note the version in IO is safe.
2017-01-25	Working on readers.	Jesse Rosenthal	1	-0/+10

2017-01-25	Class: add setMediaBag function.	Jesse Rosenthal	1	-0/+6

2017-01-25	Add ParseError to PandocExecutionError.	Jesse Rosenthal	1	-1/+3
	This will be unified with Text.Pandoc.Error eventually. But I'm building it out here so as not to interfere with other modules that might be using the error module currently.
2017-01-25	List derived instances vertically one-per-line for readability.	Jesse Rosenthal	1	-2/+14

2017-01-25	Change Test{State,Env} to Pure{State,Env}	Jesse Rosenthal	1	-10/+10
	This was left over from when the pure function was called runTest.
2017-01-25	Class: Add MediaBag to MonadState.	Jesse Rosenthal	1	-6/+18

2017-01-25	Class: Add stateful IO warnings, and function to get warndings.	Jesse Rosenthal	1	-3/+9
	Right now, the io warnings both print to stderr and write to the state. That can be easily modified. We also add a getWarnings function which pulls warnings out of the state for instances of PandocMonad.
2017-01-25	Deleted whitespace at end of source lines.	John MacFarlane	1	-1/+1

2017-01-25	Implement Errors in PandocMonad	Jesse Rosenthal	1	-7/+11
	Errors can be thrown purely with `throwError`. At the moment there are only three kinds of errors: 1. PandocFileReadError FilePath (for problems reading a file from the filesystem) 2. PandocShouldNeverHappenError String (for stuff that should never happen but we need to pattern-match anyway) 3. PandocSomeError String (a grab bag of everything else) Of course, we need to subdivide the third item in this list.