Twarc-csv

This version significantly changes the output CSV format and defaults.

It is recommended to re-run the export as the columns have changed.

Previously, the default was to output original retweets as is, and insert referenced tweets inline. With this version, referenced tweets are not inserted (so by default you will only see the tweets from `data` not any referenced replies or quotes) and retweets are now returned in "merged" form, where the tweet text is replaced with the non-truncated original with matching entities etc.

This version also requires a newer version of twarc. Update everything with:


pip install --upgrade twarc twarc-csv

Fix parsing non tweet objects from the stream, adding this to report output.

Fix ability to use pipes. The check for empty files would throw an error if using `STDIN`

* Don't include rows for referenced tweets that are missing.
* Change output report slightly.
* Add missing withheld fields

* Fix duplicate columns output when specifying custom list of output columns.
* Add __twarc metadata to all tweets
* Fix column reordering

Add missing `author.withheld` columns