Visidata

- [packaging]
- make non Python standard library loader dependencies optional
- provide method for full installation via `pip3 install "visidata[full]"`
- [visidata.org](http://visidata.org) change copyright in footer
- [docs] add csv dialects to manpage (closes issue 88)
- [bugfix]
- fix for `^Z` in builtin line editor
- fixed-width loader needs source kwarg

- [visidata.org](http://visidata.org) revamp

- [canvas] graphs and maps!
- `.` or `g.` to push a graph or a map from the current sheet (dot=plot)
- supports .shp and vector .mbtiles
- mouse left-click/drag to set cursor
- mouse right-click/drag to scroll canvas
- scrollwheel to zoom in/out on a canvas
- `s`/`u` to select/unselect rows at canvas cursor
- `ENTER` to push source sheet with only rows at canvas cursor
- 1-9 to toggle display of 'layers' (colors)
- `_` to zoom out to full width
- `disp_pixel_random` option chooses pixel attrs at random (weighted), instead of most common
- `+`/`-` to zoom in/out via keyboard

- Updates to commands
- Remove ` (backtick) command
- Remove most zscroll commands (`zs`/`ze`)
- `zz` moves cursor to center, uncertain about the future of `zt` due to conflict with `t` for toggle
- `ga` adds N new rows
- `gz=` sets value for selected/all rows to a Python sequence in this column
- `z_` sets column width to given value
- `z-` cuts column width in half
- `P` is now "paste before" (like vim); `R` now pushes a random sample
- `^Z` now sends SIGSTOP; `^O` "opens" the external $EDITOR (from builtin line editor)
- [ColumnsSheet] Added `~!$` commands back, to set type of source columns
- `w` is becoming a more universal "visibility toggle"
- [TextSheet] `w` toggles wordwrap
- [canvas] `w` toggles display of the labels
- [pyobj] `w` toggles hidden properties and methods

- Updates to command line args and options
- set initial row/col with `+<row>:<col>` (numeric only)
- `--delimiter`/`-d ` option (separate from `--csv-delimiter`) sets delimiter for tsv filetype
- `--replay-wait`/`-w` renamed from `--delay`/`-d`
- `disp_date_fmt` option for date display format string (default is date-only)
- `zero_is_null`/`empty_is_null`/`none_is_null`/`false_is_null` set which values are considered null (previously was `aggr_null_filter`)
- `--skiplines` option renamed to `--skip`, and `--headerlines` to `--header`

- Design improvements
- Add specific rowtype for each sheet (see right status)
- dates are a kind of numeric type (useful for graphing as the x-axis)
- `use_default_colors` (at behest of wavexx)
- more robust Progress indicator
- populate DescribeSheet in async thread
- remove default names for unnamed columns
- history up/down in edit widget now feels right

- API changes
- change main Column API to getter(col, row) and setter(col, row, val)
- move Path and subclasses out of vdtui
- TextSheet source is any iterable of strings
- Sheet.filetype provides default save filename extension

- Fix postgres lazy import
- BugFix: issue 83 - `z?` works on OSX
- BugFix: <Enter> on SheetsSheets itself now does nothing
- Move from readthedocs to visidata.org

- Features
- [replay]
- move vdplay into vd --play
- -p --play now replays scripts live
- --delay interspaces replay by delay seconds
- --batch to replay without interface
- --output to save at end of replay
- --replay-movement=True has --play move the cursor cell-by-cell
- -y --confirm-overwrite=False
- replay scripts can be strformatted with field=value
- add ^U command to pause/resume playback
- add ^K to cancel replay
- add Space command to go to next step of replay while paused
- [global]
- remap toggle to 't' (was Space)
- remap ^Y to push sheet of cursorRow
- 'A' creates new sheet with N empty columns
- remap 'r' to regex search of row key
- add zr/zc to go to row/col number
- F1/z? now launches man page
- gF1/gz? now launches commands sheet
- add `f` command to fill empty cells with the content of a non-empty cell up the current column
- add Del/gDel to set value(s) to None
- remove TAB/Shift-TAB sheet cycling
- add z^ command to set current column name to current cell value
- add gz^ to set current column name to cell values in selected rows
- add 'z=' to show computed expression over current row
- z' adds cache to current column (gz' for all columns)
- `gh` moves cursor to leftmost column (instead of leftmost non-key column)
- [aggregators]
- allow multiple aggregators
- 'g+ adds an aggregator to selected columns on columns sheets
- sets the exact set of aggregators on the column sheet with 'e'/'ge'
- 'z+' displays result of aggregation over selected rows for current column on status
- rework aggregators so multiple aggregators can be set
- [sheets sheet]
- '&' on Sheets sheet is now sole join sheet command; jointype is input directly
- add sheet concat
- [columns sheet]
- remap ~!$%^ on Columns sheet to behave like they do on other sheets
- add g prefix to ~!$%^ to operate on all 'selected rows' on Columns sheet (thus modifying column parameters on source sheet)
- [textsheet]
- add 'w' command on TextSheets to toggle wrap
- [cmdlog]
- editlog renamed to cmdlog
- cmdlog has a new format which minimises recordings of movement commands
- '^D' now saves cmdlog sheet
- [pivot]
- zEnter pushes this cell; Enter pushes whole row
- [describe]
- add DescribeSheet with 'I' command for viewing descriptive statistics
- add zs/zu/zt/zEnter commands to engage with rows on source sheet which are being described in current cell of describe sheet
- [frequency]
- 'zF' provides summary aggregation
- [metasheets]
- add hidden source column to metasheets
- ^P view status history
- [loaders]
- add 'postgres' schema for simple loader from postgres:// url
- add gEnter for .zip file mass open
- add 'fixed' filetype to use fixed column detector
- [clipboard]
- remove `B` clipboard sheet
- rework all d/y/p commands for only one buffer
- remove g^Z and gp
- [options]
- remove -d debug option
- add --diff to add colorizer against base sheet
- diffs a pair of tsvs cell-by-cell
- theme options removed as CLI arguments (still available for .visidatarc or apps)
- `'` appends frozen column
- rename and reorder options
- Community
- [docs]
- replace .rst userguide with VisiData [man page](http://visidata.org/man)
- [visidata.org]
- update index.html
- automate creation of tour pages from tours.vd
- tours will be played and recorded using asciinema
- then compiled into a .html with mkdemo.py for http://visidata.org/tour
- upload html version of manpage
- Internals
- renamed toplevel command() to globalCommand(); removed Sheet.command(); sheet commands now specified in Sheet.commands list of Command() objects at class level
- setter API now (sheet,col,row,value)
- move `visidata/addons/*.py` into toplevel package

- data can be piped through stdin
- remap: `N` is now previous match (instead of `p`)
- `:` now regex split
- add `bin/viewtsv` example tsv viewer as an example of a small vdtui application
- add `options.cmd_after_edit` for automove after edit
- add clipboard functionality
- `y` yanks row at cursor to clipboard; `gy` copies all selected rows
- `d` deletes row and move to clipboard; `gd` moves all selected rows
- `p` now pastes the row most recently added to the clipboard after current row; `gp` pastes all rows from clipboard after current row
- `Shift-B` opens clipboard sheet
- `Ctrl+z` now undoes the most recent delete; `gCtrl+z` undoes all deletes
- Fix cursor row highlighting of identical rows

- move some functionality out of vdtui into separate python files
- add Ctrl+z command to launch external $EDITOR
- add ``options.force_valid_names``