Sqlfluff

Highlights

This release brings several internal changes, and acts as a prelude to 2.0.0 which
will be released fairly soon. In particular, the following config values have changed:
- `sqlfluff:rules:L007:operator_new_lines` has been changed to
`sqlfluff:layout:type:binary_operator:line_position`.
- `sqlfluff:rules:comma_style` and `sqlfluff:rules:L019:comma_style` have both been
consolidated into `sqlfluff:layout:type:comma:line_position`.

If any of these values have been set in your config, they will be automatically
translated to the new values at runtime, and a warning will be shown. To silence
the warning, update your config file to the new values. For more details on
configuring layout (including some changes yet to come in future versions)
see [the docs](https://docs.sqlfluff.com/en/latest/layout.html#configuring-layout).

These changes are driven by underlying centralisation in the routines which control
layout. While for this release, no breaking changes are expected - you may find
slight differences in how SQLFluff handles edge cases. We believe in the majority
of cases these are _more_ consistent, but if you find any which are problematic
then do post an issue on GitHub as usual.

Other highlights from this release:
- Better dbt supportfor graph nodes and avoiding dependency conflicts.
- Numerous dialect improvements to T-SQL, MySQL, SparkSQL, SQLite, Athena
Snowflake, Hive, Postgres & Databricks.

There have also been first time contributions from **10 new contributors**! 🎉🎉🎉


What’s Changed

* Snowflake partition nonreserved keyword [3972](https://github.com/sqlfluff/sqlfluff/pull/3972) [YilangHe](https://github.com/YilangHe)
* Hive: Add support for EXCHANGE PARTITION in ALTER TABLE [3991](https://github.com/sqlfluff/sqlfluff/pull/3991) [nahuelverdugo](https://github.com/nahuelverdugo)
* Resolve parse error on multiple bracketed statements [3994](https://github.com/sqlfluff/sqlfluff/pull/3994) [yoichi](https://github.com/yoichi)
* Enable parsing of CLONE keyword in bigquery dialect [3984](https://github.com/sqlfluff/sqlfluff/pull/3984) [realLyans](https://github.com/realLyans)
* BigQuery: allow nesting of SetExpressionSegment [3990](https://github.com/sqlfluff/sqlfluff/pull/3990) [yoichi](https://github.com/yoichi)
* feat(clickhouse): Support non-standard CREATE TABLE statement [3986](https://github.com/sqlfluff/sqlfluff/pull/3986) [tomasfarias](https://github.com/tomasfarias)
* Fix Windows CI check [3992](https://github.com/sqlfluff/sqlfluff/pull/3992) [greg-finley](https://github.com/greg-finley)
* Snowflake tag reference segment [3985](https://github.com/sqlfluff/sqlfluff/pull/3985) [WittierDinosaur](https://github.com/WittierDinosaur)
* Fix Jinja templater issue where undefined callable threw an exception [3982](https://github.com/sqlfluff/sqlfluff/pull/3982) [barrywhart](https://github.com/barrywhart)
* Reflow Documentation V1 [3970](https://github.com/sqlfluff/sqlfluff/pull/3970) [alanmcruickshank](https://github.com/alanmcruickshank)
* Allow lambda argument columns to be unqualified [3971](https://github.com/sqlfluff/sqlfluff/pull/3971) [olagjo](https://github.com/olagjo)
* document inline configuration [3981](https://github.com/sqlfluff/sqlfluff/pull/3981) [alanmcruickshank](https://github.com/alanmcruickshank)
* [BUGFIX] Changing cwd temporarily on manifest load as dbt is not using project_dir to read/write target folder [3979](https://github.com/sqlfluff/sqlfluff/pull/3979) [barrywhart](https://github.com/barrywhart)
* Fix type annotation of user_rules in `Linter` [3977](https://github.com/sqlfluff/sqlfluff/pull/3977) [Samyak2](https://github.com/Samyak2)
* Unpin `markupsafe` [3967](https://github.com/sqlfluff/sqlfluff/pull/3967) [judahrand](https://github.com/judahrand)
* Snowflake frame clause variables [3969](https://github.com/sqlfluff/sqlfluff/pull/3969) [WittierDinosaur](https://github.com/WittierDinosaur)
* SparkSQL: added support for : (colon sign) operator (Databricks SQL) [3956](https://github.com/sqlfluff/sqlfluff/pull/3956) [karabulute](https://github.com/karabulute)
* Athena: Add support for using underscore aliases [3965](https://github.com/sqlfluff/sqlfluff/pull/3965) [hectcastro](https://github.com/hectcastro)
* Snowflake: ALTER TABLE constraint actions [3959](https://github.com/sqlfluff/sqlfluff/pull/3959) [erevear](https://github.com/erevear)
* MySQL: Support REPLACE statement [3964](https://github.com/sqlfluff/sqlfluff/pull/3964) [yoichi](https://github.com/yoichi)
* TSQL: Add support for UPDATE STATISTICS option FULLSCAN [3950](https://github.com/sqlfluff/sqlfluff/pull/3950) [hectcastro](https://github.com/hectcastro)
* ANSI: fixed typos in docstrings and comments [3953](https://github.com/sqlfluff/sqlfluff/pull/3953) [karabulute](https://github.com/karabulute)
* Postgres: ALTER PROCEDURE [3949](https://github.com/sqlfluff/sqlfluff/pull/3949) [krokofant](https://github.com/krokofant)
* T-SQL: Allow arbitrary expressions in PARTITION BY clause [3939](https://github.com/sqlfluff/sqlfluff/pull/3939) [borchero](https://github.com/borchero)
* Enable dumping of performance information to csv. [3937](https://github.com/sqlfluff/sqlfluff/pull/3937) [alanmcruickshank](https://github.com/alanmcruickshank)
* Consolidate comma style configs [3945](https://github.com/sqlfluff/sqlfluff/pull/3945) [alanmcruickshank](https://github.com/alanmcruickshank)
* Adding missing KeywordSegments for different file types in Athena dialect [3898](https://github.com/sqlfluff/sqlfluff/pull/3898) [CommonCrisis](https://github.com/CommonCrisis)
* Add templated block uuids [3936](https://github.com/sqlfluff/sqlfluff/pull/3936) [alanmcruickshank](https://github.com/alanmcruickshank)
* Load the full dbt manifest [3926](https://github.com/sqlfluff/sqlfluff/pull/3926) [davajm](https://github.com/davajm)
* MySQL: Support optional "IF NOT EXISTS" with CREATE TRIGGER [3943](https://github.com/sqlfluff/sqlfluff/pull/3943) [yoichi](https://github.com/yoichi)
* T-SQL: Allow to parse SYNONYM statements [3941](https://github.com/sqlfluff/sqlfluff/pull/3941) [borchero](https://github.com/borchero)
* Hive: Add support for LATERAL VIEW clause [3935](https://github.com/sqlfluff/sqlfluff/pull/3935) [hectcastro](https://github.com/hectcastro)
* Fix crash in L042 on "UNION" or other "set" queries [3931](https://github.com/sqlfluff/sqlfluff/pull/3931) [barrywhart](https://github.com/barrywhart)
* Refactor Lexer: Split apart elements_to_segments and refine placement of meta segments. [3925](https://github.com/sqlfluff/sqlfluff/pull/3925) [alanmcruickshank](https://github.com/alanmcruickshank)
* Add INSERT INTO <> DEFAULT VALUES to ANSI SQL and T-SQL [3934](https://github.com/sqlfluff/sqlfluff/pull/3934) [borchero](https://github.com/borchero)
* Break apart reflow classes and extract methods [3919](https://github.com/sqlfluff/sqlfluff/pull/3919) [alanmcruickshank](https://github.com/alanmcruickshank)
* T-SQL: Fix indendentation of OUTER APPLY [3932](https://github.com/sqlfluff/sqlfluff/pull/3932) [borchero](https://github.com/borchero)
* MySQL: Fix create trigger [3928](https://github.com/sqlfluff/sqlfluff/pull/3928) [adam-tokarski](https://github.com/adam-tokarski)
* SparkSQL: Fixed bug with `QUALIFY` usage without `WHERE` clause (applies also for Databricks dialect) [3930](https://github.com/sqlfluff/sqlfluff/pull/3930) [karabulute](https://github.com/karabulute)
* T-SQL: Allow specifying join hints [3921](https://github.com/sqlfluff/sqlfluff/pull/3921) [borchero](https://github.com/borchero)
* SQLite: Add support for table-level CHECK constraint [3923](https://github.com/sqlfluff/sqlfluff/pull/3923) [hectcastro](https://github.com/hectcastro)
* sparksql: added * EXCEPT for SELECT clause [3922](https://github.com/sqlfluff/sqlfluff/pull/3922) [adam-tokarski](https://github.com/adam-tokarski)
* Map old configs to new configs [3915](https://github.com/sqlfluff/sqlfluff/pull/3915) [alanmcruickshank](https://github.com/alanmcruickshank)
* [issue_3794] allow to use 'usage' as identifier for postgres [3914](https://github.com/sqlfluff/sqlfluff/pull/3914) [adam-tokarski](https://github.com/adam-tokarski)
* `DATABRICKS`: Add Support for Delta Live Tables (DLT) Syntax [3899](https://github.com/sqlfluff/sqlfluff/pull/3899) [R7L208](https://github.com/R7L208)
* Postgres Revoke fix [3912](https://github.com/sqlfluff/sqlfluff/pull/3912) [greg-finley](https://github.com/greg-finley)
* fix: Click output to stderr on errors [3902](https://github.com/sqlfluff/sqlfluff/pull/3902) [KingMichaelPark](https://github.com/KingMichaelPark)
* fix issue with empty enum for postgres [3910](https://github.com/sqlfluff/sqlfluff/pull/3910) [adam-tokarski](https://github.com/adam-tokarski)
* feat: Optional numerics for postgres arrays [3903](https://github.com/sqlfluff/sqlfluff/pull/3903) [KingMichaelPark](https://github.com/KingMichaelPark)
* fix(test): Return ParseExample namedtuple in get_parse_fixtures [3911](https://github.com/sqlfluff/sqlfluff/pull/3911) [tomasfarias](https://github.com/tomasfarias)
* Fix typos [3901](https://github.com/sqlfluff/sqlfluff/pull/3901) [kianmeng](https://github.com/kianmeng)
* provide custom DeprecatedOption [3904](https://github.com/sqlfluff/sqlfluff/pull/3904) [adam-tokarski](https://github.com/adam-tokarski)
* fix(redshift): Allow keywords in qualified references [3905](https://github.com/sqlfluff/sqlfluff/pull/3905) [tomasfarias](https://github.com/tomasfarias)
* Reflow centralisation 2: Rebreak (operators & commas) [3847](https://github.com/sqlfluff/sqlfluff/pull/3847) [alanmcruickshank](https://github.com/alanmcruickshank)
* Bring L008 into reflow work [3908](https://github.com/sqlfluff/sqlfluff/pull/3908) [alanmcruickshank](https://github.com/alanmcruickshank)
* Snowflake: Create network policy ip lists [3888](https://github.com/sqlfluff/sqlfluff/pull/3888) [greg-finley](https://github.com/greg-finley)
* MySQL: Implement (key_part, ...) in index definitions [3887](https://github.com/sqlfluff/sqlfluff/pull/3887) [yoichi](https://github.com/yoichi)
* Reflow centralisation 1: Scope + Respace [3824](https://github.com/sqlfluff/sqlfluff/pull/3824) [alanmcruickshank](https://github.com/alanmcruickshank)
* Update github badge and add docker badge [3884](https://github.com/sqlfluff/sqlfluff/pull/3884) [alanmcruickshank](https://github.com/alanmcruickshank)


New Contributors
* [kianmeng](https://github.com/kianmeng) made their first contribution in [#3901](https://github.com/sqlfluff/sqlfluff/pull/3901)
* [KingMichaelPark](https://github.com/KingMichaelPark) made their first contribution in [#3903](https://github.com/sqlfluff/sqlfluff/pull/3903)
* [hectcastro](https://github.com/hectcastro) made their first contribution in [#3923](https://github.com/sqlfluff/sqlfluff/pull/3923)
* [karabulute](https://github.com/karabulute) made their first contribution in [#3930](https://github.com/sqlfluff/sqlfluff/pull/3930)
* [davajm](https://github.com/davajm) made their first contribution in [#3926](https://github.com/sqlfluff/sqlfluff/pull/3926)
* [CommonCrisis](https://github.com/CommonCrisis) made their first contribution in [#3898](https://github.com/sqlfluff/sqlfluff/pull/3898)
* [krokofant](https://github.com/krokofant) made their first contribution in [#3949](https://github.com/sqlfluff/sqlfluff/pull/3949)
* [Samyak2](https://github.com/Samyak2) made their first contribution in [#3977](https://github.com/sqlfluff/sqlfluff/pull/3977)
* [realLyans](https://github.com/realLyans) made their first contribution in [#3984](https://github.com/sqlfluff/sqlfluff/pull/3984)
* [nahuelverdugo](https://github.com/nahuelverdugo) made their first contribution in [#3991](https://github.com/sqlfluff/sqlfluff/pull/3991)
* [YilangHe](https://github.com/YilangHe) made their first contribution in [#3972](https://github.com/sqlfluff/sqlfluff/pull/3972)

Highlights

This is primarily a release for dialect fixes and improvements with additions
and changes to TSQL, Snowflake, MySQL & Redshift. The other changes of note are:
1. Support for warnings when users set old removed config values. This supports
future change work by allowing a mechanism to warn if they are used.
2. Improvements to the fix routines for L014 and L042 to handle some trickier
cases.

What’s Changed

* Add CreateUserSegment for Snowflake dialect [3880](https://github.com/sqlfluff/sqlfluff/pull/3880) [Gal40n04ek](https://github.com/Gal40n04ek)
* raw_segments_with_ancestors [3878](https://github.com/sqlfluff/sqlfluff/pull/3878) [alanmcruickshank](https://github.com/alanmcruickshank)
* Adjust TSQL Operators [3877](https://github.com/sqlfluff/sqlfluff/pull/3877) [alanmcruickshank](https://github.com/alanmcruickshank)
* Refactor path_to [3875](https://github.com/sqlfluff/sqlfluff/pull/3875) [alanmcruickshank](https://github.com/alanmcruickshank)
* Support Removed warning on configs [3874](https://github.com/sqlfluff/sqlfluff/pull/3874) [alanmcruickshank](https://github.com/alanmcruickshank)
* MySQL: Support column-path operator for JSON type [3864](https://github.com/sqlfluff/sqlfluff/pull/3864) [yoichi](https://github.com/yoichi)
* T-SQL: ALTER FUNCTION/PROCEDURE/VIEW parsing [3867](https://github.com/sqlfluff/sqlfluff/pull/3867) [differgroup](https://github.com/differgroup)
* MySQL: Support hexadecimal literals and bit value literals [3869](https://github.com/sqlfluff/sqlfluff/pull/3869) [yoichi](https://github.com/yoichi)
* MySQL: Treat double quotes the same as single quotes [3871](https://github.com/sqlfluff/sqlfluff/pull/3871) [yoichi](https://github.com/yoichi)
* Snowflake: COMMIT WORK [3862](https://github.com/sqlfluff/sqlfluff/pull/3862) [rglbr](https://github.com/rglbr)
* Snowflake: AlterShareStatementSegment and CreateDatabaseFromShareStatementSegment [3858](https://github.com/sqlfluff/sqlfluff/pull/3858) [moreaupascal56](https://github.com/moreaupascal56)
* MySQL: Add CREATE/ALTER VIEW [3859](https://github.com/sqlfluff/sqlfluff/pull/3859) [wfelipew](https://github.com/wfelipew)
* Redshift: CREATE TABLE LIKE enhancements [3853](https://github.com/sqlfluff/sqlfluff/pull/3853) [greg-finley](https://github.com/greg-finley)
* L014 leading underscore capitalization inference fix [3841](https://github.com/sqlfluff/sqlfluff/pull/3841) [j-svensmark](https://github.com/j-svensmark)
* MySQL: Add extended DROP TRIGGER functionality [3846](https://github.com/sqlfluff/sqlfluff/pull/3846) [yoichi](https://github.com/yoichi)
* Allow standalone aliases in L027 [3848](https://github.com/sqlfluff/sqlfluff/pull/3848) [olagjo](https://github.com/olagjo)
* L042: Enable autofix for some tricky cases [3700](https://github.com/sqlfluff/sqlfluff/pull/3700) [barrywhart](https://github.com/barrywhart)
* Snowflake: CREATE FUNCTION IF NOT EXISTS [3845](https://github.com/sqlfluff/sqlfluff/pull/3845) [greg-finley](https://github.com/greg-finley)
* ignore functions with more than one element ... [3792](https://github.com/sqlfluff/sqlfluff/pull/3792) [fmms](https://github.com/fmms)
* MySQL: support remaining constraint parts of CREATE/ALTER TABLE [3827](https://github.com/sqlfluff/sqlfluff/pull/3827) [yoichi](https://github.com/yoichi)

New Contributors

* [olagjo](https://github.com/olagjo) made their first contribution in [#3848](https://github.com/sqlfluff/sqlfluff/pull/3848)
* [j-svensmark](https://github.com/j-svensmark) made their first contribution in [#3841](https://github.com/sqlfluff/sqlfluff/pull/3841)
* [wfelipew](https://github.com/wfelipew) made their first contribution in [#3859](https://github.com/sqlfluff/sqlfluff/pull/3859)
* [moreaupascal56](https://github.com/moreaupascal56) made their first contribution in [#3858](https://github.com/sqlfluff/sqlfluff/pull/3858)
* [rglbr](https://github.com/rglbr) made their first contribution in [#3862](https://github.com/sqlfluff/sqlfluff/pull/3862)
* [differgroup](https://github.com/differgroup) made their first contribution in [#3867](https://github.com/sqlfluff/sqlfluff/pull/3867)

Highlights

* More refactoring of parse structures in preparation for upcoming refactor of
formatting/whitespace rules.
* Fixes some bugs in L003 (indentation).
* New config flag `large_file_skip_byte_limit` which applies **prior to**
loading the file.

What’s Changed

* Snowflake: Fix syntax errors in tests [3834](https://github.com/sqlfluff/sqlfluff/pull/3834) [JamesRTaylor](https://github.com/JamesRTaylor)
* Add support for additional magic methods on DummyUndefined [3835](https://github.com/sqlfluff/sqlfluff/pull/3835) [barrywhart](https://github.com/barrywhart)
* MySQL: support variable assignments by assignment operator := [3829](https://github.com/sqlfluff/sqlfluff/pull/3829) [yoichi](https://github.com/yoichi)
* MYSQL: improve lexing for single-quoted strings [3831](https://github.com/sqlfluff/sqlfluff/pull/3831) [mdahlman](https://github.com/mdahlman)
* MySQL: More support for index definition in CREATE TABLE [3826](https://github.com/sqlfluff/sqlfluff/pull/3826) [yoichi](https://github.com/yoichi)
* Typed matching and ripping out the rest of .name [3819](https://github.com/sqlfluff/sqlfluff/pull/3819) [alanmcruickshank](https://github.com/alanmcruickshank)
* sparksql dialect to support lambda expressions (->) [3821](https://github.com/sqlfluff/sqlfluff/pull/3821) [juhoautio](https://github.com/juhoautio)
* Fixed broken main branch [3825](https://github.com/sqlfluff/sqlfluff/pull/3825) [alanmcruickshank](https://github.com/alanmcruickshank)
* Enable file name logging for multi-files w/ --show-lint-violations flag [3788](https://github.com/sqlfluff/sqlfluff/pull/3788) [thechopkins](https://github.com/thechopkins)
* Take database and schema out of Snowflake reserved keywords list [3818](https://github.com/sqlfluff/sqlfluff/pull/3818) [NiallRees](https://github.com/NiallRees)
* Remove a chunk of name references [3814](https://github.com/sqlfluff/sqlfluff/pull/3814) [alanmcruickshank](https://github.com/alanmcruickshank)
* Fix typo in Snowflake dialect [3813](https://github.com/sqlfluff/sqlfluff/pull/3813) [Gal40n04ek](https://github.com/Gal40n04ek)
* Allow the use of libraries in macro definitions [3803](https://github.com/sqlfluff/sqlfluff/pull/3803) [bjgbeelen](https://github.com/bjgbeelen)
* Indentation fixes and rule logging improvements [3808](https://github.com/sqlfluff/sqlfluff/pull/3808) [alanmcruickshank](https://github.com/alanmcruickshank)
* Fixes a recursion error in JinjaTemplater handling of undefined values [3809](https://github.com/sqlfluff/sqlfluff/pull/3809) [barrywhart](https://github.com/barrywhart)
* Snowflake: extend `GRANT` syntax [3807](https://github.com/sqlfluff/sqlfluff/pull/3807) [Gal40n04ek](https://github.com/Gal40n04ek)
* add warehouse_type in snowflake dialect [3805](https://github.com/sqlfluff/sqlfluff/pull/3805) [Gal40n04ek](https://github.com/Gal40n04ek)
* add Create Notification Integration syntax [3801](https://github.com/sqlfluff/sqlfluff/pull/3801) [Gal40n04ek](https://github.com/Gal40n04ek)
* T-SQL: fix parsing PARTITION BY NULL in window function [3790](https://github.com/sqlfluff/sqlfluff/pull/3790) [fmms](https://github.com/fmms)
* SparkSQL: Update L014 rule to not flag Delta Change Data Feed Session & Table Property [3689](https://github.com/sqlfluff/sqlfluff/pull/3689) [R7L208](https://github.com/R7L208)
* Snowflake: OVER (ORDER BY) clause required for first_value (fixes 3797) [3798](https://github.com/sqlfluff/sqlfluff/pull/3798) [JamesRTaylor](https://github.com/JamesRTaylor)
* add Alter Pipe syntax for snowflake dialect [3796](https://github.com/sqlfluff/sqlfluff/pull/3796) [Gal40n04ek](https://github.com/Gal40n04ek)
* BigQuery: Parse WEEK(<WEEKDAY>) in date_part [3787](https://github.com/sqlfluff/sqlfluff/pull/3787) [yoichi](https://github.com/yoichi)
* Postgres: Support setting user properties using intrinsic ON & OFF values [3793](https://github.com/sqlfluff/sqlfluff/pull/3793) [chris-codaio](https://github.com/chris-codaio)
* extend SF dialect for File Format statements [3774](https://github.com/sqlfluff/sqlfluff/pull/3774) [Gal40n04ek](https://github.com/Gal40n04ek)
* Add QUALIFY to SparkSQL dialect [3778](https://github.com/sqlfluff/sqlfluff/pull/3778) [ThijsKoot](https://github.com/ThijsKoot)
* fix regex for S3Path [3782](https://github.com/sqlfluff/sqlfluff/pull/3782) [Gal40n04ek](https://github.com/Gal40n04ek)
* Snowflake: add Optional parameter ERROR INTEGRATION for PIPE [3785](https://github.com/sqlfluff/sqlfluff/pull/3785) [Gal40n04ek](https://github.com/Gal40n04ek)
* Add a file size check in bytes [3770](https://github.com/sqlfluff/sqlfluff/pull/3770) [alanmcruickshank](https://github.com/alanmcruickshank)
* Require importlib_metadata >=1.0.0 [3769](https://github.com/sqlfluff/sqlfluff/pull/3769) [alanmcruickshank](https://github.com/alanmcruickshank)

New Contributors

* [Gal40n04ek](https://github.com/Gal40n04ek) made their first contribution in [#3785](https://github.com/sqlfluff/sqlfluff/pull/3785)
* [ThijsKoot](https://github.com/ThijsKoot) made their first contribution in [#3778](https://github.com/sqlfluff/sqlfluff/pull/3778)
* [chris-codaio](https://github.com/chris-codaio) made their first contribution in [#3793](https://github.com/sqlfluff/sqlfluff/pull/3793)
* [JamesRTaylor](https://github.com/JamesRTaylor) made their first contribution in [#3798](https://github.com/sqlfluff/sqlfluff/pull/3798)
* [fmms](https://github.com/fmms) made their first contribution in [#3790](https://github.com/sqlfluff/sqlfluff/pull/3790)
* [bjgbeelen](https://github.com/bjgbeelen) made their first contribution in [#3803](https://github.com/sqlfluff/sqlfluff/pull/3803)
* [thechopkins](https://github.com/thechopkins) made their first contribution in [#3788](https://github.com/sqlfluff/sqlfluff/pull/3788)

Highlights

This release brings several potentially breaking changes to the underlying parse tree. For
users of the cli tool in a linting context you should notice no change. If however
your application relies on the structure of the SQLFluff parse tree or the naming of certain
elements within the yaml format, then this may not be a drop-in replacement. Specifically:
- The addition of a new `end_of_file` meta segment at the end of the parse structure.
- The addition of a `template_loop` meta segment to signify a jump backward in the source
file within a loop structure (e.g. a jinja for loop).
- Much more specific types on some raw segments, in particular `identifier` and `literal`
type segments will now appear in the parse tree with their more specific type (which
used to be called `name`) e.g. `naked_identifier`, `quoted_identifier`, `numeric_literal` etc...

If using the python api, the _parent_ type (such as `identifier`) will still register if
you call `.is_type("identifier")`, as this function checks all inherited types. However the
eventual type returned by `.get_type()` will now be (in most cases) what used to be accessible
at `.name`. The `name` attribute will be deprecated in a future release.

Other highlights:
* New command-line option `--show-lint-violations` to show details on unfixable errors when
running `sqlfluff fix`.
* Improved consistency of process exit codes.
* Short CLI options for many common options.
* Jinja templater: When `--ignore=templating` is enabled, undefined Jinja variables now take
on "reasonable" default values rather than blank string (`""`). This can streamline initial
rollout of SQLFluff by reducing or eliminating the need to configure templater variables.

There are also a _ton_ of other features and bug fixes in this release, including first-time
contributions from **11 new contributors**! 🎉

What’s Changed

* T-SQL: ALTER TABLE DROP COLUMN [3749](https://github.com/sqlfluff/sqlfluff/pull/3749) [greg-finley](https://github.com/greg-finley)
* Add " pragma: no cover" to work around sporadic, spurious coverage failure [3767](https://github.com/sqlfluff/sqlfluff/pull/3767) [barrywhart](https://github.com/barrywhart)
* Add end_of_file and template_loop markers [3766](https://github.com/sqlfluff/sqlfluff/pull/3766) [alanmcruickshank](https://github.com/alanmcruickshank)
* Provide usage examples for new users [3765](https://github.com/sqlfluff/sqlfluff/pull/3765) [sirlark](https://github.com/sirlark)
* SQLite: deferrable in create table statement [3757](https://github.com/sqlfluff/sqlfluff/pull/3757) [RossOkuno](https://github.com/RossOkuno)
* When ignore=templating and fix_even_unparsable=True, provide defaults for missing vars [3753](https://github.com/sqlfluff/sqlfluff/pull/3753) [barrywhart](https://github.com/barrywhart)
* BigQuery: Support Materialized Views [3759](https://github.com/sqlfluff/sqlfluff/pull/3759) [yoichi](https://github.com/yoichi)
* Enhance L062 to ignore blocked words in comments [3754](https://github.com/sqlfluff/sqlfluff/pull/3754) [tunetheweb](https://github.com/tunetheweb)
* Fix bug where undefined Jinja variable in macro file crashes linter [3751](https://github.com/sqlfluff/sqlfluff/pull/3751) [barrywhart](https://github.com/barrywhart)
* Migrate analysis, functional and testing to utils [3743](https://github.com/sqlfluff/sqlfluff/pull/3743) [alanmcruickshank](https://github.com/alanmcruickshank)
* Build out rule crawling mechanisms [3717](https://github.com/sqlfluff/sqlfluff/pull/3717) [alanmcruickshank](https://github.com/alanmcruickshank)
* Add current_timestamp to Redshift as a bare function [3741](https://github.com/sqlfluff/sqlfluff/pull/3741) [RossOkuno](https://github.com/RossOkuno)
* BigQuery: Fix parsing parameterized data types [3735](https://github.com/sqlfluff/sqlfluff/pull/3735) [yoichi](https://github.com/yoichi)
* Change MySQL Create Statement Equals Segment to Optional [3730](https://github.com/sqlfluff/sqlfluff/pull/3730) [keyem4251](https://github.com/keyem4251)
* SQLite: add parsing of INSERT statement [3734](https://github.com/sqlfluff/sqlfluff/pull/3734) [imrehg](https://github.com/imrehg)
* SPARKSQL: Support Delta Lake Drop Column Clause in `ALTER TABLE` [3727](https://github.com/sqlfluff/sqlfluff/pull/3727) [R7L208](https://github.com/R7L208)
* Add short versions of several cli options [3732](https://github.com/sqlfluff/sqlfluff/pull/3732) [alanmcruickshank](https://github.com/alanmcruickshank)
* Build out type hints in Grammars [3718](https://github.com/sqlfluff/sqlfluff/pull/3718) [alanmcruickshank](https://github.com/alanmcruickshank)
* dbt 1.3.0 compatibility [3708](https://github.com/sqlfluff/sqlfluff/pull/3708) [edgarrmondragon](https://github.com/edgarrmondragon)
* Revise no cover direction and remove unused code. [3723](https://github.com/sqlfluff/sqlfluff/pull/3723) [alanmcruickshank](https://github.com/alanmcruickshank)
* Update broken flattr link [3720](https://github.com/sqlfluff/sqlfluff/pull/3720) [alanmcruickshank](https://github.com/alanmcruickshank)
* BigQuery: remove `key` from unreserved keywords list [3719](https://github.com/sqlfluff/sqlfluff/pull/3719) [sabrikaragonen](https://github.com/sabrikaragonen)
* Bigquery reset primary and foreign keys [3714](https://github.com/sqlfluff/sqlfluff/pull/3714) [sabrikaragonen](https://github.com/sabrikaragonen)
* Name Deprecation (Part 1) [3701](https://github.com/sqlfluff/sqlfluff/pull/3701) [alanmcruickshank](https://github.com/alanmcruickshank)
* Teradata: Add two TdTableConstraints [3690](https://github.com/sqlfluff/sqlfluff/pull/3690) [greg-finley](https://github.com/greg-finley)
* Redshift: support expressions in array accessors [3706](https://github.com/sqlfluff/sqlfluff/pull/3706) [chronitis](https://github.com/chronitis)
* Handle logging issues at teardown [3703](https://github.com/sqlfluff/sqlfluff/pull/3703) [alanmcruickshank](https://github.com/alanmcruickshank)
* L028, L032: Fix bug where fixes were copying templated table names [3699](https://github.com/sqlfluff/sqlfluff/pull/3699) [barrywhart](https://github.com/barrywhart)
* L042: Autofix sometimes results in "fix looping", hitting the linter "loop limit" [3697](https://github.com/sqlfluff/sqlfluff/pull/3697) [barrywhart](https://github.com/barrywhart)
* L042: Address corner cases where fix corrupts the SQL [3694](https://github.com/sqlfluff/sqlfluff/pull/3694) [barrywhart](https://github.com/barrywhart)
* T-SQL: Properly parse collation names [3686](https://github.com/sqlfluff/sqlfluff/pull/3686) [borchero](https://github.com/borchero)
* Allow escaping single quotes in single-quoted literal with '' [3682](https://github.com/sqlfluff/sqlfluff/pull/3682) [pdebelak](https://github.com/pdebelak)
* T-SQL: Fix indentation after JOIN/APPLY clauses with no ON statement [3684](https://github.com/sqlfluff/sqlfluff/pull/3684) [borchero](https://github.com/borchero)
* T-SQL: Parse `DATEPART` date type as date type instead of column name [3681](https://github.com/sqlfluff/sqlfluff/pull/3681) [borchero](https://github.com/borchero)
* T-SQL: Allow `COLLATE` clause in `JOIN` conditions [3680](https://github.com/sqlfluff/sqlfluff/pull/3680) [borchero](https://github.com/borchero)
* T-SQL: Fix parsing of CREATE VIEW statements with column name syntax [3669](https://github.com/sqlfluff/sqlfluff/pull/3669) [borchero](https://github.com/borchero)
* Fix typo in github issue template [3674](https://github.com/sqlfluff/sqlfluff/pull/3674) [alanmcruickshank](https://github.com/alanmcruickshank)
* Add Athena issue label [3676](https://github.com/sqlfluff/sqlfluff/pull/3676) [greg-finley](https://github.com/greg-finley)
* Set issue dialect labels via Github Actions [3666](https://github.com/sqlfluff/sqlfluff/pull/3666) [greg-finley](https://github.com/greg-finley)
* Allow configuration of processes from config [3662](https://github.com/sqlfluff/sqlfluff/pull/3662) [alanmcruickshank](https://github.com/alanmcruickshank)
* Reposition before recursion in fixes to avoid internal error [3658](https://github.com/sqlfluff/sqlfluff/pull/3658) [alanmcruickshank](https://github.com/alanmcruickshank)
* Use UUIDs for matching [3661](https://github.com/sqlfluff/sqlfluff/pull/3661) [alanmcruickshank](https://github.com/alanmcruickshank)
* Postgres: Add dialect-specific bare functions [3660](https://github.com/sqlfluff/sqlfluff/pull/3660) [WittierDinosaur](https://github.com/WittierDinosaur)
* Postgres: Add `CALL` Support [3659](https://github.com/sqlfluff/sqlfluff/pull/3659) [WittierDinosaur](https://github.com/WittierDinosaur)
* ANSI - Add support for `INTERSECT ALL` and `EXCEPT ALL` [3657](https://github.com/sqlfluff/sqlfluff/pull/3657) [WittierDinosaur](https://github.com/WittierDinosaur)
* Option to show errors on fix [3610](https://github.com/sqlfluff/sqlfluff/pull/3610) [chaimt](https://github.com/chaimt)
* L042: Fix internal error "Attempted to make a parent marker from multiple files" [3655](https://github.com/sqlfluff/sqlfluff/pull/3655) [barrywhart](https://github.com/barrywhart)
* L026: Add support for `merge_statement` [3654](https://github.com/sqlfluff/sqlfluff/pull/3654) [barrywhart](https://github.com/barrywhart)
* Add handling for Redshift `CONVERT` function data type argument [3653](https://github.com/sqlfluff/sqlfluff/pull/3653) [pdebelak](https://github.com/pdebelak)
* Deduplicate files before and during templating [3629](https://github.com/sqlfluff/sqlfluff/pull/3629) [alanmcruickshank](https://github.com/alanmcruickshank)
* Rationalise Rule Imports [3631](https://github.com/sqlfluff/sqlfluff/pull/3631) [alanmcruickshank](https://github.com/alanmcruickshank)
* Handle Jinja `{% call ... %}` blocks [3648](https://github.com/sqlfluff/sqlfluff/pull/3648) [barrywhart](https://github.com/barrywhart)
* SPARKSQL: Add Delta Lake Constraints syntax to `ALTER TABLE` [3643](https://github.com/sqlfluff/sqlfluff/pull/3643) [R7L208](https://github.com/R7L208)
* Redshift: syntax for array unnesting with index [3646](https://github.com/sqlfluff/sqlfluff/pull/3646) [chronitis](https://github.com/chronitis)
* Snowflake - `ALTER TABLE IF EXISTS` and `WHEN SYSTEM$STREAM_HAS_DATA()` [3641](https://github.com/sqlfluff/sqlfluff/pull/3641) [chrisalexeev](https://github.com/chrisalexeev)
* L057: In BigQuery, allow hyphens by default [3645](https://github.com/sqlfluff/sqlfluff/pull/3645) [barrywhart](https://github.com/barrywhart)
* Better messages for partial indentation in L003 [3634](https://github.com/sqlfluff/sqlfluff/pull/3634) [pdebelak](https://github.com/pdebelak)
* Add `INTEGER` to `PrimitiveTypeSegment` for Sparksql [3624](https://github.com/sqlfluff/sqlfluff/pull/3624) [ciwassano](https://github.com/ciwassano)
* Bump version in gettingstarted.rst via the release script [3642](https://github.com/sqlfluff/sqlfluff/pull/3642) [greg-finley](https://github.com/greg-finley)
* Improve handling of BigQuery hyphenated table names [3638](https://github.com/sqlfluff/sqlfluff/pull/3638) [barrywhart](https://github.com/barrywhart)
* update sqlfluff version in gettingstareted.rst [3639](https://github.com/sqlfluff/sqlfluff/pull/3639) [keyem4251](https://github.com/keyem4251)
* L016: Ignore jinja comments if `ignore_comment_clauses=True` [3637](https://github.com/sqlfluff/sqlfluff/pull/3637) [barrywhart](https://github.com/barrywhart)
* Add errors for redundant definitions. [3626](https://github.com/sqlfluff/sqlfluff/pull/3626) [alanmcruickshank](https://github.com/alanmcruickshank)
* Object Literals [3620](https://github.com/sqlfluff/sqlfluff/pull/3620) [alanmcruickshank](https://github.com/alanmcruickshank)
* Dialect Crumbs [3625](https://github.com/sqlfluff/sqlfluff/pull/3625) [alanmcruickshank](https://github.com/alanmcruickshank)
* Consistent return codes [3608](https://github.com/sqlfluff/sqlfluff/pull/3608) [alanmcruickshank](https://github.com/alanmcruickshank)


New Contributors
* [keyem4251](https://github.com/keyem4251) made their first contribution in [#3639](https://github.com/sqlfluff/sqlfluff/pull/3639)
* [ciwassano](https://github.com/ciwassano) made their first contribution in [#3624](https://github.com/sqlfluff/sqlfluff/pull/3624)
* [chronitis](https://github.com/chronitis) made their first contribution in [#3646](https://github.com/sqlfluff/sqlfluff/pull/3646)
* [chaimt](https://github.com/chaimt) made their first contribution in [#3610](https://github.com/sqlfluff/sqlfluff/pull/3610)
* [borchero](https://github.com/borchero) made their first contribution in [#3669](https://github.com/sqlfluff/sqlfluff/pull/3669)
* [sabrikaragonen](https://github.com/sabrikaragonen) made their first contribution in [#3714](https://github.com/sqlfluff/sqlfluff/pull/3714)
* [edgarrmondragon](https://github.com/edgarrmondragon) made their first contribution in [#3708](https://github.com/sqlfluff/sqlfluff/pull/3708)
* [imrehg](https://github.com/imrehg) made their first contribution in [#3734](https://github.com/sqlfluff/sqlfluff/pull/3734)
* [yoichi](https://github.com/yoichi) made their first contribution in [#3735](https://github.com/sqlfluff/sqlfluff/pull/3735)
* [RossOkuno](https://github.com/RossOkuno) made their first contribution in [#3741](https://github.com/sqlfluff/sqlfluff/pull/3741)
* [sirlark](https://github.com/sirlark) made their first contribution in [#3765](https://github.com/sqlfluff/sqlfluff/pull/3765)

Highlights

This is primarily a bugfix release to resolve an issue with the 1.2.0 release
where the new version of `sqlfluff-templater-dbt` relied on functionality
from the new version of `sqlfluff` but the package configuration had not
been updated. Versions of the two packages are now pinned together.

What’s Changed

* Pin sqlfluff-templater-dbt via release script [3613](https://github.com/sqlfluff/sqlfluff/pull/3613) [greg-finley](https://github.com/greg-finley)
* Specifying comma delimited is unnecessary [3616](https://github.com/sqlfluff/sqlfluff/pull/3616) [alanmcruickshank](https://github.com/alanmcruickshank)
* Handle redshift temporary tables with at the beginning of name [3615](https://github.com/sqlfluff/sqlfluff/pull/3615) [pdebelak](https://github.com/pdebelak)

Highlights
Major changes include:
* Adding AWS Athena as a dialect.
* A fix routine for L046 (whitespace in jinja tags), and the mechanisms for
more source-only fixes in future.
* By default, large files (over 20k characters) are now skipped by sqlfluff. This
limit is configurable and disable-able but exists as a sensible default to avoid
the performance overhead of linting *very* large files.
* For the dbt templater, fatal compilation errors now no longer stop linting, and
these files are now skipped instead. This enables projects to continue linting
beyond the offending file and much better logging information to enable better
debugging.

What’s Changed

* Improve documentation for custom implemented rules [3604](https://github.com/sqlfluff/sqlfluff/pull/3603) [Aditya-Tripuraneni](https://github.com/Aditya-Tripuraneni)
* Add a skip and better logging for fatal dbt issues [3603](https://github.com/sqlfluff/sqlfluff/pull/3603) [alanmcruickshank](https://github.com/alanmcruickshank)
* Add large file check [3600](https://github.com/sqlfluff/sqlfluff/pull/3600) [alanmcruickshank](https://github.com/alanmcruickshank)
* Oracle: extend support for `ALTER TABLE` [3596](https://github.com/sqlfluff/sqlfluff/pull/3596) [davidfuhr](https://github.com/davidfuhr)
* Immutability fixes [3428](https://github.com/sqlfluff/sqlfluff/pull/3428) [alanmcruickshank](https://github.com/alanmcruickshank)
* Struct type should be a segment [3591](https://github.com/sqlfluff/sqlfluff/pull/3591) [alanmcruickshank](https://github.com/alanmcruickshank)
* Fix Bracketed Struct issue [3590](https://github.com/sqlfluff/sqlfluff/pull/3590) [alanmcruickshank](https://github.com/alanmcruickshank)
* Allow spaces and multiple signs for numeric literals [3581](https://github.com/sqlfluff/sqlfluff/pull/3581) [tunetheweb](https://github.com/tunetheweb)
* Add source fixing capability and fix routines for L046 [3578](https://github.com/sqlfluff/sqlfluff/pull/3578) [alanmcruickshank](https://github.com/alanmcruickshank)
* Small grammar cleanup in team rollout docs [3584](https://github.com/sqlfluff/sqlfluff/pull/3584) [theianrobertson](https://github.com/theianrobertson)
* Postgres: `CREATE COLLATION` support [3571](https://github.com/sqlfluff/sqlfluff/pull/3571) [greg-finley](https://github.com/greg-finley)
* Redshift: Add `TOP X` to select clause modifiers [3582](https://github.com/sqlfluff/sqlfluff/pull/3582) [pdebelak](https://github.com/pdebelak)
* Postgres: Small fixes to `COMMENT ON` [3566](https://github.com/sqlfluff/sqlfluff/pull/3566) [greg-finley](https://github.com/greg-finley)
* Support MySQL system variables [3576](https://github.com/sqlfluff/sqlfluff/pull/3576) [qgallet](https://github.com/qgallet)
* Allow no alias for selects in CTEs with a column list [3580](https://github.com/sqlfluff/sqlfluff/pull/3580) [pdebelak](https://github.com/pdebelak)
* New dialect AWS Athena [3551](https://github.com/sqlfluff/sqlfluff/pull/3551) [cmotta](https://github.com/cmotta)
* Split apart `fix_string()`. [3568](https://github.com/sqlfluff/sqlfluff/pull/3568) [alanmcruickshank](https://github.com/alanmcruickshank)
* Fix incorrect L022 with postgres dialect with CTE argument list [3570](https://github.com/sqlfluff/sqlfluff/pull/3570) [pdebelak](https://github.com/pdebelak)
* Simplify lint fixing (prep for source fixes) [3567](https://github.com/sqlfluff/sqlfluff/pull/3567) [alanmcruickshank](https://github.com/alanmcruickshank)
* Exclude .coverage.py from linting [3564](https://github.com/sqlfluff/sqlfluff/pull/3564) [zidder](https://github.com/zidder)
* L016: `ignore_comment_clauses` not working for postgres dialect [3549](https://github.com/sqlfluff/sqlfluff/pull/3549) [barrywhart](https://github.com/barrywhart)
* Groundwork for a fix routine for L046 [3552](https://github.com/sqlfluff/sqlfluff/pull/3552) [alanmcruickshank](https://github.com/alanmcruickshank)
* Add better handling for SQLFluffUserError when running core cli commands [3431](https://github.com/sqlfluff/sqlfluff/pull/3431) [alanmcruickshank](https://github.com/alanmcruickshank)

New Contributors

* [pdebelak](https://github.com/pdebelak) made their first contribution in [#3570](https://github.com/sqlfluff/sqlfluff/pull/3570)
* [cmotta](https://github.com/cmotta) made their first contribution in [#3551](https://github.com/sqlfluff/sqlfluff/pull/3551)
* [qgallet](https://github.com/qgallet) made their first contribution in [#3576](https://github.com/sqlfluff/sqlfluff/pull/3576)
* [theianrobertson](https://github.com/theianrobertson) made their first contribution in [#3584](https://github.com/sqlfluff/sqlfluff/pull/3584)
* [davidfuhr](https://github.com/davidfuhr) made their first contribution in [#3596](https://github.com/sqlfluff/sqlfluff/pull/3596)
* [Aditya-Tripuraneni](https://github.com/Aditya-Tripuraneni) made their first contribution in [#3604](https://github.com/sqlfluff/sqlfluff/pull/3596)