Sqlfluff

Highlights

This is primarily a release for dialect fixes and improvements with additions
and changes to TSQL, Snowflake, MySQL & Redshift. The other changes of note are:
1. Support for warnings when users set old removed config values. This supports
future change work by allowing a mechanism to warn if they are used.
2. Improvements to the fix routines for L014 and L042 to handle some trickier
cases.

What’s Changed

* Add CreateUserSegment for Snowflake dialect [3880](https://github.com/sqlfluff/sqlfluff/pull/3880) [Gal40n04ek](https://github.com/Gal40n04ek)
* raw_segments_with_ancestors [3878](https://github.com/sqlfluff/sqlfluff/pull/3878) [alanmcruickshank](https://github.com/alanmcruickshank)
* Adjust TSQL Operators [3877](https://github.com/sqlfluff/sqlfluff/pull/3877) [alanmcruickshank](https://github.com/alanmcruickshank)
* Refactor path_to [3875](https://github.com/sqlfluff/sqlfluff/pull/3875) [alanmcruickshank](https://github.com/alanmcruickshank)
* Support Removed warning on configs [3874](https://github.com/sqlfluff/sqlfluff/pull/3874) [alanmcruickshank](https://github.com/alanmcruickshank)
* MySQL: Support column-path operator for JSON type [3864](https://github.com/sqlfluff/sqlfluff/pull/3864) [yoichi](https://github.com/yoichi)
* T-SQL: ALTER FUNCTION/PROCEDURE/VIEW parsing [3867](https://github.com/sqlfluff/sqlfluff/pull/3867) [differgroup](https://github.com/differgroup)
* MySQL: Support hexadecimal literals and bit value literals [3869](https://github.com/sqlfluff/sqlfluff/pull/3869) [yoichi](https://github.com/yoichi)
* MySQL: Treat double quotes the same as single quotes [3871](https://github.com/sqlfluff/sqlfluff/pull/3871) [yoichi](https://github.com/yoichi)
* Snowflake: COMMIT WORK [3862](https://github.com/sqlfluff/sqlfluff/pull/3862) [rglbr](https://github.com/rglbr)
* Snowflake: AlterShareStatementSegment and CreateDatabaseFromShareStatementSegment [3858](https://github.com/sqlfluff/sqlfluff/pull/3858) [moreaupascal56](https://github.com/moreaupascal56)
* MySQL: Add CREATE/ALTER VIEW [3859](https://github.com/sqlfluff/sqlfluff/pull/3859) [wfelipew](https://github.com/wfelipew)
* Redshift: CREATE TABLE LIKE enhancements [3853](https://github.com/sqlfluff/sqlfluff/pull/3853) [greg-finley](https://github.com/greg-finley)
* L014 leading underscore capitalization inference fix [3841](https://github.com/sqlfluff/sqlfluff/pull/3841) [j-svensmark](https://github.com/j-svensmark)
* MySQL: Add extended DROP TRIGGER functionality [3846](https://github.com/sqlfluff/sqlfluff/pull/3846) [yoichi](https://github.com/yoichi)
* Allow standalone aliases in L027 [3848](https://github.com/sqlfluff/sqlfluff/pull/3848) [olagjo](https://github.com/olagjo)
* L042: Enable autofix for some tricky cases [3700](https://github.com/sqlfluff/sqlfluff/pull/3700) [barrywhart](https://github.com/barrywhart)
* Snowflake: CREATE FUNCTION IF NOT EXISTS [3845](https://github.com/sqlfluff/sqlfluff/pull/3845) [greg-finley](https://github.com/greg-finley)
* ignore functions with more than one element ... [3792](https://github.com/sqlfluff/sqlfluff/pull/3792) [fmms](https://github.com/fmms)
* MySQL: support remaining constraint parts of CREATE/ALTER TABLE [3827](https://github.com/sqlfluff/sqlfluff/pull/3827) [yoichi](https://github.com/yoichi)

New Contributors

* [olagjo](https://github.com/olagjo) made their first contribution in [#3848](https://github.com/sqlfluff/sqlfluff/pull/3848)
* [j-svensmark](https://github.com/j-svensmark) made their first contribution in [#3841](https://github.com/sqlfluff/sqlfluff/pull/3841)
* [wfelipew](https://github.com/wfelipew) made their first contribution in [#3859](https://github.com/sqlfluff/sqlfluff/pull/3859)
* [moreaupascal56](https://github.com/moreaupascal56) made their first contribution in [#3858](https://github.com/sqlfluff/sqlfluff/pull/3858)
* [rglbr](https://github.com/rglbr) made their first contribution in [#3862](https://github.com/sqlfluff/sqlfluff/pull/3862)
* [differgroup](https://github.com/differgroup) made their first contribution in [#3867](https://github.com/sqlfluff/sqlfluff/pull/3867)

Highlights

* More refactoring of parse structures in preparation for upcoming refactor of
formatting/whitespace rules.
* Fixes some bugs in L003 (indentation).
* New config flag `large_file_skip_byte_limit` which applies **prior to**
loading the file.

What’s Changed

* Snowflake: Fix syntax errors in tests [3834](https://github.com/sqlfluff/sqlfluff/pull/3834) [JamesRTaylor](https://github.com/JamesRTaylor)
* Add support for additional magic methods on DummyUndefined [3835](https://github.com/sqlfluff/sqlfluff/pull/3835) [barrywhart](https://github.com/barrywhart)
* MySQL: support variable assignments by assignment operator := [3829](https://github.com/sqlfluff/sqlfluff/pull/3829) [yoichi](https://github.com/yoichi)
* MYSQL: improve lexing for single-quoted strings [3831](https://github.com/sqlfluff/sqlfluff/pull/3831) [mdahlman](https://github.com/mdahlman)
* MySQL: More support for index definition in CREATE TABLE [3826](https://github.com/sqlfluff/sqlfluff/pull/3826) [yoichi](https://github.com/yoichi)
* Typed matching and ripping out the rest of .name [3819](https://github.com/sqlfluff/sqlfluff/pull/3819) [alanmcruickshank](https://github.com/alanmcruickshank)
* sparksql dialect to support lambda expressions (->) [3821](https://github.com/sqlfluff/sqlfluff/pull/3821) [juhoautio](https://github.com/juhoautio)
* Fixed broken main branch [3825](https://github.com/sqlfluff/sqlfluff/pull/3825) [alanmcruickshank](https://github.com/alanmcruickshank)
* Enable file name logging for multi-files w/ --show-lint-violations flag [3788](https://github.com/sqlfluff/sqlfluff/pull/3788) [thechopkins](https://github.com/thechopkins)
* Take database and schema out of Snowflake reserved keywords list [3818](https://github.com/sqlfluff/sqlfluff/pull/3818) [NiallRees](https://github.com/NiallRees)
* Remove a chunk of name references [3814](https://github.com/sqlfluff/sqlfluff/pull/3814) [alanmcruickshank](https://github.com/alanmcruickshank)
* Fix typo in Snowflake dialect [3813](https://github.com/sqlfluff/sqlfluff/pull/3813) [Gal40n04ek](https://github.com/Gal40n04ek)
* Allow the use of libraries in macro definitions [3803](https://github.com/sqlfluff/sqlfluff/pull/3803) [bjgbeelen](https://github.com/bjgbeelen)
* Indentation fixes and rule logging improvements [3808](https://github.com/sqlfluff/sqlfluff/pull/3808) [alanmcruickshank](https://github.com/alanmcruickshank)
* Fixes a recursion error in JinjaTemplater handling of undefined values [3809](https://github.com/sqlfluff/sqlfluff/pull/3809) [barrywhart](https://github.com/barrywhart)
* Snowflake: extend `GRANT` syntax [3807](https://github.com/sqlfluff/sqlfluff/pull/3807) [Gal40n04ek](https://github.com/Gal40n04ek)
* add warehouse_type in snowflake dialect [3805](https://github.com/sqlfluff/sqlfluff/pull/3805) [Gal40n04ek](https://github.com/Gal40n04ek)
* add Create Notification Integration syntax [3801](https://github.com/sqlfluff/sqlfluff/pull/3801) [Gal40n04ek](https://github.com/Gal40n04ek)
* T-SQL: fix parsing PARTITION BY NULL in window function [3790](https://github.com/sqlfluff/sqlfluff/pull/3790) [fmms](https://github.com/fmms)
* SparkSQL: Update L014 rule to not flag Delta Change Data Feed Session & Table Property [3689](https://github.com/sqlfluff/sqlfluff/pull/3689) [R7L208](https://github.com/R7L208)
* Snowflake: OVER (ORDER BY) clause required for first_value (fixes 3797) [3798](https://github.com/sqlfluff/sqlfluff/pull/3798) [JamesRTaylor](https://github.com/JamesRTaylor)
* add Alter Pipe syntax for snowflake dialect [3796](https://github.com/sqlfluff/sqlfluff/pull/3796) [Gal40n04ek](https://github.com/Gal40n04ek)
* BigQuery: Parse WEEK(<WEEKDAY>) in date_part [3787](https://github.com/sqlfluff/sqlfluff/pull/3787) [yoichi](https://github.com/yoichi)
* Postgres: Support setting user properties using intrinsic ON & OFF values [3793](https://github.com/sqlfluff/sqlfluff/pull/3793) [chris-codaio](https://github.com/chris-codaio)
* extend SF dialect for File Format statements [3774](https://github.com/sqlfluff/sqlfluff/pull/3774) [Gal40n04ek](https://github.com/Gal40n04ek)
* Add QUALIFY to SparkSQL dialect [3778](https://github.com/sqlfluff/sqlfluff/pull/3778) [ThijsKoot](https://github.com/ThijsKoot)
* fix regex for S3Path [3782](https://github.com/sqlfluff/sqlfluff/pull/3782) [Gal40n04ek](https://github.com/Gal40n04ek)
* Snowflake: add Optional parameter ERROR INTEGRATION for PIPE [3785](https://github.com/sqlfluff/sqlfluff/pull/3785) [Gal40n04ek](https://github.com/Gal40n04ek)
* Add a file size check in bytes [3770](https://github.com/sqlfluff/sqlfluff/pull/3770) [alanmcruickshank](https://github.com/alanmcruickshank)
* Require importlib_metadata >=1.0.0 [3769](https://github.com/sqlfluff/sqlfluff/pull/3769) [alanmcruickshank](https://github.com/alanmcruickshank)

New Contributors

* [Gal40n04ek](https://github.com/Gal40n04ek) made their first contribution in [#3785](https://github.com/sqlfluff/sqlfluff/pull/3785)
* [ThijsKoot](https://github.com/ThijsKoot) made their first contribution in [#3778](https://github.com/sqlfluff/sqlfluff/pull/3778)
* [chris-codaio](https://github.com/chris-codaio) made their first contribution in [#3793](https://github.com/sqlfluff/sqlfluff/pull/3793)
* [JamesRTaylor](https://github.com/JamesRTaylor) made their first contribution in [#3798](https://github.com/sqlfluff/sqlfluff/pull/3798)
* [fmms](https://github.com/fmms) made their first contribution in [#3790](https://github.com/sqlfluff/sqlfluff/pull/3790)
* [bjgbeelen](https://github.com/bjgbeelen) made their first contribution in [#3803](https://github.com/sqlfluff/sqlfluff/pull/3803)
* [thechopkins](https://github.com/thechopkins) made their first contribution in [#3788](https://github.com/sqlfluff/sqlfluff/pull/3788)

Highlights

This release brings several potentially breaking changes to the underlying parse tree. For
users of the cli tool in a linting context you should notice no change. If however
your application relies on the structure of the SQLFluff parse tree or the naming of certain
elements within the yaml format, then this may not be a drop-in replacement. Specifically:
- The addition of a new `end_of_file` meta segment at the end of the parse structure.
- The addition of a `template_loop` meta segment to signify a jump backward in the source
file within a loop structure (e.g. a jinja for loop).
- Much more specific types on some raw segments, in particular `identifier` and `literal`
type segments will now appear in the parse tree with their more specific type (which
used to be called `name`) e.g. `naked_identifier`, `quoted_identifier`, `numeric_literal` etc...

If using the python api, the _parent_ type (such as `identifier`) will still register if
you call `.is_type("identifier")`, as this function checks all inherited types. However the
eventual type returned by `.get_type()` will now be (in most cases) what used to be accessible
at `.name`. The `name` attribute will be deprecated in a future release.

Other highlights:
* New command-line option `--show-lint-violations` to show details on unfixable errors when
running `sqlfluff fix`.
* Improved consistency of process exit codes.
* Short CLI options for many common options.
* Jinja templater: When `--ignore=templating` is enabled, undefined Jinja variables now take
on "reasonable" default values rather than blank string (`""`). This can streamline initial
rollout of SQLFluff by reducing or eliminating the need to configure templater variables.

There are also a _ton_ of other features and bug fixes in this release, including first-time
contributions from **11 new contributors**! 🎉

What’s Changed

* T-SQL: ALTER TABLE DROP COLUMN [3749](https://github.com/sqlfluff/sqlfluff/pull/3749) [greg-finley](https://github.com/greg-finley)
* Add " pragma: no cover" to work around sporadic, spurious coverage failure [3767](https://github.com/sqlfluff/sqlfluff/pull/3767) [barrywhart](https://github.com/barrywhart)
* Add end_of_file and template_loop markers [3766](https://github.com/sqlfluff/sqlfluff/pull/3766) [alanmcruickshank](https://github.com/alanmcruickshank)
* Provide usage examples for new users [3765](https://github.com/sqlfluff/sqlfluff/pull/3765) [sirlark](https://github.com/sirlark)
* SQLite: deferrable in create table statement [3757](https://github.com/sqlfluff/sqlfluff/pull/3757) [RossOkuno](https://github.com/RossOkuno)
* When ignore=templating and fix_even_unparsable=True, provide defaults for missing vars [3753](https://github.com/sqlfluff/sqlfluff/pull/3753) [barrywhart](https://github.com/barrywhart)
* BigQuery: Support Materialized Views [3759](https://github.com/sqlfluff/sqlfluff/pull/3759) [yoichi](https://github.com/yoichi)
* Enhance L062 to ignore blocked words in comments [3754](https://github.com/sqlfluff/sqlfluff/pull/3754) [tunetheweb](https://github.com/tunetheweb)
* Fix bug where undefined Jinja variable in macro file crashes linter [3751](https://github.com/sqlfluff/sqlfluff/pull/3751) [barrywhart](https://github.com/barrywhart)
* Migrate analysis, functional and testing to utils [3743](https://github.com/sqlfluff/sqlfluff/pull/3743) [alanmcruickshank](https://github.com/alanmcruickshank)
* Build out rule crawling mechanisms [3717](https://github.com/sqlfluff/sqlfluff/pull/3717) [alanmcruickshank](https://github.com/alanmcruickshank)
* Add current_timestamp to Redshift as a bare function [3741](https://github.com/sqlfluff/sqlfluff/pull/3741) [RossOkuno](https://github.com/RossOkuno)
* BigQuery: Fix parsing parameterized data types [3735](https://github.com/sqlfluff/sqlfluff/pull/3735) [yoichi](https://github.com/yoichi)
* Change MySQL Create Statement Equals Segment to Optional [3730](https://github.com/sqlfluff/sqlfluff/pull/3730) [keyem4251](https://github.com/keyem4251)
* SQLite: add parsing of INSERT statement [3734](https://github.com/sqlfluff/sqlfluff/pull/3734) [imrehg](https://github.com/imrehg)
* SPARKSQL: Support Delta Lake Drop Column Clause in `ALTER TABLE` [3727](https://github.com/sqlfluff/sqlfluff/pull/3727) [R7L208](https://github.com/R7L208)
* Add short versions of several cli options [3732](https://github.com/sqlfluff/sqlfluff/pull/3732) [alanmcruickshank](https://github.com/alanmcruickshank)
* Build out type hints in Grammars [3718](https://github.com/sqlfluff/sqlfluff/pull/3718) [alanmcruickshank](https://github.com/alanmcruickshank)
* dbt 1.3.0 compatibility [3708](https://github.com/sqlfluff/sqlfluff/pull/3708) [edgarrmondragon](https://github.com/edgarrmondragon)
* Revise no cover direction and remove unused code. [3723](https://github.com/sqlfluff/sqlfluff/pull/3723) [alanmcruickshank](https://github.com/alanmcruickshank)
* Update broken flattr link [3720](https://github.com/sqlfluff/sqlfluff/pull/3720) [alanmcruickshank](https://github.com/alanmcruickshank)
* BigQuery: remove `key` from unreserved keywords list [3719](https://github.com/sqlfluff/sqlfluff/pull/3719) [sabrikaragonen](https://github.com/sabrikaragonen)
* Bigquery reset primary and foreign keys [3714](https://github.com/sqlfluff/sqlfluff/pull/3714) [sabrikaragonen](https://github.com/sabrikaragonen)
* Name Deprecation (Part 1) [3701](https://github.com/sqlfluff/sqlfluff/pull/3701) [alanmcruickshank](https://github.com/alanmcruickshank)
* Teradata: Add two TdTableConstraints [3690](https://github.com/sqlfluff/sqlfluff/pull/3690) [greg-finley](https://github.com/greg-finley)
* Redshift: support expressions in array accessors [3706](https://github.com/sqlfluff/sqlfluff/pull/3706) [chronitis](https://github.com/chronitis)
* Handle logging issues at teardown [3703](https://github.com/sqlfluff/sqlfluff/pull/3703) [alanmcruickshank](https://github.com/alanmcruickshank)
* L028, L032: Fix bug where fixes were copying templated table names [3699](https://github.com/sqlfluff/sqlfluff/pull/3699) [barrywhart](https://github.com/barrywhart)
* L042: Autofix sometimes results in "fix looping", hitting the linter "loop limit" [3697](https://github.com/sqlfluff/sqlfluff/pull/3697) [barrywhart](https://github.com/barrywhart)
* L042: Address corner cases where fix corrupts the SQL [3694](https://github.com/sqlfluff/sqlfluff/pull/3694) [barrywhart](https://github.com/barrywhart)
* T-SQL: Properly parse collation names [3686](https://github.com/sqlfluff/sqlfluff/pull/3686) [borchero](https://github.com/borchero)
* Allow escaping single quotes in single-quoted literal with '' [3682](https://github.com/sqlfluff/sqlfluff/pull/3682) [pdebelak](https://github.com/pdebelak)
* T-SQL: Fix indentation after JOIN/APPLY clauses with no ON statement [3684](https://github.com/sqlfluff/sqlfluff/pull/3684) [borchero](https://github.com/borchero)
* T-SQL: Parse `DATEPART` date type as date type instead of column name [3681](https://github.com/sqlfluff/sqlfluff/pull/3681) [borchero](https://github.com/borchero)
* T-SQL: Allow `COLLATE` clause in `JOIN` conditions [3680](https://github.com/sqlfluff/sqlfluff/pull/3680) [borchero](https://github.com/borchero)
* T-SQL: Fix parsing of CREATE VIEW statements with column name syntax [3669](https://github.com/sqlfluff/sqlfluff/pull/3669) [borchero](https://github.com/borchero)
* Fix typo in github issue template [3674](https://github.com/sqlfluff/sqlfluff/pull/3674) [alanmcruickshank](https://github.com/alanmcruickshank)
* Add Athena issue label [3676](https://github.com/sqlfluff/sqlfluff/pull/3676) [greg-finley](https://github.com/greg-finley)
* Set issue dialect labels via Github Actions [3666](https://github.com/sqlfluff/sqlfluff/pull/3666) [greg-finley](https://github.com/greg-finley)
* Allow configuration of processes from config [3662](https://github.com/sqlfluff/sqlfluff/pull/3662) [alanmcruickshank](https://github.com/alanmcruickshank)
* Reposition before recursion in fixes to avoid internal error [3658](https://github.com/sqlfluff/sqlfluff/pull/3658) [alanmcruickshank](https://github.com/alanmcruickshank)
* Use UUIDs for matching [3661](https://github.com/sqlfluff/sqlfluff/pull/3661) [alanmcruickshank](https://github.com/alanmcruickshank)
* Postgres: Add dialect-specific bare functions [3660](https://github.com/sqlfluff/sqlfluff/pull/3660) [WittierDinosaur](https://github.com/WittierDinosaur)
* Postgres: Add `CALL` Support [3659](https://github.com/sqlfluff/sqlfluff/pull/3659) [WittierDinosaur](https://github.com/WittierDinosaur)
* ANSI - Add support for `INTERSECT ALL` and `EXCEPT ALL` [3657](https://github.com/sqlfluff/sqlfluff/pull/3657) [WittierDinosaur](https://github.com/WittierDinosaur)
* Option to show errors on fix [3610](https://github.com/sqlfluff/sqlfluff/pull/3610) [chaimt](https://github.com/chaimt)
* L042: Fix internal error "Attempted to make a parent marker from multiple files" [3655](https://github.com/sqlfluff/sqlfluff/pull/3655) [barrywhart](https://github.com/barrywhart)
* L026: Add support for `merge_statement` [3654](https://github.com/sqlfluff/sqlfluff/pull/3654) [barrywhart](https://github.com/barrywhart)
* Add handling for Redshift `CONVERT` function data type argument [3653](https://github.com/sqlfluff/sqlfluff/pull/3653) [pdebelak](https://github.com/pdebelak)
* Deduplicate files before and during templating [3629](https://github.com/sqlfluff/sqlfluff/pull/3629) [alanmcruickshank](https://github.com/alanmcruickshank)
* Rationalise Rule Imports [3631](https://github.com/sqlfluff/sqlfluff/pull/3631) [alanmcruickshank](https://github.com/alanmcruickshank)
* Handle Jinja `{% call ... %}` blocks [3648](https://github.com/sqlfluff/sqlfluff/pull/3648) [barrywhart](https://github.com/barrywhart)
* SPARKSQL: Add Delta Lake Constraints syntax to `ALTER TABLE` [3643](https://github.com/sqlfluff/sqlfluff/pull/3643) [R7L208](https://github.com/R7L208)
* Redshift: syntax for array unnesting with index [3646](https://github.com/sqlfluff/sqlfluff/pull/3646) [chronitis](https://github.com/chronitis)
* Snowflake - `ALTER TABLE IF EXISTS` and `WHEN SYSTEM$STREAM_HAS_DATA()` [3641](https://github.com/sqlfluff/sqlfluff/pull/3641) [chrisalexeev](https://github.com/chrisalexeev)
* L057: In BigQuery, allow hyphens by default [3645](https://github.com/sqlfluff/sqlfluff/pull/3645) [barrywhart](https://github.com/barrywhart)
* Better messages for partial indentation in L003 [3634](https://github.com/sqlfluff/sqlfluff/pull/3634) [pdebelak](https://github.com/pdebelak)
* Add `INTEGER` to `PrimitiveTypeSegment` for Sparksql [3624](https://github.com/sqlfluff/sqlfluff/pull/3624) [ciwassano](https://github.com/ciwassano)
* Bump version in gettingstarted.rst via the release script [3642](https://github.com/sqlfluff/sqlfluff/pull/3642) [greg-finley](https://github.com/greg-finley)
* Improve handling of BigQuery hyphenated table names [3638](https://github.com/sqlfluff/sqlfluff/pull/3638) [barrywhart](https://github.com/barrywhart)
* update sqlfluff version in gettingstareted.rst [3639](https://github.com/sqlfluff/sqlfluff/pull/3639) [keyem4251](https://github.com/keyem4251)
* L016: Ignore jinja comments if `ignore_comment_clauses=True` [3637](https://github.com/sqlfluff/sqlfluff/pull/3637) [barrywhart](https://github.com/barrywhart)
* Add errors for redundant definitions. [3626](https://github.com/sqlfluff/sqlfluff/pull/3626) [alanmcruickshank](https://github.com/alanmcruickshank)
* Object Literals [3620](https://github.com/sqlfluff/sqlfluff/pull/3620) [alanmcruickshank](https://github.com/alanmcruickshank)
* Dialect Crumbs [3625](https://github.com/sqlfluff/sqlfluff/pull/3625) [alanmcruickshank](https://github.com/alanmcruickshank)
* Consistent return codes [3608](https://github.com/sqlfluff/sqlfluff/pull/3608) [alanmcruickshank](https://github.com/alanmcruickshank)


New Contributors
* [keyem4251](https://github.com/keyem4251) made their first contribution in [#3639](https://github.com/sqlfluff/sqlfluff/pull/3639)
* [ciwassano](https://github.com/ciwassano) made their first contribution in [#3624](https://github.com/sqlfluff/sqlfluff/pull/3624)
* [chronitis](https://github.com/chronitis) made their first contribution in [#3646](https://github.com/sqlfluff/sqlfluff/pull/3646)
* [chaimt](https://github.com/chaimt) made their first contribution in [#3610](https://github.com/sqlfluff/sqlfluff/pull/3610)
* [borchero](https://github.com/borchero) made their first contribution in [#3669](https://github.com/sqlfluff/sqlfluff/pull/3669)
* [sabrikaragonen](https://github.com/sabrikaragonen) made their first contribution in [#3714](https://github.com/sqlfluff/sqlfluff/pull/3714)
* [edgarrmondragon](https://github.com/edgarrmondragon) made their first contribution in [#3708](https://github.com/sqlfluff/sqlfluff/pull/3708)
* [imrehg](https://github.com/imrehg) made their first contribution in [#3734](https://github.com/sqlfluff/sqlfluff/pull/3734)
* [yoichi](https://github.com/yoichi) made their first contribution in [#3735](https://github.com/sqlfluff/sqlfluff/pull/3735)
* [RossOkuno](https://github.com/RossOkuno) made their first contribution in [#3741](https://github.com/sqlfluff/sqlfluff/pull/3741)
* [sirlark](https://github.com/sirlark) made their first contribution in [#3765](https://github.com/sqlfluff/sqlfluff/pull/3765)

Highlights

This is primarily a bugfix release to resolve an issue with the 1.2.0 release
where the new version of `sqlfluff-templater-dbt` relied on functionality
from the new version of `sqlfluff` but the package configuration had not
been updated. Versions of the two packages are now pinned together.

What’s Changed

* Pin sqlfluff-templater-dbt via release script [3613](https://github.com/sqlfluff/sqlfluff/pull/3613) [greg-finley](https://github.com/greg-finley)
* Specifying comma delimited is unnecessary [3616](https://github.com/sqlfluff/sqlfluff/pull/3616) [alanmcruickshank](https://github.com/alanmcruickshank)
* Handle redshift temporary tables with at the beginning of name [3615](https://github.com/sqlfluff/sqlfluff/pull/3615) [pdebelak](https://github.com/pdebelak)

Highlights
Major changes include:
* Adding AWS Athena as a dialect.
* A fix routine for L046 (whitespace in jinja tags), and the mechanisms for
more source-only fixes in future.
* By default, large files (over 20k characters) are now skipped by sqlfluff. This
limit is configurable and disable-able but exists as a sensible default to avoid
the performance overhead of linting *very* large files.
* For the dbt templater, fatal compilation errors now no longer stop linting, and
these files are now skipped instead. This enables projects to continue linting
beyond the offending file and much better logging information to enable better
debugging.

What’s Changed

* Improve documentation for custom implemented rules [3604](https://github.com/sqlfluff/sqlfluff/pull/3603) [Aditya-Tripuraneni](https://github.com/Aditya-Tripuraneni)
* Add a skip and better logging for fatal dbt issues [3603](https://github.com/sqlfluff/sqlfluff/pull/3603) [alanmcruickshank](https://github.com/alanmcruickshank)
* Add large file check [3600](https://github.com/sqlfluff/sqlfluff/pull/3600) [alanmcruickshank](https://github.com/alanmcruickshank)
* Oracle: extend support for `ALTER TABLE` [3596](https://github.com/sqlfluff/sqlfluff/pull/3596) [davidfuhr](https://github.com/davidfuhr)
* Immutability fixes [3428](https://github.com/sqlfluff/sqlfluff/pull/3428) [alanmcruickshank](https://github.com/alanmcruickshank)
* Struct type should be a segment [3591](https://github.com/sqlfluff/sqlfluff/pull/3591) [alanmcruickshank](https://github.com/alanmcruickshank)
* Fix Bracketed Struct issue [3590](https://github.com/sqlfluff/sqlfluff/pull/3590) [alanmcruickshank](https://github.com/alanmcruickshank)
* Allow spaces and multiple signs for numeric literals [3581](https://github.com/sqlfluff/sqlfluff/pull/3581) [tunetheweb](https://github.com/tunetheweb)
* Add source fixing capability and fix routines for L046 [3578](https://github.com/sqlfluff/sqlfluff/pull/3578) [alanmcruickshank](https://github.com/alanmcruickshank)
* Small grammar cleanup in team rollout docs [3584](https://github.com/sqlfluff/sqlfluff/pull/3584) [theianrobertson](https://github.com/theianrobertson)
* Postgres: `CREATE COLLATION` support [3571](https://github.com/sqlfluff/sqlfluff/pull/3571) [greg-finley](https://github.com/greg-finley)
* Redshift: Add `TOP X` to select clause modifiers [3582](https://github.com/sqlfluff/sqlfluff/pull/3582) [pdebelak](https://github.com/pdebelak)
* Postgres: Small fixes to `COMMENT ON` [3566](https://github.com/sqlfluff/sqlfluff/pull/3566) [greg-finley](https://github.com/greg-finley)
* Support MySQL system variables [3576](https://github.com/sqlfluff/sqlfluff/pull/3576) [qgallet](https://github.com/qgallet)
* Allow no alias for selects in CTEs with a column list [3580](https://github.com/sqlfluff/sqlfluff/pull/3580) [pdebelak](https://github.com/pdebelak)
* New dialect AWS Athena [3551](https://github.com/sqlfluff/sqlfluff/pull/3551) [cmotta](https://github.com/cmotta)
* Split apart `fix_string()`. [3568](https://github.com/sqlfluff/sqlfluff/pull/3568) [alanmcruickshank](https://github.com/alanmcruickshank)
* Fix incorrect L022 with postgres dialect with CTE argument list [3570](https://github.com/sqlfluff/sqlfluff/pull/3570) [pdebelak](https://github.com/pdebelak)
* Simplify lint fixing (prep for source fixes) [3567](https://github.com/sqlfluff/sqlfluff/pull/3567) [alanmcruickshank](https://github.com/alanmcruickshank)
* Exclude .coverage.py from linting [3564](https://github.com/sqlfluff/sqlfluff/pull/3564) [zidder](https://github.com/zidder)
* L016: `ignore_comment_clauses` not working for postgres dialect [3549](https://github.com/sqlfluff/sqlfluff/pull/3549) [barrywhart](https://github.com/barrywhart)
* Groundwork for a fix routine for L046 [3552](https://github.com/sqlfluff/sqlfluff/pull/3552) [alanmcruickshank](https://github.com/alanmcruickshank)
* Add better handling for SQLFluffUserError when running core cli commands [3431](https://github.com/sqlfluff/sqlfluff/pull/3431) [alanmcruickshank](https://github.com/alanmcruickshank)

New Contributors

* [pdebelak](https://github.com/pdebelak) made their first contribution in [#3570](https://github.com/sqlfluff/sqlfluff/pull/3570)
* [cmotta](https://github.com/cmotta) made their first contribution in [#3551](https://github.com/sqlfluff/sqlfluff/pull/3551)
* [qgallet](https://github.com/qgallet) made their first contribution in [#3576](https://github.com/sqlfluff/sqlfluff/pull/3576)
* [theianrobertson](https://github.com/theianrobertson) made their first contribution in [#3584](https://github.com/sqlfluff/sqlfluff/pull/3584)
* [davidfuhr](https://github.com/davidfuhr) made their first contribution in [#3596](https://github.com/sqlfluff/sqlfluff/pull/3596)
* [Aditya-Tripuraneni](https://github.com/Aditya-Tripuraneni) made their first contribution in [#3604](https://github.com/sqlfluff/sqlfluff/pull/3596)

Highlights
Major changes include:
* L066 - New rule to allow you to set min/max length requirements for aliases to ensure they are meaningful
* L062 - addition of `blocked_regex` as well as `blocked_words`
* L025 - fix several corner cases where aliases were removed inappropriately
* L059 is now disabled by default for Postgres
* Many more dialect improvements and bug fixes.

Highlights

What’s Changed

* L025: Derived query requires alias -- also handle UNION, etc. [3548](https://github.com/sqlfluff/sqlfluff/pull/3548) [barrywhart](https://github.com/barrywhart)
* L025 should not remove aliases from derived queries [3546](https://github.com/sqlfluff/sqlfluff/pull/3546) [barrywhart](https://github.com/barrywhart)
* T-SQL keyword functions should be treated as keywords [3540](https://github.com/sqlfluff/sqlfluff/pull/3540) [tunetheweb](https://github.com/tunetheweb)
* Fix issue where "--nocolor" is ignored [3536)(https://github.com/sqlfluff/sqlfluff/pull/3536) [barrywhart](https://github.com/barrywhart)
* Clickhouse: allow `FINAL` modifier [3534](https://github.com/sqlfluff/sqlfluff/pull/3534) [ThomAub](https://github.com/ThomAub)
* L018 change to just check for newlines rather than alignment [3499](https://github.com/sqlfluff/sqlfluff/pull/3499) [zidder](https://github.com/zidder)
* SparkSQL: Update terminator grammar for `HAVING`, `WHERE`, `GROUP BY` [3526](https://github.com/sqlfluff/sqlfluff/pull/3526) [R7L208](https://github.com/R7L208)
* Fix L025 false positive for T-SQL `VALUES` clause [3533](https://github.com/sqlfluff/sqlfluff/pull/3533) [barrywhart](https://github.com/barrywhart)
* New rule L066 for enforcing table alias lengths [3384](https://github.com/sqlfluff/sqlfluff/pull/3384) [f0rk](https://github.com/f0rk)
* Redshift: `CALL` statement [3529](https://github.com/sqlfluff/sqlfluff/pull/3529) [greg-finley](https://github.com/greg-finley)
* Core: Compile regexes at init time to avoid overhead [3511](https://github.com/sqlfluff/sqlfluff/pull/3511) [judahrand](https://github.com/judahrand)
* Disable L059 by default for Postgres [3528](https://github.com/sqlfluff/sqlfluff/pull/3528) [tunetheweb](https://github.com/tunetheweb)
* Core: Add `MultiStringParser` to match a collection of strings [3510](https://github.com/sqlfluff/sqlfluff/pull/3510) [judahrand](https://github.com/judahrand)
* SQLite: `PRIMARY KEY AUTOINCREMENT` [3527](https://github.com/sqlfluff/sqlfluff/pull/3527) [greg-finley](https://github.com/greg-finley)
* MySQL: Support `LOAD DATA` [3518](https://github.com/sqlfluff/sqlfluff/pull/3518) [greg-finley](https://github.com/greg-finley)
* Redshift: `GRANT EXECUTE ON PROCEDURES` [3516](https://github.com/sqlfluff/sqlfluff/pull/3516) [greg-finley](https://github.com/greg-finley)
* Allow `DEFAULT` expression in Redshift `ALTER TABLE ADD COLUMN` statements [3513](https://github.com/sqlfluff/sqlfluff/pull/3513) [menzenski](https://github.com/menzenski)
* BigQuery: Fix parsing of Array creation from full subquery [3502](https://github.com/sqlfluff/sqlfluff/pull/3502) [judahrand](https://github.com/judahrand)
* SparkSQL: Allow dateparts as table aliases [3500](https://github.com/sqlfluff/sqlfluff/pull/3500) [R7L208](https://github.com/R7L208)
* Fix `load_macros_from_path` to actually support multiple paths [3488](https://github.com/sqlfluff/sqlfluff/pull/3488) [emancu](https://github.com/emancu)
* Allow linter to apply fixes spanning more than 2 slices [3492](https://github.com/sqlfluff/sqlfluff/pull/3492) [barrywhart](https://github.com/barrywhart)
* Fix L022 false positive when the CTE definition has a column list [3490](https://github.com/sqlfluff/sqlfluff/pull/3490) [barrywhart](https://github.com/barrywhart)
* SparkSQL: Support for Delta `RESTORE` statement [3486](https://github.com/sqlfluff/sqlfluff/pull/3486) [R7L208](https://github.com/R7L208)
* Add values function to `SET` clause [3483](https://github.com/sqlfluff/sqlfluff/pull/3483) [hgranthorner](https://github.com/hgranthorner)
* SparkSQL: Support for `CONVERT TO DELTA` command [3482](https://github.com/sqlfluff/sqlfluff/pull/3482) [R7L208](https://github.com/R7L208)
* BigQuery: Remaining procedural statements [3473](https://github.com/sqlfluff/sqlfluff/pull/3473) [tunetheweb](https://github.com/tunetheweb)
* Postgres: support grouping sets [3477](https://github.com/sqlfluff/sqlfluff/pull/3477) [tunetheweb](https://github.com/tunetheweb)
* SparkSQL: Support for Delta syntax to create manifest files through the `GENERATE` command [3478](https://github.com/sqlfluff/sqlfluff/pull/3478) [R7L208](https://github.com/R7L208)
* Add config for optionally indenting contents of `ON` blocks [3471](https://github.com/sqlfluff/sqlfluff/pull/3471) [PeterBalsdon](https://github.com/PeterBalsdon)
* L026: check standalone aliases as well as table aliases [3470](https://github.com/sqlfluff/sqlfluff/pull/3470) [tunetheweb](https://github.com/tunetheweb)
* L045: Add handling for nested queries and CTEs [3468](https://github.com/sqlfluff/sqlfluff/pull/3468) [barrywhart](https://github.com/barrywhart)
* L062: add `blocked_regex` support [3467](https://github.com/sqlfluff/sqlfluff/pull/3467) [tunetheweb](https://github.com/tunetheweb)
* SparkSQL: Support for the Delta `DESCRIBE DETAIL` command [3465](https://github.com/sqlfluff/sqlfluff/pull/3465) [R7L208](https://github.com/R7L208)

New Contributors

* [PeterBalsdon](https://github.com/PeterBalsdon) made their first contribution in [#3471](https://github.com/sqlfluff/sqlfluff/pull/3471)
* [hgranthorner](https://github.com/hgranthorner) made their first contribution in [#3483](https://github.com/sqlfluff/sqlfluff/pull/3483)
* [emancu](https://github.com/emancu) made their first contribution in [#3488](https://github.com/sqlfluff/sqlfluff/pull/3488)
* [judahrand](https://github.com/judahrand) made their first contribution in [#3502](https://github.com/sqlfluff/sqlfluff/pull/3502)
* [f0rk](https://github.com/f0rk) made their first contribution in [#3384](https://github.com/sqlfluff/sqlfluff/pull/3384)
* [zidder](https://github.com/zidder) made their first contribution in [#3499](https://github.com/sqlfluff/sqlfluff/pull/3499)
* [ThomAub](https://github.com/ThomAub) made their first contribution in [#3534](https://github.com/sqlfluff/sqlfluff/pull/3534)