Taichi

Full changelog:
- [gui] GGUI 7/n: Vertex class, and kernels for updating VBO/IBO/texture (2797) (by **Dunfan Lu**)
- [Refactor] Make Layout an Enum class and move it away from impl.py (2774) (by **Yi Xu**)
- app context and swap chain (2794) (by **Dunfan Lu**)
- [Refactor] Move snode_tree_buffer_manager and llvm_runtime to private. (by **Ailing Zhang**)
- [Refactor] Move llvm_context_host/device to private. (by **Ailing Zhang**)
- [Refactor] Further cleanup Program constructor. (by **Ailing Zhang**)
- [Refactor] Move check_runtime_error to LlvmProgramImpl. (by **Ailing Zhang**)
- [Refactor] Simplify synchronize and materialize_runtime in Program. (by **Ailing Zhang**)
- [gui] GGUI 5/n: remove some stuff (2793) (by **Dunfan Lu**)
- [ci] Added gpu test timeout (2791) (by **Jiasheng Zhang**)
- [Vulkan] [test] Fix Vulkan CI test bug & Enable tests for Vulkan backend (2776) (by **Yu Chang**)
- [vulkan] Graphics Device API (2789) (by **Dunfan Lu**)
- [ci] Changed nightly tag from pre-release to post-release (2786) (by **Jiasheng Zhang**)
- [ci] Add Apple M1 buildbot (2731) (by **ljcc0930**)
- [Refactor] Move a few helpers in LlvmProgramImpl to private. (by **Ailing Zhang**)
- [Refactor] Cleanup llvm specific apis in program.h (by **Ailing Zhang**)
- [Ir] Clean up frontend ir for global tensor and local tensor (2773) (by **squarefk**)
- [Refactor] Only prepare sandbox for cc backend. (2775) (by **Ailing**)
- [gui] Remove DPI settings (2767) (by **Ye Kuang**)
- [Doc] Add instructions for how to use conda (2764) (by **Ye Kuang**)
- [Lang] Enable treating external arrays as Taichi vector/matrix fields (2727) (by **Yi Xu**)
- [Opt] [ir] Optimize offload (2673) (by **squarefk**)
- [Refactor] Add initialize_llvm_runtime_system to LlvmProgramImpl. (by **Ailing Zhang**)
- [Refactor] Add materialize_snode_tree to LlvmProgramImpl. (by **Ailing Zhang**)
- [Refactor] Move initialize_llvm_runtime_snodes to LlvmProgramImpl. (by **Ailing Zhang**)
- [Refactor] Move clone_struct_compiler_initial_context to LlvmProgramImpl. (by **Ailing Zhang**)
- [Refactor] Move is_cuda_no_unified_memory to CompileConfig. (by **Ailing Zhang**)
- [Refactor] Add maybe_initialize_cuda_llvm_context to LlvmProgramImpl. (by **Ailing Zhang**)
- [Refactor] Add get_snode_num_dynamically_allocated to LlvmProgramImpl. (by **Ailing Zhang**)
- [Refactor] Move print_memory_profiler_info to LlvmProgramImpl. (by **Ailing Zhang**)
- [Refactor] Move print_list_manager_info to LlvmProgramImpl. (by **Ailing Zhang**)
- [Refactor] Move runtime_query to LlvmProgramImpl. (by **Ailing Zhang**)
- [Refactor] Move get_llvm_context to LlvmProgramImpl. (by **Ailing Zhang**)
- [Refactor] Move preallocated_device_buffer into LlvmProgramImpl. (by **Ailing Zhang**)
- [Refactor] Move thread_pool into LlvmProgramImpl. (by **Ailing Zhang**)
- [Refactor] Move runtime_mem_info into LlvmProgramImpl. (by **Ailing Zhang**)
- [Refactor] Move llvm_runtime to LlvmProgramImpl. (by **Ailing Zhang**)
- [Refactor] Move llvm_context_device to LlvmProgramImpl. (by **Ailing Zhang**)
- [Refactor] Move llvm_context_host to LlvmProgramImpl. (by **Ailing Zhang**)
- [Refactor] Move snode_tree_buffer_manager into LlvmProgramImpl. (by **Ailing Zhang**)
- [Doc] Several dev install doc improvements. (2741) (by **Ailing**)
- [ci] Fix clang-format version to 10 (2739) (by **Ailing**)
- [Test] Unify tests decorators with ti.test() (2674) (by **squarefk**)
- [Doc] Fix --user in dev install instruction. (2732) (by **Ailing**)
- [test] Fix potential memory error when DecoratorRecorder hasn't been reset correctly (2735) (by **squarefk**)
- [ci] Fix GPU buildbot paths and configs (2728) (by **Yi Xu**)
- [ci] Reduce the number of python wheels built nightly (2726) (by **Jiasheng Zhang**)
- [ir] Internal function call now supports arguments and i32 return value (2722) (by **Yuanming Hu**)
- [vulkan] Fix dumb memory error (2721) (by **Bob Cao**)
- [refactor] Remove unneccessary constructor argument (2720) (by **saltyFamiliar**)
- [Misc] Add submodule Eigen (2707) (by **FantasyVR**)
- Pin yapf version to 0.31.0. (2710) (by **Ailing**)
- [vulkan] [test] Support full atomic operations on Vulkan backend (2709) (by **Yu Chang**)
- [Vulkan] Move vulkan to device API (2695) (by **Bob Cao**)
- [Doc] Update developer install doc to use setup.py. (2706) (by **Ailing**)
- [ci] Fixed pypi version (2708) (by **Jiasheng Zhang**)
- [Lang] Redesign Ndarray class and add ti.any_arr() annotation (2703) (by **Yi Xu**)
- [Bug] Close the kernel context when failing to compile AST (2704) (by **Calvin Gu**)
- [Doc] Add gdb debug instructions to dev utilities. (2702) (by **Ailing**)
- [vulkan] Better detect Vulkan availability (2699) (by **Yu Chang**)
- [benchmark] [refactor] Move fill() and reduction() into Membound suite, calculate the geometric mean of the time results (2697) (by **rocket**)
- [ci] Added taichi nightly auto release to github action (2670) (by **Jiasheng Zhang**)
- [Misc] Keep debug symbols/line numbers in taichi_core.so by setting DEBUG=1. (2694) (by **Ailing**)
- [vulkan] [test] Enable Vulkan backend on OS X (2692) (by **Yu Chang**)
- [Refactor] Remove is_release() in the codebase. (2691) (by **Ailing**)
- [doc] fix outdated links of examples in examples.md (2693) (by **Yu Chang**)
- [Refactor] Make is_release always True and delete runtime dep on TAICHI_REPO_DIR. (2689) (by **Ailing**)
- [CUDA] Save an extra host to device copy if arg_buffer is already on device. (2688) (by **Ailing**)
- [Refactor] Allow taichi_cpp_tests run in release mode as well. (2686) (by **Ailing**)
- [Refactor] Re-enable gdb attach on crash. (2687) (by **Ailing**)
- [Lang] Add a Ndarray class to serve as an alternative to dense scalar fields (2676) (by **Yi Xu**)
- [gui] GGUI 4/n: Vulkan GUI backend utils (2672) (by **Dunfan Lu**)
- [Test] Smarter enumerating features and raise exception when not supported (2679) (by **squarefk**)
- [vulkan] Querying features like a mad man (2671) (by **Bob Cao**)
- [IR] Support local tensor (2637) (by **squarefk**)
- [vulkan] Check that additional extensions are supported before adding them (2667) (by **Dunfan Lu**)
- [vulkan] [test] Fix bugs detected by tests & Skip unnecessary tests for Vulkan backend (2664) (by **Yu Chang**)

Full changelog:
- [ir] Improve ExternalTensorShapeAlongAxisStmt IR print result (2665) (by **Yu Chang**)
- [ci] Refined release procedures (2663) (by **Jiasheng Zhang**)
- [vulkan] More capabilities detection and enabling (2660) (by **Bob Cao**)
- [ci] Change build method of ci tests (2661) (by **Jiasheng Zhang**)
- [gui] GGUI 3/n: Add dependencies, interfaces, and backend-independent code (2650) (by **Dunfan Lu**)
- [lang] [refactor] Add a ExtArray class for external arrays (2651) (by **Yi Xu**)
- [ci] Enable torch tests during CI (2656) (by **Yi Xu**)
- [ci] Add cuda bin folder to PATH (2655) (by **Dunfan Lu**)
- [gui] GGUI 2/n: Add optional graphics queue, compute queue, and surface to EmbeddedVulkanDevice (2648) (by **Dunfan Lu**)
- [vulkan] Build and test Vulkan backend in CI (2647) (by **Ye Kuang**)
- [ci] Added changelog.py that does not depend on taichi (2649) (by **Jiasheng Zhang**)
- [gui] GGUI 1/n: Add necessary cuda structs/enums/functions (2645) (by **Dunfan Lu**)
- [vulkan] Use VulkanMemoryAllocator for memory allocation (2644) (by **Bob Cao**)
- Improved SPIRV-Tools library search on Linux (2643) (by **masahi**)
- [Lang] [refactor] Add Field classes for ti.field/ti.Vector.field/ti.Matrix.field (2638) (by **Yi Xu**)
- [ci] Fix mac release and integrate windows release into github (2641) (by **Jiasheng Zhang**)
- [misc] [doc] Rename some profiler APIs and add docstring, mark old names as deprecated (2640) (by **rocket**)
- [doc] Better CUDA out of memory messages (2172) (by **彭于斌**)
- [Refactor] Split transformer.py into StmtBuilder and ExprBuilder (Stage 2) (2635) (by **xumingkuan**)
- [bug] Fix missing ti.template() in rand_vector(n) in examples (2636) (by **xumingkuan**)
- [doc] meta: s/alone/along/ (2616) (by **Eric Cousineau**)
- [Bug] Fix osx release workflow. (2633) (by **Ailing**)
- [vulkan] Rename ManagedVulkanDevice to EmbeddedVulkanDevice (2578) (by **Ye Kuang**)
- [ci] Add slash benchmark command for performance monitoring (2632) (by **rocket**)

Full changelog:
- [Doc] Add docstring for AutoDiff part (2630) (by **ljcc0930**)
- [vulkan] Move SPIR-V type capabilities into VulkanCapabilities & fix compilation errors (2628) (by **Yu Chang**)
- [vulkan] Use native struct types when supported & fix performance (2621) (by **Bob Cao**)
- [vulkan] Dynamically load Vulkan (2623) (by **Dunfan Lu**)
- [vulkan] Fix vulkan rand (2622) (by **Dunfan Lu**)
- [benchmark] Add query_kernel_profiler_() and benchmark/misc for performance monitoring (2601) (by **rocket**)
- [vulkan] Detect Vulkan / SPIR-V version & enabling required features (2615) (by **Bob Cao**)
- [vulkan] Add SPIRV-Headers as a submodule (2608) (by **Ye Kuang**)
- [ci] Prevent clang OOM (2620) (by **Ye Kuang**)
- [IR] Init GlobalTensorElementExpression and PtrOffsetStmt (2543) (by **squarefk**)
- [Lang] [refactor] Move SNode property calculation from materialization time to construction time (2600) (by **Yi Xu**)
- [Doc] Add python docstring in misc/util.py (2599) (by **rocket**)
- [Doc] Fix typo of PR 2586 (2613) (by **ljcc0930**)
- [vulkan] Draft: Remove shaderc on Windows & Add spirv-tools's optimization (2605) (by **Bob Cao**)
- [Lang] Support to destroy a SnodeTree and manage the memory (2583) (by **ljss**)
- [Refactor] Split transformer.py into StmtBuilder and ExprBuilder (Stage 1) (2495) (by **xumingkuan**)
- [Doc] Add Python docstring for some operators (2586) (by **ljss**)
- [Doc] Doc string for common_ops.py (2611) (by **ljcc0930**)
- [Doc] Fix return type of Python Docstring in ops.py (2609) (by **Rachel Gu**)
- [Doc] Add Python docstrings for several APIs (2606) (by **Ye Kuang**)
- [doc] Add python docstring for gui.py (2604) (by **Jiasheng Zhang**)
- [Doc] Add Python docstring for functions in matrix.py, impl.py, util.py and ops.py (2602) (by **Mingrui Zhang**)
- [opengl] Work group reduction (2595) (by **Bob Cao**)
- [bug] [vulkan] Fix bugs in SPIR-V codegen exposed under Linux (2603) (by **Yu Chang**)
- [Docs] Add docs for Expr class and functions in linalg.py (2597) (by **squarefk**)
- [Refactor] Added axes() function in impl.py (2594) (by **cruedo**)
- [ci] Fix one tiny bug (2598) (by **Jiasheng Zhang**)
- [ci] Fix appveyor with new building procedure (2596) (by **Jiasheng Zhang**)
- [Doc] Add Python docstring in several places (2592) (by **Yi Xu**)
- [Doc] Add Python Docstring in ops.py (2593) (by **Rachel Gu**)
- [Doc] Add Python docstring for Matrix class (2587) (by **FantasyVR**)
- [bug] recursively include examples in distribution script (2591) (by **Andrew Sun**)
- [Vulkan] Add SPIR-V codegen on Vulkan backend (2582) (by **Yu Chang**)
- [Doc] Add python docstring for misc.image class (2589) (by **Yidong Ma**)
- [Misc] Ignore the warning when first time finalizing ti.root(). (2584) (by **ljcc0930**)
- [ci] Correct windows build and test in CI (2576) (by **Jiasheng Zhang**)
- [refactor] Correct a few indices->axes renamings (2577) (by **Ye Kuang**)
- [Doc] Add Python docstring for SNode (2580) (by **Ye Kuang**)
- [opengl] Use OpenGL window visible hint instead of hiding after creation (2581) (by **Bob Cao**)
- [Refactor] Renamed ti.Index to ti.Axis (2560) (by **cruedo**)
- [Perf] Reduce GL backend's overhead (driver overhead & copy overhead) (2532) (by **Bob Cao**)
- [IR] Update CHI example to match SNode API (2574) (by **bx2k**)
- [Lang] Change the data layout for vector fields with that needs grad (2575) (by **Dunfan Lu**)
- [Vulkan] Add Vulkan to Taichi (2573) (by **Ye Kuang**)
- [IR] Support "packed" mode where shape will not be padded to a power of two (2541) (by **Yi Xu**)
- [vulkan] Split into managed and reference devices (2570) (by **Ye Kuang**)
- [Metal] Change Aot module for handling template arguments (2529) (by **Rachel Gu**)
- [refactor] Cleaned taichi/core/settings related import (2567) (by **Jiasheng Zhang**)
- [vulkan] Add Vulkan launcher (2562) (by **Ye Kuang**)
- [Bug] Fix racing in llvm bc generation. (2569) (by **Ailing**)
- [ci] Quick fix: bugs in upload.py (2568) (by **Jiasheng Zhang**)
- [ci] Allow build specific commit when uploading, used new building procedure. (2563) (by **Jiasheng Zhang**)
- [vulkan] Add GLSL-based codegen for Vulkan (2557) (by **Ye Kuang**)

Highlights

Starting from this release, you can create new `ti.field` instances after invoking a kernel! 🎉 Note that this feature is currently supported on the CPU and the CUDA backend.

Full changelog:
- [refactor] remove global_program in kernel.cpp (2508) (by **ljcc0930**)
- [misc] Added palette in taichi GUI for circles (2504) (by **Jiasheng Zhang**)
- [lang] Support ti.fields with shape after materialized (2503) (by **ljcc0930**)
- [doc] Add a basic doc explaining how to run Taichi CPP tests (2502) (by **Ye Kuang**)
- [lang] Support ti.FieldsBuilder() (2501) (by **ljcc0930**)
- [misc] Add needs_grad property for SNode (2500) (by **ljcc0930**)
- [lang] Support fake FieldsBuilder() with same memory location (2493) (by **ljcc0930**)
- [ci] Fix appveyor (2496) (by **Ye Kuang**)
- [ir] Add some comments to implementation of CFG optimizations and analyses (2474) (by **xumingkuan**)
- [Doc] Add .md documentation (2494) (by **Taichi Gardener**)
- [Example] Refactor example library (2475) (by **Andrew Sun**)
- [Doc] Remove all .rst docs (2492) (by **Taichi Gardener**)
- [Refactor] [cuda] Cleanup CUDA AtomicOpStmt codegen (2490) (by **Dunfan Lu**)
- [Perf] [cuda] Use warp reduction to improve reduction performance (2487) (by **Dunfan Lu**)
- [vulkan] Add kernel metadata and utils (2481) (by **Ye Kuang**)
- [opengl] [refactor] Use macro to generate atomic float functions (2486) (by **xndcn**)

Full changelog:
- [ci] Fix docker prebuilt binary link (2483) (by **Ye Kuang**)
- [wasm] Implement materialize() for wasm backend and clean up unused functions (2480) (by **squarefk**)
- [misc] Unify std::filesystem header (2478) (by **Ye Kuang**)
- [opengl] Dump compute shader source code when print_kernel_llvm_ir is true (2479) (by **xndcn**)
- [metal] Fix randseedoffset_in_runtime_buffer (2477) (by **Ye Kuang**)
- [Metal] Support pointer SNode on Metal (2441) (by **Ye Kuang**)
- [wasm] Recover code (2476) (by **ljcc0930**)
- [AutoDiff] Automatically determine AdStack's size (2438) (by **xumingkuan**)
- [misc] Add checking of gitpython in cmake (2473) (by **xndcn**)
- [ci] Restrict slash-command-dispatch to PR only (2472) (by **Ye Kuang**)
- [ir] Use SNodeTree to implement root (2449) (by **Ye Kuang**)
- [Lang] Fix parameter conflict between ti.maybe_transform_ti_func_call_to_stmt() and ti.external_func_call() (2470) (by **squarefk**)

Full changelog:
- [ci] Fix docker caching issue (2468) (by **Ye Kuang**)
- [ci] Separate Win build and test steps (2465) (by **Ye Kuang**)
- [misc] Fix parameters' type. (2464) (by **ljcc0930**)
- [wasm] [aot] Support AOT on webassembly backend. (2461) (by **ljcc0930**)