Graphscope

We are thrilled to introduce a range of enhancements to GraphScope, with the GraphScope 0.23.0 release. This release encompasses significant features and improvements in Interactive Engine (GIE), GraphScope Flex, and Deployment.

We highlight the following improvements included in this release:

**1. GraphScope Flex Technical Preview**

GraphScope Flex represents the ongoing evolution of GraphScope. In this release, we're excited to introduce a technical preview of GraphScope Flex. It highlights a modular design that reduces resource and cost requirements while providing a seamless, user-friendly experience for flexible deployment. It's currently under active development, and we look forward to your feedback.

Key Features:
- **Modular Design**: Assemble your stack much like LEGO blocks to customize your graph computing deployments.
- **Three-Layer Architecture**: Components are organized into an application layer, execution layer, and storage layer.
- **Flexible Builds and Deployments**: Use the `flexbuild` script to build a custom deployment tailored for your specific use case.

You can explore GraphScope Flex in the `flex/` directory or through the released artifacts
- `graphscope_flex_db_cppsp_hiactor_mcsr`,
- `graphscope_flex_olap_builtin_grape-cpu`, and
- `graphscope_flex_gnn_gnnmodels_graphlearn_tensorflow_vineyard.so`

packages for high-QPS interactive queries, graph analytics, and graph learning task use cases, respectively. Dive in and discover what GraphScope Flex has to offer!

**2. Enhancements for GIE**

- Support the recording of both vertices and edges during path expansion. In the past, path expansion had the option to yield either all vertices or the end vertex of the path. However, due to the requirements of both Gremlin and our users, it's essential to also retrieve the edges of the path, besides the vertices. To activate this feature, use `with('RESULT_OPT', 'ALL_V_E')` in the path expansion syntactic sugar. Here is an example:

gremlin> g.V().out("1..3", "knows").with('RESULT_OPT', 'ALL_V_E')
==>[v[1], e[0][1-knows->2], v[2]]
==>[v[1], e[2][1-knows->4], v[4]]

- We are now happy to introduce the capability of querying Cypher in GIE, by integrating Neo4j's bolt service in our system. Please follow the [guide](https://graphscope.io/docs/latest/interactive_engine/neo4j/cypher_sdk) to enable bolt service (only on local) for querying with Cypher. We also attempt to make the syntax of Cypher as close as [openCypher](https://opencypher.org/), and the details of our support for Cypher can be found [here](https://graphscope.io/docs/latest/interactive_engine/neo4j/supported_cypher).

**3. Other enhancements and bug fixes**

- GAE Java
- Fix VertexSet's problem of supporting vertex_id in java long.
- Add Grape-GraphX performance report
- Fix the problem of installing grape-jdk locally.

Docker Image
--------------

shell
Coordinator Image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/coordinator:0.23.0

Graph Analytical Engine(GAE) Image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/analytical:0.23.0

Frontend component of Graph Interactive Engine(GIE) image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/interactive-frontend:0.23.0
Executor component of Graph Interactive Engine(GIE) image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/interactive-executor:0.23.0

Graph Learning Engine(GLE) Image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/learning:0.23.0

GraphScope persistent storage, user can only perform GIE query on it.
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/graphscope-store:0.23.0

Develop Image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/graphscope-dev:latest


What's Changed

- [7dcf1950b]: Change the version to v0.23.0 (2969) (Dongze Li)
- [731629732]: Introduce flexbuild and a readme to flex. (2954) (luoxiaojian)
- [d8ad6ce6c]: Install jdk 11 on MacOS CI and fixes the GAE link failure in nightly CI on MacOS (2965) (Tao He)
- [c27f45902]: Fixes two compliation warnings (2968) (Tao He)
- [bb1921eca]: Update the elementMap-step's doc of GIE (2966) (Dongze Li)
- [cb27df481]: Fixes nightly CI error for Arm Linux wheels (2963) (Tao He)
- [69258d995]: Fixes the "illegal thread local variable reference to regular symbol" error on macOS for GLE (2962) (Tao He)
- [1e2c8f62a]: [GIE Compiler] Unify Gremlin Timeout Configurations (2953) (Xiaoli Zhou)
- [46949638e]: Add setuptools to client requirement in order to use pyproject based build (2958) (Siyuan Zhang)
- [7fc14b5af]: [GIE Compiler] Support Case When Expression in Logical and Physical Plan (2918) (Xiaoli Zhou)
- [b82b74883]: Avoid implicit int to enum conversion, causing the -fpermissive error (2957) (Siyuan Zhang)
- [ad4aea19d]: Use the correct delete in free_graph_handle (2955) (Tao He)
- [21fd64430]: Sort the server list before iterate to keep consistent between workers (2956) (Tao He)
- [502e41030]: Parallelize the PrepareToRun implementation in projected fragment (2949) (Tao He)
- [5ffad661f]: Add two more pagerank variants (2950) (Siyuan Zhang)
- [a22247999]: Use pagerank_local_parallel rather than pagerank_local for better performance (2945) (Tao He)
- [92da63887]: Refine CI process (2948) (Siyuan Zhang)
- [555b13de8]: add figures for GraphScope Flex. (2946) (Jingbo Xu)
- [7035c0a44]: ElementMap step support (2942) (Dongze Li)
- [b6402e708]: cluster_builder.py: add missing copyright header and remove unused import lines (2944) (Tao He)
- [5b852ffe1]: Docs preview is only available for pull requests from the orignal repo, not forks (2943) (Tao He)
- [cab8cde5e]: Add GLE quick start example in the overview getting started page (2939) (LiSu)
- [badf3f3be]: hotfix: pull_request_target issue. (2941) (Jingbo Xu)
- [08f8d0f24]: Disable JAVA SDK (with a warning) when JNI not found (2937) (Tao He)
- [f543cd29e]: Improve the `deploy_with_existing_vineyard_cluster` doc for easy understanding (2930) (Ye Cao)
- [ae8d96c7d]: Show explicit error message for SSSP run over a graph with no edge weight (2929) (Lei Wang)
- [50c7a1e21]: Pin vineyard python version to 0.15.0 (2933) (Siyuan Zhang)
- [25496f8d5]: Connect to frontend directly, bypass coordinator for GIE query (2923) (Siyuan Zhang)
- [96d50939d]: [GIE Compiler] Parse Label Id to Name in `label` Operator (2928) (Xiaoli Zhou)
- [34b365028]: [GAE-Java] Use `FFI-bitset` rather than java BitSet for VertexSet backend (2926) (Zhang Lei)
- [f0a779e88]: [good-first-issue]Move `save_to/load_from` from client side to coordinator (2917) (Zhang Lei)
- [c1007cff5]: [GIE Compiler] Introduce cypher service to accept queries from neo4j ecosystem (2848) (Xiaoli Zhou)
- [7637aafb5]: [GIE] Refine FFI interface `build_physical_plan` (2911) (Xiaoli Zhou)
- [d0dc2b7c4]: Print metrics of application running time (2908) (Siyuan Zhang)
- [628773d80]: [Bug Fix] Fix bug of null pointer exception in `distinct` operator (2901) (Xiaoli Zhou)
- [0a44e711e]: Fixes the misuse of "continue-on-error" and "fail_ci_if_error". (2904) (Tao He)
- [612bd7f09]: Upload coverage: continue on error to avoid false negative on main branch (2903) (Tao He)
- [513155c30]: Upgrade the graphlearn submodule to fixes nightly CI, refactor the Makefile for early error exit (2902) (Tao He)
- [bd7680f2c]: Use CONFIG mode to find protobuf to address the absl dependency issue. (2899) (Tao He)
- [cf81c7b80]: [GAE-Java] Relax version enforce for some mvn dependencies (2894) (Zhang Lei)
- [b37ab9031]: [GIE Compiler] Add data type of algebra operator output to physical plan (2870) (Xiaoli Zhou)
- [79cd5770b]: Use local metadata backend to avoid the requirements of etcd for local sessions (2889) (Tao He)
- [7ef0e4d14]: fix munew line are not rendered correclty when multiple params are given (2891) (Siyuan Zhang)
- [fbf40f6dd]: Update the pre-genereated unload_op when the op itself been deepcopied (2888) (Tao He)
- [32089f285]: [Grape-Java] Add `grape-graphx` performance.md (2886) (Zhang Lei)
- [e4f1f23a3]: Allow pass params to gie instance (2885) (Siyuan Zhang)
- [17819c81f]: [BugFix] Fix bug in endV() after PathExpand (2881) (BingqingLyu)
- [a18836d5c]: [GIE Compiler] Support dynamic query params in cypher queries (2874) (Xiaoli Zhou)
- [ce3e16b2e]: [GAE/tests] Add GAE tests for FLASH algorithms of bfs and cc (2869) (Longbin Lai)
- [5a63fafa0]: upload log should not fail the CI (2879) (Siyuan Zhang)
- [559b084b6]: Direct the content of log files to stdout of pods in kubernetes deployment (2871) (Siyuan Zhang)
- [4af5689be]: add initial version of command-line tool `gsctl`. (2868) (Jingbo Xu)
- [7a3e06b56]: [GIE Doc] Update Doc for `PathExpand` Step Usage in GIE (2877) (BingqingLyu)
- [387f915f6]: Fixes the docs generation for tagged releases (2878) (Tao He)
- [c489c6381]: [BugFix] Make the error message truncated not so aggressive (2876) (Weibin Zeng)
- [e9af91a91]: [GIE] Support `PathExpand` with `OPT=ALL_V_E` in GIE (2841) (BingqingLyu)
- [37738891e]: Add a initializeCommand to `devcontainer.json`: always pull newer image before create container (2873) (Weibin Zeng)
- [086fa6362]: [GIE/docs] reorganize gremlin docs (2862) (Longbin Lai)
- [bd8952093]: Allow triggering workflow dispatch event for CIs (2865) (Ke Meng)
- [a0b36eeef]: [GIE Doc] Add examples to collect gremlin results in a streaming way (2842) (Xiaoli Zhou)
- [5fd6cc173]: Fixes the inconsistent usage of msgpack/json in graph reporter and avoid protobuf message creation in __del__ (2843) (Tao He)
- [434acdfea]: Fix dns search error in groot (2850) (Siyuan Zhang)
- [9bf071cf3]: auto-gen docs of flex (2851) (ds-ssj)
- [6851cd9fc]: allow null value in data loading (2845) (Siyuan Zhang)
- [1ba61029e]: [GIE Compiler] Introduce `GraphPlanner` to unify logical and physical plan building (2838) (Xiaoli Zhou)
- [a8b9dce78]: [GAE-Java] Use maven-flatten-plugin to replace revision property for locally build&install (2840) (Zhang Lei)
- [3c4cd9d98]: Fix compile error for the flash bc algorithm on ubuntu (2839) (lixueclaire)
- [0de3063f1]: use -O3 instead of -O0 in customized algo compilation (2837) (Siyuan Zhang)
- [9a265dcd1]: [GIE/Runtime] Redesign `PartitionerInfo`, `ClusterInfo`, and `Router` trait to better support parallel processing in Runtime (2744) (BingqingLyu)
- [653823b88]: [GIE/tests] Add pattern matching test cases for GIE (2831) (lixueclaire)
- [30e45e0ed]: [GIE Compiler] Unify execution client which is used to send request to remote engine service (2818) (Xiaoli Zhou)
- [f46941564]: Remove unused ports in Groot deployment (2832) (Siyuan Zhang)
- [d75ba7b26]: Add coordinator as the Ownerreferces of frontend deployment. (2830) (Ye Cao)
- [ec218cf3d]: [GIE Compiler] Fix query params of getV base in path expand operator (2773) (Xiaoli Zhou)
- [e28faa991]: Change version to 0.23.0 for daily release (2828) (Dongze Li)
- [4535bc34b]: Fixes errors during macos M1 CI (2827) (Tao He)
- [9f2334c68]: [GIE/docs] Add gie glossary and quick start (2821) (Longbin Lai)

We are delighted to bring a number of improvements to GraphScope, alongside the GraphScope 0.22.0 release. This release contains many important features and enhancements to Interactive Engine (GIE) and Deployment. Now the user can try GraphScope under the Linux Arm64 platform by `pip3 install graphscope`.

We highlight the following improvements included in this release:

**1. Enhancements for GIE**
- We have provided a utility for users to easily develop and test GIE on a local machine. Basically, users can run three parts of integration tests using the `gs` command line tool, including the official gremlin test, auxiliary pattern match test, and ldbc complex interactive workload on ldbc social network scale factor 1. In addition, users are allowed to locally start a frontend and an executor, where the former exposes an endpoint to easily integrate with the official gremlin console, and the latter is responsible for executing queries. Details can be found in the [documentation](https://graphscope.io/docs/latest/interactive_engine/dev_and_test).

**2. Enhancements for Deployment**
- User can try GraphScope under the **Linux Arm64** platform by `pip3 install graphscope`
- All images are now switched to ubuntu-based.
- Add a `devcontainer.json` for users to quickly get started.
- Use vineyardctl to install vineyard as the sidecar container.
- Support to deploy the engines of GraphScope on demand in the `lazy` mode.

**3. Other enhancements and bug fixes**
- Support to store and restore graphs from/to persistent storage on the kubernetes cluster. Details can be found in the guide: https://graphscope.io/docs/latest/deployment/persistent_storage_of_graphs_on_k8s.
- Add an end-to-end example about training over vineyard graphs using GLE
- Fixes the incorrect problem of results in python algorithm with PIE model under the session's parameter `num_workers=1`
- We have fixed a bug of GIE related to using `match` step with a `not`-existed edge, for which it should be executed via `anti join`, but it returned unexpected error "the first sentence of `MergedSentence` must have InnerJoin" instead.
groovy
g.V().match(
__.as("a").in().as("b"),
__.as("b").out().as("c"),
__.not(__.as("c").out().as("a")) `not`-exsited edge
)

Now such kind of query can be executed without issue.
- Fixes the bug of incorrect results when dedup edges on a partitioned graph in GIE, e.g.,
groovy
g.V().outE().dedup()

Now it can output expected results.

Docker Image
--------------

shell
Coordinator Image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/coordinator:0.22.0

Graph Analytical Engine(GAE) Image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/analytical:0.22.0

Frontend component of Graph Interactive Engine(GIE) image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/interactive-frontend:0.22.0
Executor component of Graph Interactive Engine(GIE) image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/interactive-executor:0.22.0

Graph Learning Engine(GLE) Image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/learning:0.22.0

GraphScope persistent storage, user can only perform GIE query on it.
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/graphscope-store:0.22.0

Develop Image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/graphscope-dev:latest


What's Changed

- [99c9d15d2]: Fixes the GAE fork issue with openmpi (2820) (Tao He)
- [ba359967a]: [GLE Doc] complete the build and install details of learning engine (2815) (LiSu)
- [7af925532]: Fixes some failures in nightly CI (2817) (Tao He)
- [0b220536d]: Support to install deps for Alibaba Cloud Linux in the gs bash utility (2816) (Ye Cao)
- [28a360593]: Cleanup space in CI (2814) (Siyuan Zhang)
- [3f50d7d3e]: Update dev_guide.md: change the link to learning engine to a correct one. (2813) (Taoshu)
- [035036b2c]: disable debug-assert in groot (2811) (Siyuan Zhang)
- [57b22febf]: Groot schema now supports add comment (2802) (Siyuan Zhang)
- [43493ce11]: Fixes bug when building docs from pull requests (2810) (Tao He)
- [302b02877]: Support to backup and recover the specific graphs via vineyardctl (2771) (Ye Cao)
- [d49d0edb7]: docs: update rst-versions style, defaults default version to latest, and fixes the zh/en indexing (2803) (Tao He)
- [9efd4f672]: Add local python script path to PATH (2804) (Tao He)
- [9d5d968e7]: [Docs/GIE] add tinkerpop ecosystem (2784) (Longbin Lai)
- [278a24c79]: Adapt to latest vineyard for varint encoding in CSR (2791) (Tao He)
- [f1b216cc7]: Support users to only input the kubeconfig path for connecting the k8s cluster (2799) (Ye Cao)
- [33e300721]: Correct the version of built wheel (2798) (Siyuan Zhang)
- [191949b18]: Fixes the graphdef value when constructing graphs from vineyard_id. (2793) (Tao He)
- [699ffbe57]: [k8s]Support deploying vineyard cluster independently and deploy the engines on called (2710) (Ye Cao)
- [c1ef88582]: refine docs latest tag to make it ready as default. (2788) (Jingbo Xu)
- [e9090db36]: Refine doc for `dev and test` of analytical engine. (2787) (Jingbo Xu)
- [1e57650a0]: Read version number from the package in setup.cfg (2785) (Dongze Li)
- [09ead30e5]: [GLE docs] minor fixes (2783) (LiSu)
- [b014dad1f]: use kubectl cp --retries (2781) (Siyuan Zhang)
- [d2c7d2edb]: Fix typo in Makefile (2782) (Siyuan Zhang)
- [3606b857b]: Fixes the building failure of client wheel on Linux arm64 platform (2780) (Dongze Li)
- [fdc626ee4]: Use vineyardctl API to inject the vineyard sidecar (2612) (Ye Cao)
- [7fd430b3d]: [GraphProxy] refine implementation of LazyDetails (2766) (BingqingLyu)
- [4b24146d1]: [Bug Fix] fix the bug in implementation of `PartialEq` for `Edge` in GIE Runtime (2740) (BingqingLyu)
- [5b46a68bc]: Improve GetInnerVertex() by querying local fragment only (2772) (Songqing Zhang)
- [983a41e33]: Enable deploy groot on local environment (2769) (Siyuan Zhang)
- [2509958c4]: Make grape_engine help message more friendly (2774) (Siyuan Zhang)
- [e2943778e]: [GIE Dev Test] Refine GIE Dev and Test (2767) (Xiaoli Zhou)
- [bf8d7b096]: Generate pyi stubs for protobuf modules for better developer experience (2768) (Tao He)
- [6fc7db32f]: [Bug Fix] Fix the alias of `GetV` of `ExpandBase` in `PathExpand`, an… (2763) (BingqingLyu)
- [a119c23b4]: Correct the python sssp result by setting generate_eid to false in load_p2p_network dataset (2762) (Dongze Li)
- [e4bb06903]: Make sure grape-engine exit when CTRL-C without crash (2761) (Tao He)
- [df1628425]: Store address offset of string properties with 48-bit unsigned intege… (2760) (luoxiaojian)
- [747df41cf]: Drop the environment switch in dev and test, and update gs (2754) (Siyuan Zhang)
- [46d7ed8bb]: Fixes duplicated run and upload actions for k8s-ci (2751) (Tao He)
- [3cf079817]: Propogate the k8s exception to avoid waiting forever (2747) (Tao He)
- [e6af69be1]: Ensure use string as log-level, even for logging.XXX (2745) (Tao He)
- [e969d0e4e]: [GIE Dev Test] Add docs for interactive dev test (2733) (Xiaoli Zhou)
- [ac7308e87]: [BugFix] add Metadata for `PathExpand` (2720) (BingqingLyu)
- [94ec2d895]: Updated license and notice. (2725) (Jingbo Xu)
- [8ab7b1b84]: Overhaul data-load-tools (2715) (Siyuan Zhang)
- [b03bc60ea]: Publish wheel packages on Linux arm64 platform nightly (2732) (Dongze Li)
- [1e63e8731]: [GIE/bug] fix a bug of matching with anti join (2730) (Longbin Lai)
- [1a8162090]: use javac to find the version of java (2728) (Siyuan Zhang)
- [51f92ac04]: Support to build wheel package on Linux aarch64 platform (2723) (Dongze Li)
- [1d3cd4a44]: refine retry logic to exponential backoff (2729) (Siyuan Zhang)
- [06f876920]: Fixes the installation prefix for nightly linux CI (2727) (Tao He)
- [662014fcc]: Opt-out zstd in features when requiring rocksdb (2722) (Tao He)
- [0a5c14410]: set timeout of rt_admin to 1 minute. (2719) (luoxiaojian)
- [fb79c6211]: Bump up graph-learn submodule version (2716) (Tao He)
- [7a5ed1344]: add docs for using dev container and fix typo (2711) (Siyuan Zhang)
- [5bd90ba10]: Requires correct version of graphscope_client in coordinator to avoid diverage (2708) (Tao He)
- [10a6488de]: Introduce the new version of kubernetes log exporter for dumping logs during a period of time such as pytest (2706) (Ye Cao)
- [e447cd5cd]: Fixes the linux wheel install prefix (2707) (Tao He)
- [f476c5736]: Fixes the 'sudo' in dockerfile for gss image (2704) (Tao He)
- [3b11b77ff]: Build wheels for macOS m1 (2701) (Tao He)
- [446b6601d]: [LICENSE] add dependency licenses for calcite and antlr (2699) (Xiaoli Zhou)
- [52b1ee29e]: Fixes the initialization of paramters in load_from() (2698) (Tao He)
- [d4b72fd97]: Display stderr logs as expected on K8s (2696) (Tao He)
- [6da5c3112]: Add version info for making interactive (2685) (Siyuan Zhang)
- [6dd3af29b]: Implemented 3-retries, added detailed logs for insert queries, and unified bulk-load and recovery. (2691) (luoxiaojian)
- [03165eb94]: [FEAT][GraphAr] Add API to python client to enable loading graph from gar files or archive graph to gar files (2588) (Weibin Zeng)
- [c2cb28678]: Export the k8s logs of graphscope helm test and upload to artifact when the helm test failed (2683) (Ye Cao)
- [81230c586]: Add prepare-commit-msg (2688) (Siyuan Zhang)
- [90b7e0049]: Update install-hook.sh (Wenyuan Yu)
- [ff9582e37]: Create install-hook.sh (2687) (Wenyuan Yu)
- [909b3c4d0]: [GIE/Runtime] Remove the dependency of GIE Runtime on GlobalQueryStore to accelerate the compilation (2681) (BingqingLyu)
- [a46663e52]: Clearify the requirements for MacOS (2684) (Tao He)
- [25a70f127]: Preload searchindex.js in background to optimize the search experiences (2682) (Tao He)
- [b258999b0]: Bump up vineyard to v0.14.5 (2676) (Siyuan Zhang)
- [ff5809e06]: Use different default value for vineyard_shared_memory on k8s and local (2678) (Tao He)
- [a38f41439]: enable auth for realtime write (2674) (Siyuan Zhang)
- [4225cb1c7]: Use ubuntu-base to build out production images. Add another `wheel` tag dedicated for building wheels. (2607) (Siyuan Zhang)
- [8168275e5]: Improve the error message when passing unexpected arguments to `g.project()` (2667) (Tao He)
- [5646ce2ea]: Document how to install scipy on M1 MacOS. (2666) (Tao He)
- [b4caf8f06]: [GAE] Fix overflow of MPI_Isend()'s data size (2665) (Songqing Zhang)
- [5c0ad71cc]: Upgrade protobuf/grpc, use newer macos builder, fixes bugs in local launcher where vineyardd may fail, use latest black as formatter (2650) (Tao He)
- [25593331c]: temporarily fix the urllib3 2.0.0 incompatible with openssl (2662) (Siyuan Zhang)
- [57dba68e6]: Tune kafka and grpc maximum message size (2661) (Siyuan Zhang)
- [1f0b8b91e]: Implemented the init version of Flex. (2660) (luoxiaojian)
- [35b148c0c]: Update the GLE submodule to include the latest updates (2643) (LiSu)
- [7fc0a1522]: Change version to 0.22.0 for daily release (2658) (DongZe Li)
- [21bdae33c]: add export CMAKE_PREFIX_PATH (2655) (Siyuan Zhang)

New Contributors
* wenyuanyu made their first contribution in https://github.com/alibaba/GraphScope/pull/2687
* TaoLbr1993 made their first contribution in https://github.com/alibaba/GraphScope/pull/2813

**Full Changelog**: https://github.com/alibaba/GraphScope/compare/v0.21.0...v0.22.0

We are delighted to bring a number of improvements to GraphScope, alongside the GraphScope 0.21.0 release. This release contains many important features and improvements to GraphScope. The Graph Learning Engine (GLE) now supports the 'SubGraphSampler' and 'RandomWalk' operators and adds a node labeling-based SEAL and node2vec model. Also, GLE supports node cache for accelerating distributed feature lookup. This release also adds a 'devcontainer.json' for users to easily set up a developing environment using VSCode.

We highlight the following improvements included in this release:

- **Enhancements for GLE:**
a. Add operators: SubGraphSampler, RandomWalk
b. Add node labeling based SEAL model, node2vec model.
c. Support temporal graph with the timestamp, and add TokTimestampSampler operator.
d. Add temporal models: TGN and TGAT.
e. Support node cache for accelerating distributed feature lookup.

- **Enhancements for Dev:**
a. Add a devcontainer.json for users to easily set up a developing environment using vscode.

- **Other enhancements and bug fixes:**
a. 'helm install graphscope/graphscope' would now launch all pods upon the start.
b. Allowing more fine-grained control over Groot deployment
c. Fixed an error of 'lgraph' that could cause the building failure in M1 Mac

Docker Image
--------------

shell
Coordinator Image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/coordinator:0.21.0

Graph Analytical Engine(GAE) Image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/analytical:0.21.0
Graph Analytical Engine(GAE) Image with java SDK, which supports running Giraph and GraphX algorithms on it.
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/analytical-java:0.21.0

Frontend component of Graph Interactive Engine(GIE) image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/interactive-frontend:0.21.0
Executor component of Graph Interactive Engine(GIE) image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/interactive-executor:0.21.0

Graph Learning Engine(GLE) Image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/learning:0.21.0

GraphScope persistent storage, user can only perform GIE query on it.
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/graphscope-store:0.21.0

Develop Image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/graphscope-dev:latest


What's Changed
* Fix docs images not shown by doudoubobo in https://github.com/alibaba/GraphScope/pull/2519
* Fix GAE catalog by doudoubobo in https://github.com/alibaba/GraphScope/pull/2520
* [GIE/Doc] Add initial design docs of GIE by longbinlai in https://github.com/alibaba/GraphScope/pull/2518
* Fix dataset env is not used error by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2525
* add intro.md by yecol in https://github.com/alibaba/GraphScope/pull/2521
* [Docs/GIE] Add doc for getting started with GIE by longbinlai in https://github.com/alibaba/GraphScope/pull/2527
* Fix: Gremlin startup error when k8s release name contains' - '. 2524 by YANGBoSunning in https://github.com/alibaba/GraphScope/pull/2526
* [GAIA CI Tests] Unify gremlin ci tests under different storages by shirly121 in https://github.com/alibaba/GraphScope/pull/2504
* proofread and enhanced by cursor.so/chatgpt. by yecol in https://github.com/alibaba/GraphScope/pull/2532
* Add deploy on local doc by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2523
* [GAIA Compiler] Build algebra layer structures for group and order in `GraphBuilder` by shirly121 in https://github.com/alibaba/GraphScope/pull/2508
* [GAIA Compiler] Refine error handling in antlr grammar by shirly121 in https://github.com/alibaba/GraphScope/pull/2530
* bump up scala version by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2533
* Add a CI step to avoid running the tmate session on the self-hosted machine by dashanji in https://github.com/alibaba/GraphScope/pull/2529
* Integrate vineyard operator python API with Graphscope by dashanji in https://github.com/alibaba/GraphScope/pull/2458
* [docs] Adds the documentation for storage/vineyard. by sighingnow in https://github.com/alibaba/GraphScope/pull/2536
* [docs] Optimize the embed read-the-docs to optimize the page loading. by sighingnow in https://github.com/alibaba/GraphScope/pull/2538
* Add GLE workload doc by LiSu in https://github.com/alibaba/GraphScope/pull/2537
* Minor fix by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2543
* [GIE] impl graph_proxy for csr_store by lnfjpt in https://github.com/alibaba/GraphScope/pull/2466
* fix chart download path by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2548
* [GIE Docker] Add env to build docker image of GIE running on vineyard storage by shirly121 in https://github.com/alibaba/GraphScope/pull/2547
* [Bug Fix] Fix bug in getting properties with `LateProject` strategy by BingqingLyu in https://github.com/alibaba/GraphScope/pull/2534
* [GAE/Docs] Improve GAE docs by doudoubobo in https://github.com/alibaba/GraphScope/pull/2550
* Make wheel name depends on platform name by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2551
* Bump up vineyard version to v0.13.4 to fixes the vineyard-graph-loader by sighingnow in https://github.com/alibaba/GraphScope/pull/2556
* `sh` doesn't have `source` by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2558
* Add document for groot by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2560
* [GIE/Docs] Add LDBC Tutorial by longbinlai in https://github.com/alibaba/GraphScope/pull/2562
* [Doc] Add documentation for getting started and dev with learning engine by goldenleaves in https://github.com/alibaba/GraphScope/pull/2557
* Pre-release 0.21.0 by lidongze0629 in https://github.com/alibaba/GraphScope/pull/2559
* [GIE Standalone] Add helm chart to deploy GIE on vineyard storage by shirly121 in https://github.com/alibaba/GraphScope/pull/2546
* [BugFix] Fix bug in GetV() when with specified label by BingqingLyu in https://github.com/alibaba/GraphScope/pull/2564
* [GIE docs] Fix minor issues of using the wrong directory of the Gremlin console by longbinlai in https://github.com/alibaba/GraphScope/pull/2573
* [GIE] Support `Until` condition in `PathExpand` by BingqingLyu in https://github.com/alibaba/GraphScope/pull/2514
* tips for reduce memory consumption by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2575
* [Doc] Add documentation for design of GLE: Overview and Architecture, Graph Sampling & Model Paradigms by husimplicity in https://github.com/alibaba/GraphScope/pull/2565
* [GIE Compiler & Runtime] Make lower bound of limit range start from 0 by shirly121 in https://github.com/alibaba/GraphScope/pull/2570
* [Doc] add grin docs under storage engine by andydiwenzhu in https://github.com/alibaba/GraphScope/pull/2563
* [Doc] Add the documentation for FLASH & Ingress by lixueclaire in https://github.com/alibaba/GraphScope/pull/2552
* [GIE] Support ExpandE+GetV in PathExpand and Match. by BingqingLyu in https://github.com/alibaba/GraphScope/pull/2572
* [GIE Compiler] Convert algebra layer structures to ir core logic plan by shirly121 in https://github.com/alibaba/GraphScope/pull/2568
* [Bug Fix] fix some bugs found in cypher e2e test by BingqingLyu in https://github.com/alibaba/GraphScope/pull/2579
* [GIE Compiler] Introduce planner framework `HepPlanner` and implement `FilterMatchRule` by shirly121 in https://github.com/alibaba/GraphScope/pull/2581
* [GIE Compiler] Define cypher grammar by `antlr` && support cypher service by shirly121 in https://github.com/alibaba/GraphScope/pull/2582
* Support reading HDFS files for GIE standalone deployment by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2580
* [GAE/WCC] Fix WCC' implementation on undirected graph by songqing in https://github.com/alibaba/GraphScope/pull/2586
* Use 0 as default glog_level to allow suppress `VLOG(1)` by sighingnow in https://github.com/alibaba/GraphScope/pull/2587
* Add the doc about how to deploy graphscope on existing vineyard cluster by dashanji in https://github.com/alibaba/GraphScope/pull/2555
* Add images for deployment doc. by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2589
* [Doc] Add guide and examples for GLE by LiSu in https://github.com/alibaba/GraphScope/pull/2585
* [GIE][Doc] Update GIE tutorial by MeloYang05 in https://github.com/alibaba/GraphScope/pull/2583
* [Doc] Add coding style guide and how to contribute guide by acezen in https://github.com/alibaba/GraphScope/pull/2542
* fix several broken links in docs, may due to directory reorganization by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2590
* Add document tutorial_dev_algo_cpp_pie.md by lidongze0629 in https://github.com/alibaba/GraphScope/pull/2541
* doc: add deploy graphscope with helm by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2592
* doc: add deployment with gae only by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2591
* Document how to install graphscope in offline mode by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2593
* [GAE] Integrate the FLASH model with GraphScope by lixueclaire in https://github.com/alibaba/GraphScope/pull/2554
* fix link grpc on mac m1 by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2597
* [Doc] Add documentation for GraphAr by lixueclaire in https://github.com/alibaba/GraphScope/pull/2578
* Add doc: How to find logs by lidongze0629 in https://github.com/alibaba/GraphScope/pull/2600
* doc: Add dev and test guides. by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2605
* [GIE Doc] Add the GIE FAQs document by shirly121 in https://github.com/alibaba/GraphScope/pull/2599
* fix typo of install_deps to install-deps by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2614
* update gs and fix test doc inconsistency by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2616
* issue2606 change decode error strategy compatible with cpp std::string by wuyueandrew in https://github.com/alibaba/GraphScope/pull/2622
* bump up gremlinpython version to enable usage in python 3.11 by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2623
* add grpc retry to channels by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2624
* Add a section to install virtual environment by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2627
* Allow finetune parameters for each statefulsets by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2625
* add simple devcontainers.json by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2629
* Fix some typos of GIE doc by dashanji in https://github.com/alibaba/GraphScope/pull/2630
* Add GART storage doc by doudoubobo in https://github.com/alibaba/GraphScope/pull/2615
* Refine docs. by yecol in https://github.com/alibaba/GraphScope/pull/2609
* Launch pods at the start of the coordinator by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2636
* Add a tip to the GAE document to remind users of potential errors. by dashanji in https://github.com/alibaba/GraphScope/pull/2638
* Prepare to release 0.21.0 by lidongze0629 in https://github.com/alibaba/GraphScope/pull/2637
* Find python path correctly by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2647

New Contributors
* husimplicity made their first contribution in https://github.com/alibaba/GraphScope/pull/2565
* andydiwenzhu made their first contribution in https://github.com/alibaba/GraphScope/pull/2563
* lixueclaire made their first contribution in https://github.com/alibaba/GraphScope/pull/2552

**Full Changelog**: https://github.com/alibaba/GraphScope/compare/v0.20.0...v0.21.0

We are delighted to bring a number of improvements to GraphScope, alongside the GraphScope 0.20.0 release. This release contains many important features and improvements to the persistent graph store Groot, including load balance and failover mechanism. In addition, Graph Learning Engine (GLE) now supports the Aliyun ACK cluster.

We highlight the following improvements included in this release:

**1. Enhancements for GLE:**
- GLE could be launched and used to training on ACK cluster.

**2. Enhancements for Groot:**
- Chart is refactored and has more customizable fields.
- LoadBalancher service is supported.
- Optimization of failover mechanism.

**3. Enhancement for images:**
- We release the first dev image (graphscope-dev) for arm64 platform.

Docker Image
--------------

shell
Coordinator Image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/coordinator:0.20.0

Graph Analytical Engine(GAE) Image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/analytical:0.20.0
Graph Analytical Engine(GAE) Image with java SDK, which supports running Giraph and GraphX algorithms on it.
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/analytical-java:0.20.0

Frontend component of Graph Interactive Engine(GIE) image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/interactive-frontend:0.20.0
Executor component of Graph Interactive Engine(GIE) image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/interactive-executor:0.20.0

Graph Learning Engine(GLE) Image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/learning:0.20.0

GraphScope persistent storage, user can only perform GIE query on it.
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/graphscope-store:0.20.0


What's Changed
* [GraphScope/Docs] Add docs for positioning GraphScope by longbinlai in https://github.com/alibaba/GraphScope/pull/2390
* Remove the java target directory before commit to gh-pages branch. by sighingnow in https://github.com/alibaba/GraphScope/pull/2393
* Fix the tag when releasing graphscope-store by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2392
* Add a mark to disable generated warnings. by sighingnow in https://github.com/alibaba/GraphScope/pull/2394
* Clean up and fix Java dependency problems by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2384
* [GIE/Runtime] Support `Entry` Trait in GIE/Runtime by BingqingLyu in https://github.com/alibaba/GraphScope/pull/2300
* [GIE/Docs] update path_expand examples in docs by shirly121 in https://github.com/alibaba/GraphScope/pull/2395
* [GLE/Docs]Add the GLE white paper in docs by LiSu in https://github.com/alibaba/GraphScope/pull/2399
* Add docs for GAE and other improvement by doudoubobo in https://github.com/alibaba/GraphScope/pull/2389
* [BUG Fix] fix bug when fetch properties of tags generated by a `Project` by BingqingLyu in https://github.com/alibaba/GraphScope/pull/2402
* Fix images not shown in docs. by doudoubobo in https://github.com/alibaba/GraphScope/pull/2404
* [GraphScope/Docs] Add overview of GIE by longbinlai in https://github.com/alibaba/GraphScope/pull/2403
* Find header under GRAPHSCOPE_HOME for learning by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2406
* refactor engine selection interface to enabled_engines by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2410
* test demo on helm by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2412
* Improve the message when docs CI running/succeed/failed for pull requests by sighingnow in https://github.com/alibaba/GraphScope/pull/2419
* No NPM cache when setup-node. by sighingnow in https://github.com/alibaba/GraphScope/pull/2420
* Improves the message and fixes the dist directory. by sighingnow in https://github.com/alibaba/GraphScope/pull/2421
* Don't upload docs if we are run on the fork. by sighingnow in https://github.com/alibaba/GraphScope/pull/2422
* Leverage graphscope cli to build docker, and add arm64 based images by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2341
* Reorg doc structures by doudoubobo in https://github.com/alibaba/GraphScope/pull/2427
* Fix bugs in docs by doudoubobo in https://github.com/alibaba/GraphScope/pull/2428
* [GIE/Physical] Introduce new physical operators (in proto) and physical plan builder by BingqingLyu in https://github.com/alibaba/GraphScope/pull/2411
* fix nightly CI by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2430
* fix helm installation with default configurations by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2433
* Add intro for fragment by doudoubobo in https://github.com/alibaba/GraphScope/pull/2434
* [GAIA Compiler] Introduce interfaces (GraphBuilder) to build compiler algebra layer by shirly121 in https://github.com/alibaba/GraphScope/pull/2432
* [GIE/Physical] Physical Layer: build physical plan and execution by BingqingLyu in https://github.com/alibaba/GraphScope/pull/2429
* fix bugs when launch gie on ack by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2441
* Revise docs for GAE by doudoubobo in https://github.com/alibaba/GraphScope/pull/2439
* [GraphScope/Docs] Provide GIE overview by longbinlai in https://github.com/alibaba/GraphScope/pull/2442
* Fixes the RPATH for inplace development for learning engine client. by sighingnow in https://github.com/alibaba/GraphScope/pull/2448
* fix gle on ack by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2445
* Update gle submodule to the latest version by LiSu in https://github.com/alibaba/GraphScope/pull/2450

We are glad to present the release of GraphScope 0.19.0, which brings a number of new features as well as performance and stability improvements to GraphScope. Specially, users can try GraphScope in **python3.10** **and python3.11** environments of Linux and MacOS by `pip3 install graphscope`; This release also optimizes the memory usage for loading graphs, which allows users to load larger graphs on their machines. In addition, we improve Graph Interactive Engine (GIE) via a couple of bug fixes and improvements.

We highlight the following improvements included in this release:

**1. Optimized memory usage for loading graphs:**
- Improves memory usage during loading and projecting graphs, especially for graphs with string as OID type.
- Improves the performance of `project_to_simple`.

**2. Bug fix and enhancements for GIE:**
- Fix a bug in Pegasus that may block the execution of interactive queries in certain case.
- Fix a bug that fails to configure the server number for the GIE engine.
- Fix multiple dependencies in both Java and Rust codes.
- Resolve a issue that JNA could not map bool correctly.

**3. Enhancements for GAE Java:**
- Pack JNI lib into the grape-runtime jar and fix some dependency issues.

**4. Standalone deployment:**
- Components now have their own dedicated image, and user could configure a subset of engines to use when launching `session`.

**5. Other bug fixes:**
- Fix helm deployment could not delete role and rolebindings when uninstalling GraphScope.
- Fix compile error under the newer toolchain and arrow 10
- Rename `maxgraph` to `graphscope` and other refactors
- Cleanup overlapping rust dependencies


Docker Image
--------------

shell
Coordinator Image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/coordinator:0.19.0

Graph Analytical Engine(GAE) Image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/analytical:0.19.0
Graph Analytical Engine(GAE) Image with java SDK, which supports running Giraph and GraphX algorithms on it.
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/analytical-java:0.19.0

Frontend component of Graph Interactive Engine(GIE) image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/interactive-frontend:0.19.0
Executor component of Graph Interactive Engine(GIE) image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/interactive-executor:0.19.0

Graph Learning Engine(GLE) Image
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/learning:0.19.0

GraphScope persistent storage, user can only perform GIE query on it.
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/graphscope-store:0.19.0



What's Changed
* Upgrade vineyard to v0.11.0 by sighingnow in https://github.com/alibaba/GraphScope/pull/2260
* [BUG] Fix bug in Pattern Match when project properties by BingqingLyu in https://github.com/alibaba/GraphScope/pull/2257
* [GIE POM] Ignore the poms generated by maven-flatten-plugin in git by shirly121 in https://github.com/alibaba/GraphScope/pull/2272
* Move the theme to furo, and add some markdown examples. by sighingnow in https://github.com/alibaba/GraphScope/pull/2291
* [docs CI] Choose stable/latest tag correctly by fixing the missing `$` in bash script by sighingnow in https://github.com/alibaba/GraphScope/pull/2293
* Don't delete the existing docs, if don't copy. by sighingnow in https://github.com/alibaba/GraphScope/pull/2294
* Pre-release v0.19.0 by lidongze0629 in https://github.com/alibaba/GraphScope/pull/2276
* Make sure reconnect behaves as expected by sighingnow in https://github.com/alibaba/GraphScope/pull/2297
* Add a write options to enable adding header row to OSS output by sighingnow in https://github.com/alibaba/GraphScope/pull/2296
* Support write string ids/context datas to OSS via vineyard by sighingnow in https://github.com/alibaba/GraphScope/pull/2295
* Use a self-hosted public image to avoid reaching the download limits by sighingnow in https://github.com/alibaba/GraphScope/pull/2308
* Enable plug udf cpp pregel algorithm to graphscope. by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2312
* add structure of the next-gen docs. by yecol in https://github.com/alibaba/GraphScope/pull/2315
* Fix return type of cython combine by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2314
* Disable dark theme even the browser is dark by sighingnow in https://github.com/alibaba/GraphScope/pull/2316
* Fixes: it is not a template by sighingnow in https://github.com/alibaba/GraphScope/pull/2318
* fix nightly networkx forward ci by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2319
* Fix outdated vineyard version by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2323
* Fix helm could not delete role and rolebindings when uninstalling GS by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2324
* fix connect session logic and wait for gae ready by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2326
* [GAE-Java] Automatically load `grape_jvm_opt` when create jvm instances through JNI by zhanglei1949 in https://github.com/alibaba/GraphScope/pull/2327
* Fix `grape-demo` shaded dependencies issue by zhanglei1949 in https://github.com/alibaba/GraphScope/pull/2229
* Accept a filetype arguments in loader for reading orc/parquet using prefix by sighingnow in https://github.com/alibaba/GraphScope/pull/2332
* Upgrade the fragment loader to reuse vineyard components by sighingnow in https://github.com/alibaba/GraphScope/pull/2331
* Launch engines with each components inside their own container. by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2247
* Fix kafka version by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2336
* fix nightly CI and remove redundant comments by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2340
* Fixes CI by lidongze0629 in https://github.com/alibaba/GraphScope/pull/2343
* Fix k8s volumes in helm installation and a bug in get_service_endpoint by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2346
* template helm charts before install by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2348
* Use ownerReferences to replace finalizers during helm uninstall by dashanji in https://github.com/alibaba/GraphScope/pull/2350
* Update the CI badge in README. by sighingnow in https://github.com/alibaba/GraphScope/pull/2353
* Fixes compilation errors on Mac with LLVM. by sighingnow in https://github.com/alibaba/GraphScope/pull/2352
* Add docs for data scientists by doudoubobo in https://github.com/alibaba/GraphScope/pull/2339
* Add Java tutorial by zhanglei1949 in https://github.com/alibaba/GraphScope/pull/2320
* [GraphScope/docs]Add basic and featured functionalities by LiSu in https://github.com/alibaba/GraphScope/pull/2335
* Fix compile error under newer toolchain and arrow 10 by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2355
* Add ownerreferences to all subresources created by coordinator by dashanji in https://github.com/alibaba/GraphScope/pull/2356
* Fixes the hangs up issue in Python test by sighingnow in https://github.com/alibaba/GraphScope/pull/2354
* [GAE-Java] Pack JNI lib `libgrape-jni.so` into `grape-runtime.jar` by zhanglei1949 in https://github.com/alibaba/GraphScope/pull/2330
* Fixes the dependentbot warnings in coordinator by sighingnow in https://github.com/alibaba/GraphScope/pull/2363
* Fix GAE v6d test with arrow projected fragment by songqing in https://github.com/alibaba/GraphScope/pull/2345
* Fix missing header files by songqing in https://github.com/alibaba/GraphScope/pull/2360
* Implement ToArrowArrays method for TensorContext by acezen in https://github.com/alibaba/GraphScope/pull/2351
* fix pytest warnings and install necessary plugins by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2338
* fix building learning engine in CXX 17 by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2364
* OpenMPI: bind to none to leverage all cores for when there are 2 processes by sighingnow in https://github.com/alibaba/GraphScope/pull/2365
* rename maxgraph to graphscope and other refactors by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2367
* Some minor improvement in logs and configurations of groot. by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2371
* Documentation enhancement by yecol in https://github.com/alibaba/GraphScope/pull/2358
* Remove pegasus.server.num and use pegasus.hosts by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2372
* Fix images not shown in docs by doudoubobo in https://github.com/alibaba/GraphScope/pull/2373
* Install myst-parser for markdown pages. by sighingnow in https://github.com/alibaba/GraphScope/pull/2374
* [pegasus] fix operator blocking by lnfjpt in https://github.com/alibaba/GraphScope/pull/2347
* [GIE Doc] Add Tutorials for Gremlin Users by shirly121 in https://github.com/alibaba/GraphScope/pull/2369
* upgrade vineyard version to v0.11.4 by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2375
* cleanup overlapping rust dependencies and bump up some to latest version by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2377
* Resolve a issue that JNA could not map bool correctly by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2376
* [GAE-Java] Remove some dummy java dep in gae java by zhanglei1949 in https://github.com/alibaba/GraphScope/pull/2380
* Upgrade graphlearn to latest for Python 3.11 by sighingnow in https://github.com/alibaba/GraphScope/pull/2382
* Optimize the memory usage of certain graphs by sighingnow in https://github.com/alibaba/GraphScope/pull/2381
* Fixes the performance issue in `Project()` by sighingnow in https://github.com/alibaba/GraphScope/pull/2383
* add graphscope executive script `gs` by siyuan0322 in https://github.com/alibaba/GraphScope/pull/2388
* [Benchmark Doc] add gae benchmark results in doc by BingqingLyu in https://github.com/alibaba/GraphScope/pull/2386
* Build wheel package on python3.10 and python3.11 by lidongze0629 in https://github.com/alibaba/GraphScope/pull/2379

New Contributors
* LiSu made their first contribution in https://github.com/alibaba/GraphScope/pull/2335
* songqing made their first contribution in https://github.com/alibaba/GraphScope/pull/2345

**Full Changelog**: https://github.com/alibaba/GraphScope/compare/v0.18.0...v0.19.0

GraphScope persistent storage, user can only perform GIE query on it.
docker pull registry.cn-hongkong.aliyuncs.com/graphscope/graphscope-store:0.18.0


Commits
---------
- [6775658d7]: Push jupyter image nightly with the latest client (2266) (DongZe Li)
- [df9f6ebf3]: Fix nightly CI (2262) (Siyuan Zhang)
- [4f1777700]: Fixes CI failure both on Linux and MacOS (2244) (DongZe Li)
- [07efc740d]: [GIE/engine] Bug fix; (2250) (bmmcq)
- [5ea5b874a]: [GIE] Support parallel scan on ExpStore (2253) (BingqingLyu)
- [432e65c89]: [GIE] Make the version of GIE compiler consistent with the default value in interactive engine pom (2249) (shirly121)
- [2b7cf0050]: [GIE POM] Unify GIE version by the global flag 'revision' (2243) (shirly121)
- [71d61e3cf]: Reorganize for Makefiles and dockerfiles (2246) (Siyuan Zhang)
- [84f449c7c]: [GIE Runtime] Debug runtime op info on in a more clearly way (2226) (BingqingLyu)
- [f77627dd7]: Update the learning model to align with the latest graphlearn (2235) (Tao He)
- [1c4c1cd17]: [GIE/Store] Reduce memory footprint in `exp_store` (2245) (Longbin Lai)
- [e375f8d3d]: [GIE/Exp-Store] Optimize memory usage in loading graph data into `MutTopo`. (2242) (Longbin Lai)
- [8844e9027]: Fixes release graphscope-store image (2241) (Siyuan Zhang)
- [428c7855c]: [GIE/Engine]: add direct executor implementation; (2234) (bmmcq)
- [e071ce4eb]: add docs revision preview in CI (2237) (Jingbo Xu)
- [f52455078]: Enable cpplint in CI (2233) (Tao He)
- [330fe14a7]: Makes GAE compatible with latest arrow release (2232) (Tao He)
- [ed8604036]: Revise docs. (2231) (Jingbo Xu)
- [b4d7038da]: Fixes compilation error of graphx runner (2228) (Siyuan Zhang)
- [a11b45395]: Reorganize Dockerfile according to specification of standalone deployment (2227) (Siyuan Zhang)
- [dcaa38ac0]: [GIE/GLogue] rename Catalogue as GLogue (2224) (BingqingLyu)
- [aed1f1362]: [GIE/IR] Introduce a new strategy for pattern matching (2159) (BingqingLyu)
- [92f7da3a9]: Add two other version of wcc for compatiblity (2223) (Siyuan Zhang)
- [2fbc4ad7c]: Add local vertex map to arrow fragment and arrow projected fragment. (2212) (Siyuan Zhang)
- [cc5170434]: Fixes nightly CI on macOS (2219) (DongZe Li)
- [f21754fcc]: [GAE-Java] GRAPE JDK support Spark local mode for graphx (2216) (Zhang Lei)
- [ed33b08c6]: [BugFix] GAE JavaDoc not generated (2206) (Zhang Lei)
- [440572158]: Update the DefaultTag to .Chart.AppVersion (2210) (Ye Cao)
- [3ee05f77b]: [new FAQ] add network proxy related FAQ (2211) (Yifan Yuan)
- [09995bfa0]: Delegate parquet/orc files to vineyard io adaptors (2209) (Tao He)
- [7ecd75a47]: Delete all deployed resources without a extra rbac role when using helm unintsall (2208) (Ye Cao)
- [094e81d67]: [Bug Fix] Add default tag (.Chart.AppVersion) to graphscope-store (2205) (Ye Cao)
- [4279b8fc8]: [BugFix] make ResultCode in ir core ffi consistent with Compiler (2188) (BingqingLyu)
- [7cfe9a3fd]: [Bug Fix] Avoid throwing exception after processing grpc error from executor in compiler (2182) (shirly121)
- [abdd5c979]: [GAE-Java] Update doc (2199) (Zhang Lei)
- [8de000fd1]: [GAE-Java] Remove String-specialized FFI classes and Simplify Java MessageManager interface (2195) (Zhang Lei)
- [5a4312ded]: Fix failure in network forward CI (2204) (Siyuan Zhang)
- [773545142]: Fixes failures in nightly CI (2201) (Tao He)
- [264cbc8a2]: Log level can accept int and string ignore case (2200) (Siyuan Zhang)
- [fb12c7b12]: Fix slf4j version conflicts (2196) (Siyuan Zhang)
- [87b960232]: [GIE Deploy] Deploy GIE with exp or v6d in standalone mode by helm configuration management (2143) (shirly121)
- [ecd58a248]: Fix possible java sandbox protection. (2191) (Siyuan Zhang)
- [38a3781dc]: Enable HDFS tests in CI. (2175) (Tao He)
- [7fdcd2357]: [GAE-Java] Support `grape-graphx` running on yarn cluster and support multiple executor on one host (2185) (Zhang Lei)
- [f983bd672]: [GIE pegasus] Support cancelling query. (2168) (Neng Li)
- [26f03827e]: gss ci use lesser image size (2186) (Siyuan Zhang)
- [2b00169b9]: [GAE-Java] Fix GAE-Java driver app's message strategy specification (2178) (Zhang Lei)
- [f4dea3e74]: [OSPP] Spark RDD Reader for GraphScope (2103) (Issac-Newton)
- [cfb707dd7]: Enhance grpc finding in GAE cmake (2184) (Tao He)
- [25ab4664f]: Use pre-built llvm instead of build when making analytical docker (2183) (Siyuan Zhang)
- [79a08d3b9]: [GIE Compiler] update ResultCode to be consistent with ir core interface (2158) (shirly121)
- [74af74f00]: [GAE-Java] GraphX-on-GraphScope : remove `GraphXFragment` and related components (2123) (Zhang Lei)
- [49ae814f1]: [GAE-Java] Add necessary configurations in `pom.xml` to publish GRAPE jdk to maven central repo (2166) (Zhang Lei)
- [2821169a8]: Fix create interactive engine failure on helm installed graphscope (2171) (Siyuan Zhang)
- [89a4a218e]: [GAE-Java] GRAPE jdk submodules naming to same pattern (2163) (Zhang Lei)
- [321d93805]: Upgrade GitHub actions versions (2160) (Siyuan Zhang)
- [695cb9caa]: Reorganized coordinator and redesigned the logic to create engines. (2152) (Siyuan Zhang)
- [ea4ca1d0b]: fix src label and dst label of edge kinds may be empty (2153) (Siyuan Zhang)
- [1b312af5c]: Move the tolerances of graphscope-store charts to the global scope (2151) (DongZe Li)
- [37fa85ad4]: [GAE-Java] Speed up Java App runtime codegen& compiling (2150) (Zhang Lei)
- [733fda3d0]: [GIE IR] Add docker files to build images of GIE (using exp store) (2142) (shirly121)
- [0c5a4b55d]: [GAE-Java] Fix : can not compile the submodule of GAE Java SDK (2146) (Zhang Lei)
- [3220a7f03]: Fixes the conditions for GAE CI in PR and on main, add timeout for test_java_app.py (2148) (Tao He)
- [998e3615c]: Rename pegasus.hosts to network.servers for executor (2147) (Siyuan Zhang)
- [97eec7023]: Add pytest-timeout to requirements-dev.txt and fixes a deprecated warnings when running tests (2145) (Tao He)
- [3038b8970]: [GAE-Java] Introduce GrapeSkip to support generated method overloading (2144) (Zhang Lei)
- [77b4ec5c6]: [GAE-Java] Fix log4j jar missing in `grape-runtime` and java pie driver app's message strategy settable. (2140) (Zhang Lei)
- [7d351a2b5]: [IR Compiler] make gremlin server listen to 0.0.0.0 instead of localhost (2141) (shirly121)
- [759b7a5b0]: Server now use aks provided by client side (2132) (Siyuan Zhang)
- [5c963f583]: Update cluster.py to fix the bug that etcd selector could not work (2139) (changyi1223)
- [6d94c3fa0]: [Bug Fix] Fix bug in index_scan on Groot/Vineyard (2129) (BingqingLyu)
- [d4d942c51]: [Assembly] wait_servers_ready() instead of sleep 3s when start engine on vineyard (2136) (BingqingLyu)
- [2aa3cfc38]: Update commons-codec:commons-codec 1.11 to 1.13 (2119) (zhoumengyks)
- [6d3d6aada]: Update org.apache.kafka:kafka-clients 2.5.0 to 2.7.2 (2120) (zhoumengyks)
- [6d5d288fa]: Fixes the docstring rendering for GAE apps (2131) (Tao He)
- [950ed7ab7]: App now can carry cmake options, and enabled wcc on string oid. (2130) (Siyuan Zhang)
- [31829fd08]: [GIE/Runtime] Refine some error infos in Runtime (2113) (BingqingLyu)
- [d16b1b482]: Fixes configuration in dockerignore (2126) (Tao He)
- [71c37fecf]: Upgrade com.fasterxml.jackson.core:jackson-databind to version 2.14.0-rc1 (2122) (Siyuan Zhang)
- [ace93c53b]: [Pegasus] minor fix: avoid iter.next() when it is None in release (2112) (BingqingLyu)
- [5756de3dc]: Make gae CI invoked when CMakeLists.template changes (2101) (Zhang Lei)
- [b6d68bc61]: New predicate support (2086) (waruto)
- [eb393dab1]: Bump protobuf-java from 3.18.2 to 3.19.6 in /interactive_engine (2109) (dependabot[bot])
- [0b10f5c0f]: Bump protobuf-java from 3.18.2 to 3.19.6 in /interactive_engine/compiler (2111) (dependabot[bot])
- [b1132cc7c]: [ASoC] report for subtask (2107) (Haochen Shi)
- [751e3e7c6]: [GIE IR] Provide expr store ffi interfaces to encode and write data (2098) (shirly121)
- [91db0334b]: [IR Runtime] Support removing columns in `Record` via `Auxilia` in IR-Runtime (2085) (BingqingLyu)
- [e024c6549]: [GIE-IR] Fix the doc inconsistency issue of the legacy MaxGraph and the latest Gaia-IR. (2074) (shirly121)
- [cf7495c69]: Pre-release v0.18.0 (2104) (DongZe Li)
- [5aabc4dc0]: [IR Benchmark] Benchmark for BI queries on GIE-IR (2081) (BingqingLyu)
- [be1d7a864]: upgrade rocksdb-rust to 0.19.0 (2100) (Siyuan Zhang)


New Contributors
* Swthaochen made their first contribution in https://github.com/alibaba/GraphScope/pull/2107
* zhoumengyks made their first contribution in https://github.com/alibaba/GraphScope/pull/2120
* changyi1223 made their first contribution in https://github.com/alibaba/GraphScope/pull/2139
* Issac-Newton made their first contribution in https://github.com/alibaba/GraphScope/pull/2103
* YifanYuan3 made their first contribution in https://github.com/alibaba/GraphScope/pull/2211

**Full Changelog**: https://github.com/alibaba/GraphScope/compare/v0.17.0...v0.18.0