Llama-cpp-cffi

Added:
- Support for default CPU tinyBLAS (llamafile, sgemm) builds.
- Support for CPU OpenBLAS (GGML_OPENBLAS) builds.

Changed:
- Build scripts now have separate step/function `cuda_12_5_1_setup` which setups CUDA 12.5.1 env for build-time.

Fixed:
- Stop thread in `llama_generate` on `GeneratorExit`.

Removed:
- `callback` parameter in `llama_generate` and dependent functions.

Added:
- `Model.tokenizer_hf_repo` as optional in case when `Model.creator_hf_repo` cannot be used to tokenize / format prompt/messages.

Added:
- Support for `stop` tokens/words.

Changed:
- `llama/llama_cli.py` unified CPU and CUDA 12.5 modules into single module.

Removed:
- Removed separate examples for CPU and CUDA 12.5 modules.

Changed:
- Updated `huggingface-hub`.

Fixed:
- `llama.__init__` now correctly imports submodules and handles CPU and CUDA backends.
- OpenAI: `ctx_size: int = config.max_position_embeddings if max_tokens is None else max_tokens`.

Fixed:
- Build for linux, upx uses best compression option, 7z uses more aggressive compression.
- Do not use UPX for shared/dynamic library compression.

Added:
- README: supported GPU Compute Capability for CUDA.

Fixed:
- Cleaned up `build.py`.
- Type annotations in OpenAI related code.