Mindsdb

Features, Improvements and Fixes:
- create prometheus dir if it doesnt exist https://github.com/mindsdb/mindsdb/pull/8991
- add default handlers to manifest and fix pip install test https://github.com/mindsdb/mindsdb/pull/8989
- agent behaves as model https://github.com/mindsdb/mindsdb/pull/8984
- Fix image tags https://github.com/mindsdb/mindsdb/pull/8979
- Add Local Ollama Model Support to Langchain Handler https://github.com/mindsdb/mindsdb/pull/8978
- Sets the 'success' Attribute of /<handler_name>/install Endpoint to False Upon Installation Failure https://github.com/mindsdb/mindsdb/pull/8977
- Add Support for Querying Agents via SQL https://github.com/mindsdb/mindsdb/pull/8856
- New /tabs routes https://github.com/mindsdb/mindsdb/pull/8898
- added ollama_serve_url argument to overwrite hardcoded default URL and validated linux compatability https://github.com/mindsdb/mindsdb/pull/8914
- Updated the Broken Dependencies for the BigQuery Handler https://github.com/mindsdb/mindsdb/pull/8910
- Github handler: all tables converted to APIResource https://github.com/mindsdb/mindsdb/pull/8940
- Del stream interface https://github.com/mindsdb/mindsdb/pull/8967
Documentation Updates:
- updated mindsdb editor image in docs https://github.com/mindsdb/mindsdb/pull/8982
- mindsdb sql updates for docs https://github.com/mindsdb/mindsdb/pull/8939
- updated docker docs https://github.com/mindsdb/mindsdb/pull/8938

- fixed docker image tag

Features, Improvements and Fixes:
* [ENH] Code and contextual QA formatters for LLM finetuning https://github.com/mindsdb/mindsdb/pull/8759
* Fixes for Issue 8565 https://github.com/mindsdb/mindsdb/pull/8567
* Refactor email handler https://github.com/mindsdb/mindsdb/pull/8794
* clean up docker/docker-compose and comment https://github.com/mindsdb/mindsdb/pull/8798
* Add 12labs handler to cloud https://github.com/mindsdb/mindsdb/pull/8804
* Improve email ingestion and handling in MindsDB https://github.com/mindsdb/mindsdb/pull/8803
* Added insert method for email campaigns table https://github.com/mindsdb/mindsdb/pull/8698
* Skills updates https://github.com/mindsdb/mindsdb/pull/8765
* Refactor docker bake file https://github.com/mindsdb/mindsdb/pull/8763
* Improve error message if model in 'error' status https://github.com/mindsdb/mindsdb/pull/8827
* Fix create ml engine https://github.com/mindsdb/mindsdb/pull/8830
* Fix `describe` of broken openai model https://github.com/mindsdb/mindsdb/pull/8829
* Fix: JOIN model with empty dataframe https://github.com/mindsdb/mindsdb/pull/8843
* PR for small fixes on hachaton https://github.com/mindsdb/mindsdb/pull/8833
* Fix `describe` for models with 'broken' ml_engines https://github.com/mindsdb/mindsdb/pull/8839
* Validate api key during OpenAI or Anyscale-endpoints ml_engine creation https://github.com/mindsdb/mindsdb/pull/8847
* Validate the timegpt token https://github.com/mindsdb/mindsdb/pull/8841
* Add multi environment deploy step https://github.com/mindsdb/mindsdb/pull/8836
* add deploy to staging when mergeing to staging branch https://github.com/mindsdb/mindsdb/pull/8852
* Fix show command https://github.com/mindsdb/mindsdb/pull/8849
* Adding icon.svg file for writer handler https://github.com/mindsdb/mindsdb/pull/8859
* Removed Non-integrations from the /handlers Endpoint https://github.com/mindsdb/mindsdb/pull/8862
* Fixed Several Unusable Handlers https://github.com/mindsdb/mindsdb/pull/8864
* Added Support for Summarization to the Twelve Labs Integration https://github.com/mindsdb/mindsdb/pull/8795
* Make Langchain Handler More Reliable https://github.com/mindsdb/mindsdb/pull/8844
* Add /completions POST Endpoint for Agent Completions https://github.com/mindsdb/mindsdb/pull/8850
* [ENH] Updates to langchain: version bump, observability https://github.com/mindsdb/mindsdb/pull/8785
* Getting anyscale key instead openai https://github.com/mindsdb/mindsdb/pull/8800
* Skills decoupling https://github.com/mindsdb/mindsdb/pull/8792
* Updated icons for TPOT and StatsForecast https://github.com/mindsdb/mindsdb/pull/8872
* Slack list messages updated https://github.com/mindsdb/mindsdb/pull/8796
* Don't pickle exception, wrap it https://github.com/mindsdb/mindsdb/pull/8866
* Make `langchain_community` dependency optional https://github.com/mindsdb/mindsdb/pull/8875
* Mark `files` handler as permanent https://github.com/mindsdb/mindsdb/pull/8879
* fix `github_tables` filtering https://github.com/mindsdb/mindsdb/pull/8881
* Make web handler optional https://github.com/mindsdb/mindsdb/pull/8880
* Twelvelabs Integration fixes https://github.com/mindsdb/mindsdb/pull/8883
* Fixed the Import of MatrixOneHandler in D0lt Handler https://github.com/mindsdb/mindsdb/pull/8886
* Fix last: one condition in view https://github.com/mindsdb/mindsdb/pull/8867
* Add auth flag in the config example https://github.com/mindsdb/mindsdb/pull/8888
* Anomaly detection process data bug https://github.com/mindsdb/mindsdb/pull/8897
* Fix warning about flask JSONEncoder deprecation https://github.com/mindsdb/mindsdb/pull/8869
* Init load tests https://github.com/mindsdb/mindsdb/pull/8730
* anthropic to use messages api (instead of legacy completions api) https://github.com/mindsdb/mindsdb/pull/8885
* Removed Icons as Determining Factor for Handler Import Status https://github.com/mindsdb/mindsdb/pull/8909
* Updated the Broken Dependencies for the BigQuery Handler https://github.com/mindsdb/mindsdb/pull/8910
* Add Support for Prometheus Metrics & Add New Handler Metrics https://github.com/mindsdb/mindsdb/pull/8899
* fix for email handler to work in jobs with last https://github.com/mindsdb/mindsdb/pull/8913
* Fix failing coveralls action https://github.com/mindsdb/mindsdb/pull/8917
* Fix `select connection_id()` https://github.com/mindsdb/mindsdb/pull/8920
* Added Improved Logos for Integrations https://github.com/mindsdb/mindsdb/pull/8854
* Add `jobs_history` to `log` db https://github.com/mindsdb/mindsdb/pull/8793
* Bump follow-redirects from 1.15.5 to 1.15.6 in /docs https://github.com/mindsdb/mindsdb/pull/8932
* Fix supported python versions for pip installs https://github.com/mindsdb/mindsdb/pull/8905
* Json operators support https://github.com/mindsdb/mindsdb/pull/8895
* fix setup limits https://github.com/mindsdb/mindsdb/pull/8937
* Add Prometheus Metrics for All API Endpoints https://github.com/mindsdb/mindsdb/pull/8904
* Include prometheus_metrics Dir in Dockerfile https://github.com/mindsdb/mindsdb/pull/8944

Documentation Updates:
* Typo "mbd" vs "mdb" https://github.com/mindsdb/mindsdb/pull/8736
* Update README.md - tweak messaging https://github.com/mindsdb/mindsdb/pull/8797
* [Docs] update mongo doc: replace `insert`->`insertOne`, `predictors`->`models https://github.com/mindsdb/mindsdb/pull/8802
* fixed api_key param names https://github.com/mindsdb/mindsdb/pull/8809
* added info to finetune commands https://github.com/mindsdb/mindsdb/pull/8808
* docs for evaluate by https://github.com/mindsdb/mindsdb/pull/8807
* update to rest api docs https://github.com/mindsdb/mindsdb/pull/8810
* docs rearranged and modified intro pages https://github.com/mindsdb/mindsdb/pull/8811
* Cleanup docs https://github.com/mindsdb/mindsdb/pull/8825
* added a note that create table needs database with write access https://github.com/mindsdb/mindsdb/pull/8832
* Update Anomaly detection docs https://github.com/mindsdb/mindsdb/pull/8834
* added eeg forecast tutorial https://github.com/mindsdb/mindsdb/pull/8835
* tutorial for learning hub https://github.com/mindsdb/mindsdb/pull/8837
* fixed query in tutorial https://github.com/mindsdb/mindsdb/pull/8840
* updated tutorials for learning hub https://github.com/mindsdb/mindsdb/pull/8845
* added data file to openai finetuning tutorial https://github.com/mindsdb/mindsdb/pull/8853
* update file link https://github.com/mindsdb/mindsdb/pull/8855
* fixed slack chatbot tutorial https://github.com/mindsdb/mindsdb/pull/8868
* Less redundant doc example https://github.com/mindsdb/mindsdb/pull/8873
* fixed github docs https://github.com/mindsdb/mindsdb/pull/8877
* fixed anthropic model names in docs https://github.com/mindsdb/mindsdb/pull/8884
* Update README.md https://github.com/mindsdb/mindsdb/pull/8887
* Update README.md https://github.com/mindsdb/mindsdb/pull/8889
* Update monkeylearn.mdx https://github.com/mindsdb/mindsdb/pull/8891
* Update README.md https://github.com/mindsdb/mindsdb/pull/8901
* updated middleware to platform https://github.com/mindsdb/mindsdb/pull/8894
* added links to use cases https://github.com/mindsdb/mindsdb/pull/8912
* update to docker docs https://github.com/mindsdb/mindsdb/pull/8916
* updated slack docs https://github.com/mindsdb/mindsdb/pull/8921
* Update MindsDB Installation for Development docs https://github.com/mindsdb/mindsdb/pull/8908
* updating ai engines doc pages https://github.com/mindsdb/mindsdb/pull/8799

Features, Improvements and Fixes:
- Fix args in test_predict_text_sentiment_openai_tutorial https://github.com/mindsdb/mindsdb/pull/8789
- Better error handling if exception can't be pickled https://github.com/mindsdb/mindsdb/pull/8729
- added rag handler param https://github.com/mindsdb/mindsdb/pull/8781
- Slack fixex https://github.com/mindsdb/mindsdb/pull/8782
- Fix getting api key https://github.com/mindsdb/mindsdb/pull/8786
- Add internal `log` database https://github.com/mindsdb/mindsdb/pull/8778
- Fix All Tests Under tests/unit https://github.com/mindsdb/mindsdb/pull/8662
- Stored MS Teams Redirect URI in Handler Storage https://github.com/mindsdb/mindsdb/pull/8766
- Corrected Use of Logger in LibSQL Handler https://github.com/mindsdb/mindsdb/pull/8769
- modify get_api_key util function and affected handlers https://github.com/mindsdb/mindsdb/pull/8245
- Datanode returns list of lists instead of dict https://github.com/mindsdb/mindsdb/pull/8745
- Fix getting api-key for openai finetune https://github.com/mindsdb/mindsdb/pull/8762
- Fix Twelve Labs indexing local file https://github.com/mindsdb/mindsdb/pull/8748
- [ENH] Improved data preparation for LLM finetuning https://github.com/mindsdb/mindsdb/pull/8692
- Mongodb handler tests https://github.com/mindsdb/mindsdb/pull/8470
- Save anomaly_detection files to storage https://github.com/mindsdb/mindsdb/pull/8724
- Minor Fix to the Put Config API Endpoint https://github.com/mindsdb/mindsdb/pull/8732
- Update APITable docs https://github.com/mindsdb/mindsdb/pull/8738
- Remove permanent for some ml handlers https://github.com/mindsdb/mindsdb/pull/8737
- Google_analytics is not permanent https://github.com/mindsdb/mindsdb/pull/8734
- [refactor] Migrate legacy OpenAI API https://github.com/mindsdb/mindsdb/pull/8541
- [fix] Minor finetune improvements https://github.com/mindsdb/mindsdb/pull/8727
- Show content in files by default https://github.com/mindsdb/mindsdb/pull/8731
- GITHUB handler update https://github.com/mindsdb/mindsdb/pull/8721
- Fix anyscale-endpoints finetune https://github.com/mindsdb/mindsdb/pull/8713
- Pass info about model target to planner https://github.com/mindsdb/mindsdb/pull/8722
- Postgres handler unit tests https://github.com/mindsdb/mindsdb/pull/8214
- Mssql handler unit tests https://github.com/mindsdb/mindsdb/pull/8317
- Mysql handler tests https://github.com/mindsdb/mindsdb/pull/8587
- Move lanchain skills to langchain handler. https://github.com/mindsdb/mindsdb/pull/8711
- Fixed: Whatsapp logger issue https://github.com/mindsdb/mindsdb/pull/8717
- Fix RAG post openai changes https://github.com/mindsdb/mindsdb/pull/8674
- Run all ML handlers methods via queue https://github.com/mindsdb/mindsdb/pull/8645
- Return tests with last to 8662 https://github.com/mindsdb/mindsdb/pull/8694
- [fix] Key error when exiting context handler https://github.com/mindsdb/mindsdb/pull/8710
- Move file test to acceptance tests https://github.com/mindsdb/mindsdb/pull/8697
- Fix mongodb parsing https://github.com/mindsdb/mindsdb/pull/8675
- added text-generation support to hf handler https://github.com/mindsdb/mindsdb/pull/8513
- PostgreSQL Integration improvments https://github.com/mindsdb/mindsdb/pull/8680
- [fix] Anyscale key getter https://github.com/mindsdb/mindsdb/pull/8693


Documentation Updates:
- Update Other Clouds Deployment Page https://github.com/mindsdb/mindsdb/pull/8788
- rag param update in docs https://github.com/mindsdb/mindsdb/pull/8780
- added anyscale docs https://github.com/mindsdb/mindsdb/pull/8779
- updated last keyword docs https://github.com/mindsdb/mindsdb/pull/8776
- updated intro docs https://github.com/mindsdb/mindsdb/pull/8775
- updated slack chatbot tutorial https://github.com/mindsdb/mindsdb/pull/8772
- Update twitter-chatbot.mdx to use LAST https://github.com/mindsdb/mindsdb/pull/8750
- updated mindsdb intro https://github.com/mindsdb/mindsdb/pull/8770
- Update README.md with the new messaging https://github.com/mindsdb/mindsdb/pull/8768
- updates to integrations doc pages https://github.com/mindsdb/mindsdb/pull/8758
- updated neuralforecast parameters in docs https://github.com/mindsdb/mindsdb/pull/7336
- sql api updates https://github.com/mindsdb/mindsdb/pull/8756
- updated deprecated openai models https://github.com/mindsdb/mindsdb/pull/8755
- added d0lt.mdx https://github.com/mindsdb/mindsdb/pull/5383
- youtube docs for connecting https://github.com/mindsdb/mindsdb/pull/8744
- youtube docs https://github.com/mindsdb/mindsdb/pull/8741
- updates to postgres docs https://github.com/mindsdb/mindsdb/pull/8740
- updated ai tables doc page https://github.com/mindsdb/mindsdb/pull/8706
- installation docs updates https://github.com/mindsdb/mindsdb/pull/8705
- PostgreSQL Updates docs https://github.com/mindsdb/mindsdb/pull/8707
- youtube documentation update https://github.com/mindsdb/mindsdb/pull/8682
- Fix: Typo in documentation https://github.com/mindsdb/mindsdb/pull/8703
- sql syntax document page https://github.com/mindsdb/mindsdb/pull/8676
- fix_query https://github.com/mindsdb/mindsdb/pull/8683

New Handlers:
- Whatsapp Integration https://github.com/mindsdb/mindsdb/pull/8393
- Initial Google Analytics Handler https://github.com/mindsdb/mindsdb/pull/8586
- Leonardo AI Integration https://github.com/mindsdb/mindsdb/pull/8553
- Microsoft Teams Chat Handler https://github.com/mindsdb/mindsdb/pull/8479
- Add LiteLLM handler https://github.com/mindsdb/mindsdb/pull/8507

Features, Improvements and Fixes
- Added dependencies to k8s, LLM fixes https://github.com/mindsdb/mindsdb/pull/8652
- Update of internal DB https://github.com/mindsdb/mindsdb/pull/8552
- updated sendinblue_tables.py https://github.com/mindsdb/mindsdb/pull/8679
- Allow to use `in` in `show tables {from | in} db` https://github.com/mindsdb/mindsdb/pull/8671
- add credentials_json https://github.com/mindsdb/mindsdb/pull/8635
- Fix BYOM venv paths on windows https://github.com/mindsdb/mindsdb/pull/8668
- Mark anyscale endpoints integration as permanent https://github.com/mindsdb/mindsdb/pull/8654
- Redirect URI Fix for MS Teams https://github.com/mindsdb/mindsdb/pull/8659
- fix drop table for vectordatabase_handler.py and specifically chroma https://github.com/mindsdb/mindsdb/pull/8612
- Add QueryStep to planner https://github.com/mindsdb/mindsdb/pull/8524
- Ollama - Drop model registry check & improve description https://github.com/mindsdb/mindsdb/pull/8631
- Remove mssql as default handler https://github.com/mindsdb/mindsdb/pull/8647
- YouTube Integration Fixes https://github.com/mindsdb/mindsdb/pull/8614
- fix openai handler api_base argument https://github.com/mindsdb/mindsdb/pull/8630
- Minor Fixes to LangChain and Rag https://github.com/mindsdb/mindsdb/pull/8628
- More deploy triggers and simplify docker https://github.com/mindsdb/mindsdb/pull/8609
- Fix vertex dependency https://github.com/mindsdb/mindsdb/pull/8620
- Fix deploy trigger input name https://github.com/mindsdb/mindsdb/pull/8616
- Fix Replicate schema bug https://github.com/mindsdb/mindsdb/pull/8601
- Executor moved from mysql server https://github.com/mindsdb/mindsdb/pull/8544
- Fix neuralforecast and statsforecast in cloud image https://github.com/mindsdb/mindsdb/pull/8605
- Fix https CH bug https://github.com/mindsdb/mindsdb/pull/8597
- fix issue with pdf upload in cloud https://github.com/mindsdb/mindsdb/pull/8589
- Bump lightwood to 23.12.4.0 https://github.com/mindsdb/mindsdb/pull/8602
- Fix checking frontend version https://github.com/mindsdb/mindsdb/pull/8598
- Update LlamaIndex handler with GithubLoader and YoutubeTranscript loader https://github.com/mindsdb/mindsdb/pull/8562
- Update deps install log message https://github.com/mindsdb/mindsdb/pull/8571
- Feat add new handler to update Shopify orders https://github.com/mindsdb/mindsdb/pull/8585
- Update mysql_handler.py https://github.com/mindsdb/mindsdb/pull/8575
- Twelve Labs Fixes & Improvements https://github.com/mindsdb/mindsdb/pull/8578

Documentation Updates
- updated docs re agents/chatbots/kb https://github.com/mindsdb/mindsdb/pull/8660
- Binance https://github.com/mindsdb/mindsdb/pull/7088
- Readme updates https://github.com/mindsdb/mindsdb/pull/8661
- updated timegpt docs with more info https://github.com/mindsdb/mindsdb/pull/8657
- removed chatbot ui docs https://github.com/mindsdb/mindsdb/pull/8655
- updated agent/chatbot tutorial https://github.com/mindsdb/mindsdb/pull/8656
- restructured docs sections into tabs https://github.com/mindsdb/mindsdb/pull/8633
- Add Python code docs for Contributors https://github.com/mindsdb/mindsdb/pull/8651
- Update jobs.mdx https://github.com/mindsdb/mindsdb/pull/8646
- Update timegpt.mdx https://github.com/mindsdb/mindsdb/pull/8634
- Update youtube.mdx https://github.com/mindsdb/mindsdb/pull/8621
- Update openai.mdx https://github.com/mindsdb/mindsdb/pull/8625
- Update README.md https://github.com/mindsdb/mindsdb/pull/8622
- README.md update https://github.com/mindsdb/mindsdb/pull/8627
- Fix vertex install instructions https://github.com/mindsdb/mindsdb/pull/8626
- updated syntax of describe, retrain, finetune https://github.com/mindsdb/mindsdb/pull/8618
- linked finetuning blog post https://github.com/mindsdb/mindsdb/pull/8617
- added info about which slack connection method to use with the chatbot syntax https://github.com/mindsdb/mindsdb/pull/8615
- Update lightwood documentation URL https://github.com/mindsdb/mindsdb/pull/8604
- Update default project https://github.com/mindsdb/mindsdb/pull/8607
- Replicate docs update https://github.com/mindsdb/mindsdb/pull/8599
- updated timegpt docs https://github.com/mindsdb/mindsdb/pull/8596
- new finetuning example for anyscale_endpoints engine https://github.com/mindsdb/mindsdb/pull/8581
- Minor docs update https://github.com/mindsdb/mindsdb/pull/8545
- fixed tab content in docs https://github.com/mindsdb/mindsdb/pull/8580
- Docs updates [fixes to broken links and some docs] https://github.com/mindsdb/mindsdb/pull/8583

Features, Improvements and Fixes

- migrate openai version https://github.com/mindsdb/mindsdb/pull/8541
- fix anyscale issues with finetuning https://github.com/mindsdb/mindsdb/pull/8579
- Implemented Components table for instatus handler https://github.com/mindsdb/mindsdb/pull/8339
- Update LlamaIndex handler with GithubLoader and YoutubeTranscript loader https://github.com/mindsdb/mindsdb/pull/8562