Is local LLM yet an option?

Self Hosted Retool
1

I saw a brief from Prod Mgr Dworsky and he mentioned the future capability of using on prem LLMs. Is this yet a feature? Key determining selling point for my organization.

Have considered many tools and Retool is a leader.

2

Same here :wink:

3

Hey @lbeers @theidleguest can you briefly talk about your setup and use cases?

4

Yes thank you. Briefly, the setup would be on prem, using an on prem served LLM (llamacpp etc) to be used in a variety of contexts including the analysis of proprietary data and information.