LLM selection
m
mansona
AI space is every evolving. Would love to have more insight into what LLM is currently being used. Also what emedding model is being used on the inference side as well. What's good today may not be good tomorrow. Are you all using open ai? I'd love the option of using open router even. or better yet give folks a discounted rate, but let them use their own API key.
Log In
S
Stefanos Chrysanthakopoulos
Also, have the ability to regenerate summaries/content with different LLMs.
Again, you may want to generate content with 2 LLMs and compare either at once ot manually.
Lots of space here to improvise and check as LLMs constantly improve/change.
a
acannon37
I think that this feature should be a must in the next update. Most, if not all, LLM based tools provide the option of selecting from a menu of top models.
I've found this feature helpful because I can use the model that might perform best for either the specific material at hand or intended task.