Is it possible to integrate internal LLM to the positron AI

[roopesh79]

Hi,
I had a chance to look into the Oxygen Positron AI and I would like to know more details about its integration and customization.
Is it possible to add custom LLM to this positron?
Is there any specific documentation available for this?

Thanks
Roopesh

[alex_jitianu]

Hello,
It is possible to connect it to a Microsoft Azure account and on the short term we intend to make this procedure easier and seamless. For now, the Microsoft Azure integration is for demonstration purposes only, to allow those having an openAI model in Azure to test the AI Positron in their environment.
Can you tell me more about this custom LLM? Is it an openAI model that runs in a Micrsoft Azure account, or is it a LLM development in-house from a https://huggingface.co/ model? What kind of restAPI does it have?


Best regards,
Alex