This is a LLMs project implemented in Java. You can use it to deploy your own private services, supports the Llama2 and GPT models as well as other open-source models.