Skip to content

Enable galaxyAI on qa1#344

Merged
martenson merged 2 commits into
mainfrom
enable_chatgxy
Jul 15, 2026
Merged

Enable galaxyAI on qa1#344
martenson merged 2 commits into
mainfrom
enable_chatgxy

Conversation

@ljocha

@ljocha ljocha commented Jul 13, 2026

Copy link
Copy Markdown
Collaborator

Done by adding inference_services to galaxy: section of galaxy.yml, according to galaxyproject/galaxy#21434

Ansible secret file requires something like:

chatgxy:
  model: agentic
  token: sk-XXXXXXX
  endpoint: https://llm.ai.e-infra.cz/v1

I did it for QA2 (where it works now), I can't find the valut password for usegalaxy.cz now ... Kindly asking @martenson or @martindemko to add it.

The token can be the same as llm_hub, but it needn't be the same, hence introducing another config entry.

@martindemko

Copy link
Copy Markdown
Collaborator

I think we should reformat this because, as it is now, all our instances will expect to have these Ansible variables. If we want to enable this functionality on QA2 and GCZ, it should be moved to host_vars/INSTANCE/vars.yml. Otherwise, the playbook won't be compatible.

@martindemko martindemko added the enhancement New feature or request label Jul 14, 2026
@ljocha

ljocha commented Jul 14, 2026

Copy link
Copy Markdown
Collaborator Author

I'm afraid that due to the way Ansible works, you would have to move the whole galaxy_config: from group_vars/galaxyservers.yml to host_vars/..., which you don't want.

But you are right things get broken now, IMHO we need placeholders like

, don't we?

@martenson

martenson commented Jul 14, 2026

Copy link
Copy Markdown
Member

we'd make csnt_inference_services and propagate through that, see existing examples with the prefix in the file

@martenson martenson changed the title Enable essential ChatGXY functionality Enable galaxyAI on qa1 Jul 15, 2026
@martenson martenson merged commit 12396f1 into main Jul 15, 2026
@martenson martenson deleted the enable_chatgxy branch July 15, 2026 12:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants