saltstack jinja for loop in parallel

user_7478901 0
Viewed 695

hope to find you well and healthy :)

I have one jinja loop which is working, unfortunately not the way I would like :|

Short story:

Using salt-run for orchestration, minion targeting is accomplished by passing the pre-defined nodegroup as a pillar

{% set minions = salt.saltutil.runner('cache.mine', tgt=nodegroup,tgt_type='nodegroup').keys() %}
{% for minion_id in minions %}

patch-n1-{{ minion_id }}:
  salt.state:
    - tgt: {{ minion_id }}
    - sls:
      - patching.patch-n1
    - pillar:
        minion_id: {{ minion_id }}

reboot_minion-{{ minion_id }}:
  salt.function:
    - name: cmd.run_bg
    - arg:
      - 'salt-call system.reboot 1'
    - tgt: {{ minion_id }}

{% endfor %}

The problem is that with this loop both tasks are executed minion by minion. In my case, this is not efficient ...

If remove the loop both states are applied however again doesn't help so much.

Main goal is to apply patch-n1-{{ minion_id }} and reboot_minion-{{ minion_id }} for each minion in the nodegroup indipended from each other. Or said in a different way I need a for loop which to work simultaneously for all minions in it.

Do you have any ideas about that? Thanks!

orchestration salt-stack jinja2
2 Answers

When we target minions by globbing, or nodegroups, the defined states will be applied to them in parallel. So one way to achieve this is by moving the "reboot minion" functionality into the state file patch-n1.sls itself.

Example /srv/salt/patch-n1.sls file:

# Some tasks to perform patching, just using 'include' for example
# from /srv/salt/patching/os_pkg.sls
include:
- patching.os_pkg

reboot-after-package-update:
  module.run:
  - name: system.reboot

And in orchestrate /srv/salt/orch/patch_all.sls file:

patch-group1:
  salt.state:
  - tgt: group1
  - tgt_type: nodegroup
  - sls:
    - patch-n1

patch-group2:
  salt.state:
  - tgt: group2
  - tgt_type: nodegroup
  - sls:
    - patch-n2

When we run the orchestration, the each minion will run patching and reboot in parallel.

user_139680970

system.reboot didn't help at my case bacause my minions are mixed (Windows, Linux)

reboot-after-package-update:
  module.run:
  - name: system.reboot
I was able to achieve my goal by:

# Some tasks to perform patching, just using 'include' for example
# from /srv/salt/patching/uptodate.sls

include:
- patching.uptodate

reboot-after-package-update:
  cmd.run:
    - name: shutdown -r -t 60

{% set stage = pillar['stage'] %}

{% set nodegroup = salt['pillar.get']('nodegroup', 'PILLAR nodegroup NOT FOUND!') %}

{% set minions = salt.saltutil.runner('cache.mine', tgt=nodegroup,tgt_type='nodegroup').keys() %}

wait_for_reboot-{{ stage }}:
  salt.wait_for_event:
    - name: salt/minion/*/start
    - id_list: {% for minion_id in minions %}
      - {{minion_id}}{% endfor %}
    - timeout: 6000
    - require:
      - cmd: reboot-after-package-update
user_74789010
Related