diff --git a/CHANGELOG.md b/CHANGELOG.md
index 83739288..48dd75bd 100644
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@ -84,6 +84,7 @@ The **patch** part changes incrementally at each release.
 * evolinux-base: Don't make alert5.service executable as systemd will complain
 * webapps/evoadmin-web: Set default evoadmin_mail_tpl_force to True to fix a regression where the mail template would not get updated because the file is created before the role is first run.
 * minifirewall: Backport changes from minifirewall (properly open outgoing smtp(s))
+* minifirewall: Properly detect alert5.sh to turn on firewall at boot
 
 ### Security
 
diff --git a/minifirewall/tasks/activate.yml b/minifirewall/tasks/activate.yml
index d0b28220..cfa3d6ad 100644
--- a/minifirewall/tasks/activate.yml
+++ b/minifirewall/tasks/activate.yml
@@ -16,7 +16,7 @@
 
 - name: check if /usr/share/scripts/alert5 exists
   stat:
-    path: /usr/share/scripts/alert5
+    path: /usr/share/scripts/alert5.sh
   register: usr_share_scripts_alert5
 
 - name: Uncomment minifirewall start line