FATAL: The redirector helpers are crashing too rapidly, need help!
by Anonymous on 9 Mar 2009Hello,
I have had some definite trouble getting videocache to work on my copy of Squid. Squid works normally and caches as per usual WITHOUT the videocache lines added to my squid.conf file. As soon as I add them to my Squid.conf file; I lose all proxy access and it stops working. Here are the errors I receive in my cache.log file.
2009/03/09 10:03:01| Starting Squid Cache version 3.0.STABLE1 for i486-pc-linux-gnu...
2009/03/09 10:03:01| Process ID 21766
2009/03/09 10:03:01| With 1024 file descriptors available
2009/03/09 10:03:01| DNS Socket created at 0.0.0.0, port 38103, FD 8
2009/03/09 10:03:01| Adding domain xxx.xx.xx from /etc/resolv.conf
2009/03/09 10:03:01| Adding nameserver 1xxxxxxx from /etc/resolv.conf
2009/03/09 10:03:01| Adding nameserver 1xxxxxxx from /etc/resolv.conf
2009/03/09 10:03:01| helperOpenServers: Starting 25 'python' processes
2009/03/09 10:03:02| Unlinkd pipe opened on FD 38
2009/03/09 10:03:02| Local cache digest enabled; rebuild/rewrite every 3600/3600 sec
2009/03/09 10:03:02| Swap maxSize 102400 KB, estimated 7876 objects
2009/03/09 10:03:02| Target number of buckets: 393
2009/03/09 10:03:02| Using 8192 Store buckets
2009/03/09 10:03:02| Max Mem size: 8192 KB
2009/03/09 10:03:02| Max Swap size: 102400 KB
2009/03/09 10:03:02| Version 1 of swap file with LFS support detected...
2009/03/09 10:03:02| Rebuilding storage in /var/spool/squid3 (CLEAN)
2009/03/09 10:03:02| Using Least Load store dir selection
2009/03/09 10:03:02| Set Current Directory to /var/spool/squid3
2009/03/09 10:03:02| Loaded Icons.
2009/03/09 10:03:02| Accepting transparently proxied HTTP connections at 0.0.0.0, port 3128, FD 40.
2009/03/09 10:03:02| Accepting ICP messages at 0.0.0.0, port 3130, FD 41.
2009/03/09 10:03:02| HTCP Disabled.
2009/03/09 10:03:02| Ready to serve requests.
2009/03/09 10:03:02| WARNING: redirector #1 (FD 9) exited
2009/03/09 10:03:02| WARNING: redirector #2 (FD 10) exited
2009/03/09 10:03:02| WARNING: redirector #3 (FD 11) exited
2009/03/09 10:03:02| WARNING: redirector #4 (FD 12) exited
2009/03/09 10:03:02| Done reading /var/spool/squid3 swaplog (341 entries)
2009/03/09 10:03:02| Finished rebuilding storage from disk.
2009/03/09 10:03:02| 341 Entries scanned
2009/03/09 10:03:02| 0 Invalid entries.
2009/03/09 10:03:02| 0 With invalid flags.
2009/03/09 10:03:02| 341 Objects loaded.
2009/03/09 10:03:02| 0 Objects expired.
2009/03/09 10:03:02| 0 Objects cancelled.
2009/03/09 10:03:02| 0 Duplicate URLs purged.
2009/03/09 10:03:02| 0 Swapfile clashes avoided.
2009/03/09 10:03:02| Took 0.12 seconds (2878.27 objects/sec).
2009/03/09 10:03:02| Beginning Validation Procedure
2009/03/09 10:03:02| Completed Validation Procedure
2009/03/09 10:03:02| Validated 707 Entries
2009/03/09 10:03:02| store_swap_size = 2708
2009/03/09 10:03:03| WARNING: redirector #5 (FD 13) exited
2009/03/09 10:03:03| WARNING: redirector #6 (FD 14) exited
2009/03/09 10:03:03| WARNING: redirector #7 (FD 15) exited
2009/03/09 10:03:03| WARNING: redirector #8 (FD 16) exited
2009/03/09 10:03:03| WARNING: redirector #9 (FD 17) exited
2009/03/09 10:03:03| WARNING: redirector #11 (FD 19) exited
2009/03/09 10:03:03| WARNING: redirector #10 (FD 18) exited
2009/03/09 10:03:03| WARNING: redirector #12 (FD 20) exited
2009/03/09 10:03:03| WARNING: redirector #13 (FD 21) exited
2009/03/09 10:03:03| WARNING: redirector #14 (FD 22) exited
2009/03/09 10:03:03| Too few redirector processes are running
2009/03/09 10:03:03| storeDirWriteCleanLogs: Starting...
2009/03/09 10:03:03| Finished. Wrote 341 entries.
2009/03/09 10:03:03| Took 0.00 seconds (727078.89 entries/sec).
FATAL: The redirector helpers are crashing too rapidly, need help!
What could this mean? Please help! I need to get videocache properly working asap!
10 Answers
Here is also my Squid.conf and Videocache.conf files incase I did something wrong.
Videocache:
http://pastebin.com/m26cfc220
Squid:
http://pastebin.com/m50204c04
Thanks..
I am also getting this issue... nothing in any of the log files give any hint to the problem.
Is there are way to increase logging verbosity?
How can i test the script from command line while logged in as the proxy user? i execute /usr/bin/python /use/share/videocache/videocache.py but nothing happens, i just get a carriage return. CTRL+C = Hangup
/etc/videocache.conf
http://pastebin.com/m7e3b3614
/etc/squid/squid.conf
http://pastebin.com/m3a152a6a
/var/log/squid/cache.log
http://pastebin.com/m27f61e03
/var/log/videocache/videocache.log
http://pastebin.com/m3eb037f6
Anon,
update-vc script updates your system in accordance with the /etc/videocache.conf file. More details at update-vc page.
Congratulations for the setup.
2009/03/10 17:46:08| WARNING: redirector #1 (FD 6) exited
2009/03/10 17:46:08| WARNING: redirector #2 (FD 7) exited
2009/03/10 17:46:08| WARNING: redirector #4 (FD 9) exited
2009/03/10 17:46:08| WARNING: redirector #3 (FD 8) exited
2009/03/10 17:46:08| WARNING: redirector #5 (FD 10) exited
2009/03/10 17:46:08| Too few redirector processes are running
FATAL: The redirector helpers are crashing too rapidly, need help!
me too.. also update-vc nothing happen.. :(
Nic,
Check these
- Your base_dir or /var/spool/videocache ownership is squid:squid or the squid user on your machine.
- /var/log/videocache is also squid:squid and is writable by squid.
- Port 9100 is not blocked.
- SELinux may cause problems in videocache working.
If it still doesn't work, get back with logs.
Also mention your operating system details. Try the newer version of videocache which is 1.9.1.
Thank You!
I wish to integrate videocache with: squid-dansguardian and antivirus clamav or karsperky
Anon,
You can learn how to integrate squid with more than one url rewrite plugin by following this tutorial.
Thank You!
Thank you Kulbir!
I've got it running on OpenSuse 10.3.
- Your base_dir or /var/spool/videocache ownership is squid:squid or the squid user on your machine.
- /var/log/videocache is also squid:squid and is writable by squid.
I had to manually set above directory ownerships to squid:root