error starting squid
by Anonymous on 5 Feb 2009Hi. i install videocache, paste the lines on squid.conf but when i try to start i take:
2009/02/03 03:42:40| WARNING: url_rewriter #1 (FD 7) exited
2009/02/03 03:42:41| WARNING: url_rewriter #3 (FD 9) exited
2009/02/03 03:42:41| WARNING: url_rewriter #2 (FD 8) exited
2009/02/03 03:42:41| Too few url_rewriter processes are running
2009/02/03 03:42:41| storeDirWriteCleanLogs: Starting...
2009/02/03 03:42:41| Finished. Wrote 1491 entries.
2009/02/03 03:42:41| Took 0.0 seconds (559264.8 entries/sec).
FATAL: The url_rewriter helpers are crashing too rapidly, need help!
Aborted
If i cut the lines for rewrite the squid start.
can you help me. I'm using ubuntu server
36 Answers
Anon,
Paste the lines to squid, and then run this command
[root@localhost ~]# squid -k parse [ENTER]
And see if there are any syntax errors.
Report back with results if the problem persists.
# --BEGIN-- videocache config for squid
url_rewrite_program /usr/bin/python /usr/share/videocache/videocache.py
url_rewrite_children 5
acl videocache_allow_url url_regex -i \\.youtube\\.com\\/get_video\\?
acl videocache_allow_url url_regex -i \\.googlevideo\\.com\\/videoplayback \\.googlevideo\\.com\\/get_video\\?
acl videocache_allow_url url_regex -i \\.google\\.com\\/videoplayback \\.google\\.com\\/get_video\\?
acl videocache_allow_url url_regex -i \\.google\\.[a-z][a-z]\\/videoplayback \\.google\\.[a-z][a-z]\\/get_video\\?
acl videocache_allow_url url_regex -i proxy[a-z0-9\\-][a-z0-9][a-z0-9][a-z0-9]?\\.dailymotion\\.com\\/
acl videocache_allow_url url_regex -i vid\\.akm\\.dailymotion\\.com\\/
acl videocache_allow_url url_regex -i [a-z0-9][0-9a-z][0-9a-z]?[0-9a-z]?[0-9a-z]?\\.xtube\\.com\\/(.*)flv
acl videocache_allow_url url_regex -i bitcast\\.vimeo\\.com\\/vimeo\\/videos\\/
acl videocache_allow_url url_regex -i va\\.wrzuta\\.pl\\/wa[0-9][0-9][0-9][0-9]?
acl videocache_allow_url url_regex -i \\.files\\.youporn\\.com\\/(.*)\\/flv\\/
acl videocache_allow_url url_regex -i \\.msn\\.com\\.edgesuite\\.net\\/(.*)\\.flv
acl videocache_allow_url url_regex -i media[a-z0-9]?[a-z0-9]?[a-z0-9]?\\.tube8\\.com\\/
acl videocache_allow_url url_regex -i \\.mais\\.uol\\.com\\.br\\/(.*)\\.flv
acl videocache_allow_url url_regex -i \\.video[a-z0-9]?[a-z0-9]?\\.blip\\.tv\\/(.*)\\.(flv|avi|mov|mp3|m4v|mp4|wmv|rm|ram)
acl videocache_allow_url url_regex -i video\\.break\\.com\\/(.*)\\.(flv|mp4)
acl videocache_allow_dom dstdomain v.mccont.com dl.redtube.com .cdn.dailymotion.com
acl videocache_deny_url url_regex -i http:\\/\\/[a-z][a-z]\\.youtube\\.com http:\\/\\/www\\.youtube\\.com
url_rewrite_access deny videocache_deny_url
url_rewrite_access allow videocache_allow_url
url_rewrite_access allow videocache_allow_dom
redirector_bypass on
# --END-- videocache config for squid</code>
That are the lines that i use. If i do:
sudo squid -k parse
The response is blank, i mean, i don't take any legend when i run this command.
But if i run
sudo squid -NCd10
I take this:
2009/02/05 13:11:04| WARNING: url_rewriter #3 (FD 9) exited
2009/02/05 13:11:05| WARNING: url_rewriter #2 (FD 8) exited
2009/02/05 13:11:05| WARNING: url_rewriter #1 (FD 7) exited
2009/02/05 13:11:05| Too few url_rewriter processes are running
2009/02/05 13:11:05| storeDirWriteCleanLogs: Starting...
2009/02/05 13:11:05| Finished. Wrote 1892 entries.
2009/02/05 13:11:05| Took 0.0 seconds (377042.6 entries/sec).
FATAL: The url_rewriter helpers are crashing too rapidly, need help!
Aborted
what i can do for use you plugin?
Regards
now works, i try with differents distros and i use ubuntu + manual install squid + manual install videocache.
i set url_rewrite_children to 10
Regards
M
Max,
congratulations!! Enjoy caching videos.
Thank you for using videocache :)
I have the same problem , same error ..
already set url_rewrite_children to 10
but no hope !!!!!!
squid 2.7stable5 on Debian 4 etch ..
please i need help ....
Anon,
Please follow these steps.
- Check your /var/log/squid/cache.log for errors such as python tracebacks.
- Check /var/log/squid.out for any errors.
- Use command "squid -k parse" to check if there are any syntax error in your squid.conf file.
If nothing seems to help, please paste your /etc/videocache.conf and /var/log/videocache/videocache.log file at http://pastebin.com and give us the urls.
Thank You!
1- the errors in cache.log are like :
2009/02/05 13:11:04| WARNING: url_rewriter #3 (FD 9) exited
2009/02/05 13:11:05| WARNING: url_rewriter #2 (FD 8) exited
2009/02/05 13:11:05| WARNING: url_rewriter #1 (FD 7) exited
2009/02/05 13:11:05| Too few url_rewriter processes are running
FATAL: The url_rewriter helpers are crashing too rapidly, need help!
Aborted
2- I can't find /var/log/squid.out !!!
3- squid -k parse doesnt show anything ..
for /etc/videocache.conf : http://pastebin.com/m30cd297a
for /var/log/videocache/videocache.log : http://pastebin.com/m5e14260d
please I need your help , thanks in advance ..
Anon,
Your setup went perfectly ok. And your config file is also ok. Did you check the path to python on your system and path specified in videocache specific configuration in squid.conf ? They should be same otherwise videocache will never run.
Other thing me be that you have incorrect permissions of your cache directories. Please confirm. They should be squid:squid and 755.
Thank You!
this is the cache.log if it will help solving the problem :
http://pastebin.com/m45396351
Yes I did it ..
it was a permession issue ...... i changed to squid..
let me see ..
now i can see the youtube files in /var/www/video-cache/youtube/
but no cache when i play them again !!!!
Anon,
I could not understand what you meant by "but no cache when i play them again !!!!"? Please be descriptive while asking.
Thank You!
Hi
I have the same problem
Incredible, i set url_rewrite_children to 10
And everything is fine now
anyway.
hello admin, very good program, but i am a problem, i probe all configurations of this page, but no work again.
the error show is the next:
2009/09/30 16:07:21| Starting Squid Cache version 2.7.STABLE3 for i386-debian-l$
2009/09/30 16:07:21| Process ID 3748
2009/09/30 16:07:21| With 1024 file descriptors available
2009/09/30 16:07:21| Using epoll for the IO loop
2009/09/30 16:07:21| DNS Socket created at 0.0.0.0, port 56424, FD 6
2009/09/30 16:07:21| Adding nameserver 192.168.11.1 from /etc/resolv.conf
2009/09/30 16:07:21| helperOpenServers: Starting 10 'python' processes
2009/09/30 16:07:21| User-Agent logging is disabled.
2009/09/30 16:07:21| Referer logging is disabled.
2009/09/30 16:07:21| logfileOpen: opening log /var/log/squid/access.log
2009/09/30 16:07:21| Unlinkd pipe opened on FD 21
2009/09/30 16:07:21| Swap maxSize 21196800 KB, estimated 1630523 objects
2009/09/30 16:07:21| Target number of buckets: 81526
2009/09/30 16:07:21| Using 131072 Store buckets
2009/09/30 16:07:21| Max Mem size: 524288 KB
2009/09/30 16:07:21| Max Swap size: 21196800 KB
2009/09/30 16:07:21| Local cache digest enabled; rebuild/rewrite every 3600/360$
2009/09/30 16:07:21| logfileOpen: opening log /var/log/squid/store.log
2009/09/30 16:07:21| Rebuilding storage in /var/spool/squid (DIRTY)
2009/09/30 16:07:21| Using Least Load store dir selection
2009/09/30 16:07:21| Current Directory is /
2009/09/30 16:07:21| Loaded Icons.
2009/09/30 16:07:21| Accepting transparently proxied HTTP connections at 0.0.0.$
2009/09/30 16:07:21| Accepting ICP messages at 0.0.0.0, port 3130, FD 24.
2009/09/30 16:07:21| HTCP Disabled.
2009/09/30 16:07:21| WCCP Disabled.
2009/09/30 16:07:21| Ready to serve requests.
2009/09/30 16:07:21| WARNING: url_rewriter #1 (FD 7) exited
2009/09/30 16:07:21| WARNING: url_rewriter #3 (FD 9) exited
2009/09/30 16:07:21| WARNING: url_rewriter #2 (FD 8) exited
2009/09/30 16:07:21| WARNING: url_rewriter #4 (FD 10) exited
2009/09/30 16:07:21| WARNING: url_rewriter #5 (FD 11) exited
2009/09/30 16:07:21| Too few url_rewriter processes are running
FATAL: The url_rewriter helpers are crashing too rapidly, need help!
Squid Cache (Version 2.7.STABLE3): Terminated abnormally.
CPU Usage: 0.008 seconds = 0.004 user + 0.004 sys
Maximum Resident Size: 0 KB
Page faults with physical i/o: 0
Memory usage for squid via mallinfo():
total space in arena: 2268 KB
Ordinary blocks: 2174 KB 6 blks
Small blocks: 0 KB 0 blks
Holding blocks: 1792 KB 3 blks
Free Small blocks: 0 KB
Free Ordinary blocks: 93 KB
Total in use: 3966 KB 98%
Total free: 93 KB 2%
please, helpme, tanks.
my system is debian 5.0 larry + apache2 + squid 2.7stable3
It`s works!
i change owner directory /usr/bin/videocache and enjoy!
best regards!
2009/11/26 05:46:13| Too few url_rewriter processes are running
2009/11/26 05:46:13| storeDirWriteCleanLogs: Starting...
2009/11/26 05:46:13| Finished. Wrote 2476 entries.
2009/11/26 05:46:13| Took 0.0 seconds (2109029.0 entries/sec).
FATAL: The url_rewriter helpers are crashing too rapidly, need help!
what can i do...
i purchase this system but i can't use it..
pleese assist me..
Hi!
Please mention your operating system, squid version etc while reporting a problem.
Did you check 1) Your disk is not full, 2) cache_dir and logdir has right permissions and ownershipt?
Thank You!
i use ubuntu 8.04
can u help me step by step to install the videocache on ubuntu
permission and ownership set to nobody or to proxy or to root?
please i need ur answer... help me brother..
regard's ratna
Greaaaaaaaaaaat.... its work... i change permisions and ownership..
but now the problem is.. the video cannot be cache.. i can find the last open video on the videocache local web http://localhost/videoacahe
whats problem again?
just that...
2009-12-04 21:21:45,773 6090 18.10.10.14 - REQUEST - http://v18.lscache1.c.youtube.com/videoplayback?ip=0.0.0.0&sparams=id%2Cexpire%2Cip%2Cipbits%2Citag%2Calgorithm%2Cburst%2Cfactor&fexp=902306%2C905208&algorithm=throttle-factor&itag=34&ipbits=0&burst=40&sver=3&expire=1259935200&key=yt1&signature=D7338B00C0C7F75CFE856E258E0FC4F57938C61B.9A343454B4F434F9EFE148338B5D44F47B096B22&factor=1.25&id=ca28c7aace4a507c&
2009-12-04 21:22:24,560 6090 18.10.10.14 - REQUEST - http://v21.lscache6.c.youtube.com/videoplayback?ip=0.0.0.0&sparams=id%2Cexpire%2Cip%2Cipbits%2Citag%2Calgorithm%2Cburst%2Cfactor&fexp=902306%2C905208&algorithm=throttle-factor&itag=34&ipbits=0&burst=40&sver=3&expire=1259935200&key=yt1&signature=8798AF28AC2065E7991089E71832E8FD0678D7DB.53D54DFA68318507687B540B3232E0958E80BB07&factor=1.25&id=81df79bbdcaf2048&
2009-12-04 21:23:35,158 6090 18.10.10.14 - REQUEST - http://v18.lscache1.c.youtube.com/videoplayback?ip=0.0.0.0&sparams=id%2Cexpire%2Cip%2Cipbits%2Citag%2Calgorithm%2Cburst%2Cfactor&fexp=902306%2C905208&algorithm=throttle-factor&itag=34&ipbits=0&burst=40&sver=3&expire=1259935200&key=yt1&signature=D7338B00C0C7F75CFE856E258E0FC4F57938C61B.9A343454B4F434F9EFE148338B5D44F47B096B22&factor=1.25&id=ca28c7aace4a507c&
i cant see about cache hit or downloaded video
Hi!
I use Centos 5.4, squid 2.6 stable21
I want to redirect some url-s to another using a redirector.pl Perl script (which I was downloaded from the internet).
But I have the same problem:
2010/03/04 10:46:13| Too few url_rewriter processes are running
2010/03/04 10:46:13| storeDirWriteCleanLogs: Starting...
2010/03/04 10:46:13| Finished. Wrote 2476 entries.
2010/03/04 10:46:13| Took 0.0 seconds (2109029.0 entries/sec).
FATAL: The url_rewriter helpers are crashing too rapidly, need help!
I was trying everything I saw above, but nothing helps. I was put the "redirector.pl" script into squid directory (etc/squid) and the permission of the file is 777, the owner and group is squid.
In the squid.conf file I set:
url_rewrite_program /etc/squid/redirect.pl
url_rewrite_children 10
for command "squid -k parse" nothing happens.
But the problem is the same!
Can you help me?
Thanks
I use Gentoo.
I ckecked all the settings and file permissions 100 times and everything seems to be ok. But squid doesn't start and dumps in log:
2010/03/10 15:26:59| Beginning Validation Procedure
2010/03/10 15:26:59| WARNING: redirector #1 (FD 8) exited
2010/03/10 15:26:59| WARNING: redirector #2 (FD 9) exited
2010/03/10 15:26:59| WARNING: redirector #3 (FD 10) exited
2010/03/10 15:26:59| WARNING: redirector #4 (FD 11) exited
2010/03/10 15:26:59| WARNING: redirector #5 (FD 12) exited
2010/03/10 15:26:59| WARNING: redirector #6 (FD 13) exited
2010/03/10 15:26:59| WARNING: redirector #7 (FD 14) exited
2010/03/10 15:26:59| WARNING: redirector #8 (FD 15) exited
2010/03/10 15:26:59| WARNING: redirector #9 (FD 16) exited
2010/03/10 15:26:59| WARNING: redirector #10 (FD 17) exited
2010/03/10 15:26:59| WARNING: redirector #11 (FD 18) exited
2010/03/10 15:26:59| Too few redirector processes are running
FATAL: The redirector helpers are crashing too rapidly, need help!
Squid Cache (Version 3.0.STABLE19): Terminated abnormally.
CPU Usage: 0.024 seconds = 0.016 user + 0.008 sys
Maximum Resident Size: 0 KB
Page faults with physical i/o: 0
Memory usage for squid via mallinfo():
total space in arena: 3168 KB
Ordinary blocks: 3099 KB 6 blks
Small blocks: 0 KB 0 blks
Holding blocks: 2272 KB 9 blks
Free Small blocks: 0 KB
Free Ordinary blocks: 68 KB
Total in use: 5371 KB 170%
Total free: 68 KB 2%
When I comment out the videocache configuration part squid starts normally.
In videocache logs from time to time (once per ca. 5 start attepts) I get:
2010-03-10 15:22:38,315 17844 - - XMLRPCSERVER - Starting XMLRPCServer on port 9100.
2010-03-10 15:22:38,320 17844 - - SCHEDULEDER - Download Scheduler starting.
2010-03-10 15:22:42,531 17844 - - RELOAD - videocache plugin was reloaded.
Where is the problem?
please check the daemon of videocache from ps -ax, it seems the daemon still running
Ok.. after 24h of trying different things I found a solution. I created a script called
/usr/local/sbin/start_videocache
with content:
#!/bin/bash
/usr/bin/python /usr/share/videocache/videocache.py
and replaced the line in squid.conf:
url_rewrite_program /usr/bin/python /usr/share/videocache/videocache.py
with:
url_rewrite_program /usr/local/sbin/start_videocache
So it seems squid doesn't accept white characters in url_rewrite_program directive. Is it just an issue with my version of squid? Do you know how to fix it?
hello, I use centos + squid2.6
I have the same error pro se that has to do with "/usr/share/videocache/videocache.py" If you remove this line up this service.
Thank You!
I also have the same problem but your solution does not work with me. I'am using Debian 5 + apache2 + squid 2.7
2010/03/24 18:38:19| Starting Squid Cache version 2.7.STABLE3 for i386-debian-linux-gnu...
2010/03/24 18:38:19| Process ID 6451
2010/03/24 18:38:19| With 1024 file descriptors available
2010/03/24 18:38:19| Using epoll for the IO loop
2010/03/24 18:38:19| Performing DNS Tests...
2010/03/24 18:38:19| Successful DNS name lookup tests...
2010/03/24 18:38:19| DNS Socket created at 0.0.0.0, port 43926, FD 6
2010/03/24 18:38:19| Adding domain solintec.com.bo from /etc/resolv.conf
2010/03/24 18:38:19| Adding nameserver 200.58.160.25 from /etc/resolv.conf
2010/03/24 18:38:19| Adding nameserver 200.58.161.25 from /etc/resolv.conf
2010/03/24 18:38:19| helperOpenServers: Starting 10 'python' processes
2010/03/24 18:38:21| User-Agent logging is disabled.
2010/03/24 18:38:21| Referer logging is disabled.
2010/03/24 18:38:21| logfileOpen: opening log /var/log/squid/access.log
2010/03/24 18:38:21| Unlinkd pipe opened on FD 21
2010/03/24 18:38:21| Swap maxSize 102400 KB, estimated 7876 objects
2010/03/24 18:38:21| Target number of buckets: 393
2010/03/24 18:38:21| Using 8192 Store buckets
2010/03/24 18:38:21| Max Mem size: 16384 KB
2010/03/24 18:38:21| Max Swap size: 102400 KB
2010/03/24 18:38:21| Local cache digest enabled; rebuild/rewrite every 3600/3600 sec
2010/03/24 18:38:21| logfileOpen: opening log /var/log/squid/store.log
2010/03/24 18:38:21| Rebuilding storage in /var/spool/squid (CLEAN)
2010/03/24 18:38:21| Using Least Load store dir selection
2010/03/24 18:38:21| Set Current Directory to /var/spool/squid
2010/03/24 18:38:21| Loaded Icons.
2010/03/24 18:38:24| Accepting proxy HTTP connections at 192.168.255.95, port 3128, FD 23.
2010/03/24 18:38:24| Accepting ICP messages at 0.0.0.0, port 3130, FD 24.
2010/03/24 18:38:24| HTCP Disabled.
2010/03/24 18:38:24| WCCP Disabled.
2010/03/24 18:38:24| Ready to serve requests.
2010/03/24 18:38:24| WARNING: url_rewriter #1 (FD 7) exited
2010/03/24 18:38:24| Store rebuilding is 61.0% complete
2010/03/24 18:38:24| WARNING: url_rewriter #2 (FD 8) exited
2010/03/24 18:38:24| Done reading /var/spool/squid swaplog (6715 entries)
2010/03/24 18:38:24| Finished rebuilding storage from disk.
2010/03/24 18:38:24| 6715 Entries scanned
2010/03/24 18:38:24| 0 Invalid entries.
2010/03/24 18:38:24| 0 With invalid flags.
2010/03/24 18:38:24| 6715 Objects loaded.
2010/03/24 18:38:24| 0 Objects expired.
2010/03/24 18:38:24| 0 Objects cancelled.
2010/03/24 18:38:24| 0 Duplicate URLs purged.
2010/03/24 18:38:24| 0 Swapfile clashes avoided.
2010/03/24 18:38:24| Took 3.2 seconds (2108.3 objects/sec).
2010/03/24 18:38:24| Beginning Validation Procedure
2010/03/24 18:38:24| Completed Validation Procedure
2010/03/24 18:38:24| Validated 6715 Entries
2010/03/24 18:38:24| store_swap_size = 92156k
2010/03/24 18:38:25| storeLateRelease: released 0 objects
2010/03/24 18:38:25| WARNING: url_rewriter #6 (FD 12) exited
2010/03/24 18:38:25| WARNING: url_rewriter #8 (FD 14) exited
2010/03/24 18:38:25| WARNING: url_rewriter #3 (FD 9) exited
2010/03/24 18:38:25| Too few url_rewriter processes are running
2010/03/24 18:38:25| storeDirWriteCleanLogs: Starting...
2010/03/24 18:38:25| Finished. Wrote 6715 entries.
2010/03/24 18:38:25| Took 0.0 seconds (3215996.2 entries/sec).
FATAL: The url_rewriter helpers are crashing too rapidly, need help!
Aborted (core dumped)
Please help me.
Thank you very much.
Please increase the number of file descriptors. You are running squid with default number of file descriptors.
stan hello as I have centos 5.5 and squid 2.6 everything was fine until I install Ocurí VideoCach Masomenos sends me an error like this ...
type = 1400 audit (1284648898.159: 332): avc: denied (name_connect) for pid = 4565 comm = "python" src = 9100scontext = root: system_r: squid_t: s0tcontext = system_u: object_r: hplip_port_t: s0 tclass = tcp_socket
type = 1400 audit (1284648898.159: 332): avc: denied (name_bind) for pid = 4565 comm = "python" src = 9100scontext = root: system_r: squid_t: s0tcontext = system_u: object_r: hplip_port_t: s0 tclass = tcp_socket
and nose due to this error before installing the squid VideoCach was wrong but when I install I got this message from squid broken
Okala can help me
EscucharLeer fonéticamente
Hi Samuelito,
Videocache doesn't work fine if you have selinux turned on. Please check squid has write access to cache directories and log directory.
Thank you!
hello how are you I have centos 5.5 and squid 2.6 everything was fine until I install ocurio VideoCach maso sends me an error like this ... but that's when I put video ---- --- cache config for squid in / etc / squid / squid.conf but when I clear the config cache so good here I get the error
type=1400 audit (1284648898.159 : 332):avc: denied {name_connect} for pid=4565 comm="python"src=9100scontext=root: system_r: squid_t: s0tcontext= system_u: object_r :hplip_port_t : s0 tclass=tcp_socket
type=1400 audit (1284648898.159 : 332):avc: denied {name_bind} for pid=4565 comm="python"src=9100scontext=root: system_r: squid_t: s0tcontext= system_u: object_r :hplip_port_t : s0 tclass=tcp_socket
and I also get this error when I do service squid reload
Se está ejecutando squid (pid 2130)...
squid: ERROR: Could not send signal 0 to process 2132: (3) No such process
Hi!
SELinux is preventing videocache from accessing log files and cache directories. Please either create exception for videocache or disable selinux to make it work properly.
Thanks!
Hi, nice work.... but I got error :(
squid (pid 9722) is running...
squid: ERROR: Could not send signal 0 to process 9724: (3) No such process
in /var/log/messages
Oct 18 03:20:47 dhcppc0 squid[9722]: Squid Parent: child process 9778 started
Oct 18 03:20:48 dhcppc0 squid[9778]: The url_rewriter helpers are crashing too rapidly, need help!
Oct 18 03:20:48 dhcppc0 squid[9722]: Squid Parent: child process 9778 exited due to signal 6
Oct 18 03:20:48 dhcppc0 squid[9722]: Exiting due to repeated, frequent failures
Please help me out to figure this problem.