error starting squid

Anon,

Paste the lines to squid, and then run this command

[root@localhost ~]# squid -k parse [ENTER]

And see if there are any syntax errors.
Report back with results if the problem persists.

# --BEGIN-- videocache config for squid
url_rewrite_program /usr/bin/python /usr/share/videocache/videocache.py
url_rewrite_children 5
acl videocache_allow_url url_regex -i \.youtube\.com\/get_video\?
acl videocache_allow_url url_regex -i \.googlevideo\.com\/videoplayback \.googlevideo\.com\/get_video\?
acl videocache_allow_url url_regex -i \.google\.com\/videoplayback \.google\.com\/get_video\?
acl videocache_allow_url url_regex -i \.google\.[a-z][a-z]\/videoplayback \.google\.[a-z][a-z]\/get_video\?
acl videocache_allow_url url_regex -i proxy[a-z0-9\-][a-z0-9][a-z0-9][a-z0-9]?\.dailymotion\.com\/
acl videocache_allow_url url_regex -i vid\.akm\.dailymotion\.com\/
acl videocache_allow_url url_regex -i [a-z0-9][0-9a-z][0-9a-z]?[0-9a-z]?[0-9a-z]?\.xtube\.com\/(.*)flv
acl videocache_allow_url url_regex -i bitcast\.vimeo\.com\/vimeo\/videos\/
acl videocache_allow_url url_regex -i va\.wrzuta\.pl\/wa[0-9][0-9][0-9][0-9]?
acl videocache_allow_url url_regex -i \.files\.youporn\.com\/(.*)\/flv\/
acl videocache_allow_url url_regex -i \.msn\.com\.edgesuite\.net\/(.*)\.flv
acl videocache_allow_url url_regex -i media[a-z0-9]?[a-z0-9]?[a-z0-9]?\.tube8\.com\/
acl videocache_allow_url url_regex -i \.mais\.uol\.com\.br\/(.*)\.flv
acl videocache_allow_url url_regex -i \.video[a-z0-9]?[a-z0-9]?\.blip\.tv\/(.*)\.(flv|avi|mov|mp3|m4v|mp4|wmv|rm|ram)
acl videocache_allow_url url_regex -i video\.break\.com\/(.*)\.(flv|mp4)
acl videocache_allow_dom dstdomain v.mccont.com dl.redtube.com .cdn.dailymotion.com
acl videocache_deny_url url_regex -i http:\/\/[a-z][a-z]\.youtube\.com http:\/\/www\.youtube\.com
url_rewrite_access deny videocache_deny_url
url_rewrite_access allow videocache_allow_url
url_rewrite_access allow videocache_allow_dom
redirector_bypass on
# --END-- videocache config for squid

That are the lines that i use. If i do:
sudo squid -k parse
The response is blank, i mean, i don't take any legend when i run this command.

But if i run
sudo squid -NCd10
I take this:
2009/02/05 13:11:04| WARNING: url_rewriter #3 (FD 9) exited
2009/02/05 13:11:05| WARNING: url_rewriter #2 (FD 8) exited
2009/02/05 13:11:05| WARNING: url_rewriter #1 (FD 7) exited
2009/02/05 13:11:05| Too few url_rewriter processes are running
2009/02/05 13:11:05| storeDirWriteCleanLogs: Starting...
2009/02/05 13:11:05| Finished. Wrote 1892 entries.
2009/02/05 13:11:05| Took 0.0 seconds (377042.6 entries/sec).
FATAL: The url_rewriter helpers are crashing too rapidly, need help!

Aborted

what i can do for use you plugin?

Regards

now works, i try with differents distros and i use ubuntu + manual install squid + manual install videocache.

i set url_rewrite_children to 10

Regards
M

I have the same problem , same error ..
already set url_rewrite_children to 10
but no hope !!!!!!

squid 2.7stable5 on Debian 4 etch ..

please i need help ....

Anon,

Please follow these steps.

1. Check your /var/log/squid/cache.log for errors such as python tracebacks.
2. Check /var/log/squid.out for any errors.
3. Use command "squid -k parse" to check if there are any syntax error in your squid.conf file.

If nothing seems to help, please paste your /etc/videocache.conf and /var/log/videocache/videocache.log file at http://pastebin.com and give us the urls.

Thank You!

1- the errors in cache.log are like :
2009/02/05 13:11:04| WARNING: url_rewriter #3 (FD 9) exited
2009/02/05 13:11:05| WARNING: url_rewriter #2 (FD 8) exited
2009/02/05 13:11:05| WARNING: url_rewriter #1 (FD 7) exited
2009/02/05 13:11:05| Too few url_rewriter processes are running
FATAL: The url_rewriter helpers are crashing too rapidly, need help!

Aborted

2- I can't find /var/log/squid.out !!!
3- squid -k parse doesnt show anything ..
for /etc/videocache.conf : http://pastebin.com/m30cd297a
for /var/log/videocache/videocache.log : http://pastebin.com/m5e14260d

please I need your help , thanks in advance ..

Anon,

Your setup went perfectly ok. And your config file is also ok. Did you check the path to python on your system and path specified in videocache specific configuration in squid.conf ? They should be same otherwise videocache will never run.

Other thing me be that you have incorrect permissions of your cache directories. Please confirm. They should be squid:squid and 755.

Thank You!

the squid cache directories are
nobody nogroup
does it effect ??

this is the cache.log if it will help solving the problem :
http://pastebin.com/m45396351

Yes I did it ..
it was a permession issue ...... i changed to squid..
let me see ..
now i can see the youtube files in /var/www/video-cache/youtube/
but no cache when i play them again !!!!

Anon,

I could not understand what you meant by "but no cache when i play them again !!!!"? Please be descriptive while asking.

Thank You!

Hi
I have the same problem
Incredible, i set url_rewrite_children to 10

And everything is fine now

anyway.

hello admin, very good program, but i am a problem, i probe all configurations of this page, but no work again.
the error show is the next:

2009/09/30 16:07:21| Starting Squid Cache version 2.7.STABLE3 for i386-debian-l$
2009/09/30 16:07:21| Process ID 3748
2009/09/30 16:07:21| With 1024 file descriptors available
2009/09/30 16:07:21| Using epoll for the IO loop
2009/09/30 16:07:21| DNS Socket created at 0.0.0.0, port 56424, FD 6
2009/09/30 16:07:21| Adding nameserver 192.168.11.1 from /etc/resolv.conf
2009/09/30 16:07:21| helperOpenServers: Starting 10 'python' processes
2009/09/30 16:07:21| User-Agent logging is disabled.
2009/09/30 16:07:21| Referer logging is disabled.
2009/09/30 16:07:21| logfileOpen: opening log /var/log/squid/access.log
2009/09/30 16:07:21| Unlinkd pipe opened on FD 21
2009/09/30 16:07:21| Swap maxSize 21196800 KB, estimated 1630523 objects
2009/09/30 16:07:21| Target number of buckets: 81526
2009/09/30 16:07:21| Using 131072 Store buckets
2009/09/30 16:07:21| Max Mem size: 524288 KB
2009/09/30 16:07:21| Max Swap size: 21196800 KB
2009/09/30 16:07:21| Local cache digest enabled; rebuild/rewrite every 3600/360$
2009/09/30 16:07:21| logfileOpen: opening log /var/log/squid/store.log
2009/09/30 16:07:21| Rebuilding storage in /var/spool/squid (DIRTY)
2009/09/30 16:07:21| Using Least Load store dir selection
2009/09/30 16:07:21| Current Directory is /
2009/09/30 16:07:21| Loaded Icons.
2009/09/30 16:07:21| Accepting transparently proxied HTTP connections at 0.0.0.$
2009/09/30 16:07:21| Accepting ICP messages at 0.0.0.0, port 3130, FD 24.
2009/09/30 16:07:21| HTCP Disabled.
2009/09/30 16:07:21| WCCP Disabled.
2009/09/30 16:07:21| Ready to serve requests.
2009/09/30 16:07:21| WARNING: url_rewriter #1 (FD 7) exited
2009/09/30 16:07:21| WARNING: url_rewriter #3 (FD 9) exited
2009/09/30 16:07:21| WARNING: url_rewriter #2 (FD 8) exited
2009/09/30 16:07:21| WARNING: url_rewriter #4 (FD 10) exited
2009/09/30 16:07:21| WARNING: url_rewriter #5 (FD 11) exited
2009/09/30 16:07:21| Too few url_rewriter processes are running
FATAL: The url_rewriter helpers are crashing too rapidly, need help!

Squid Cache (Version 2.7.STABLE3): Terminated abnormally.
CPU Usage: 0.008 seconds = 0.004 user + 0.004 sys
Maximum Resident Size: 0 KB
Page faults with physical i/o: 0
Memory usage for squid via mallinfo():
total space in arena: 2268 KB
Ordinary blocks: 2174 KB 6 blks
Small blocks: 0 KB 0 blks
Holding blocks: 1792 KB 3 blks
Free Small blocks: 0 KB
Free Ordinary blocks: 93 KB
Total in use: 3966 KB 98%
Total free: 93 KB 2%

please, helpme, tanks.

my system is debian 5.0 larry + apache2 + squid 2.7stable3

It`s works!
i change owner directory /usr/bin/videocache and enjoy!

best regards!

2009/11/26 05:46:13| Too few url_rewriter processes are running
2009/11/26 05:46:13| storeDirWriteCleanLogs: Starting...
2009/11/26 05:46:13| Finished. Wrote 2476 entries.
2009/11/26 05:46:13| Took 0.0 seconds (2109029.0 entries/sec).
FATAL: The url_rewriter helpers are crashing too rapidly, need help!

what can i do...

i purchase this system but i can't use it..
pleese assist me..

i use ubuntu 8.04

can u help me step by step to install the videocache on ubuntu

permission and ownership set to nobody or to proxy or to root?

please i need ur answer... help me brother..

regard's ratna

Greaaaaaaaaaaat.... its work... i change permisions and ownership..

but now the problem is.. the video cannot be cache.. i can find the last open video on the videocache local web http://localhost/videoacahe

whats problem again?

just that...

2009-12-04 21:21:45,773 6090 18.10.10.14 - REQUEST - http://v18.lscache1.c.youtube.com/videoplayback?ip=0.0.0.0&sparams=id%2C...
2009-12-04 21:22:24,560 6090 18.10.10.14 - REQUEST - http://v21.lscache6.c.youtube.com/videoplayback?ip=0.0.0.0&sparams=id%2C...
2009-12-04 21:23:35,158 6090 18.10.10.14 - REQUEST - http://v18.lscache1.c.youtube.com/videoplayback?ip=0.0.0.0&sparams=id%2C...

i cant see about cache hit or downloaded video

Hi!
I use Centos 5.4, squid 2.6 stable21

I want to redirect some url-s to another using a redirector.pl Perl script (which I was downloaded from the internet).

But I have the same problem:
2010/03/04 10:46:13| Too few url_rewriter processes are running
2010/03/04 10:46:13| storeDirWriteCleanLogs: Starting...
2010/03/04 10:46:13| Finished. Wrote 2476 entries.
2010/03/04 10:46:13| Took 0.0 seconds (2109029.0 entries/sec).
FATAL: The url_rewriter helpers are crashing too rapidly, need help!

I was trying everything I saw above, but nothing helps. I was put the "redirector.pl" script into squid directory (etc/squid) and the permission of the file is 777, the owner and group is squid.

In the squid.conf file I set:
url_rewrite_program /etc/squid/redirect.pl
url_rewrite_children 10

for command "squid -k parse" nothing happens.

But the problem is the same!

Can you help me?

Thanks

I use Gentoo.
I ckecked all the settings and file permissions 100 times and everything seems to be ok. But squid doesn't start and dumps in log:
2010/03/10 15:26:59| Beginning Validation Procedure
2010/03/10 15:26:59| WARNING: redirector #1 (FD 8) exited
2010/03/10 15:26:59| WARNING: redirector #2 (FD 9) exited
2010/03/10 15:26:59| WARNING: redirector #3 (FD 10) exited
2010/03/10 15:26:59| WARNING: redirector #4 (FD 11) exited
2010/03/10 15:26:59| WARNING: redirector #5 (FD 12) exited
2010/03/10 15:26:59| WARNING: redirector #6 (FD 13) exited
2010/03/10 15:26:59| WARNING: redirector #7 (FD 14) exited
2010/03/10 15:26:59| WARNING: redirector #8 (FD 15) exited
2010/03/10 15:26:59| WARNING: redirector #9 (FD 16) exited
2010/03/10 15:26:59| WARNING: redirector #10 (FD 17) exited
2010/03/10 15:26:59| WARNING: redirector #11 (FD 18) exited
2010/03/10 15:26:59| Too few redirector processes are running
FATAL: The redirector helpers are crashing too rapidly, need help!

Squid Cache (Version 3.0.STABLE19): Terminated abnormally.
CPU Usage: 0.024 seconds = 0.016 user + 0.008 sys
Maximum Resident Size: 0 KB
Page faults with physical i/o: 0
Memory usage for squid via mallinfo():
total space in arena: 3168 KB
Ordinary blocks: 3099 KB 6 blks
Small blocks: 0 KB 0 blks
Holding blocks: 2272 KB 9 blks
Free Small blocks: 0 KB
Free Ordinary blocks: 68 KB
Total in use: 5371 KB 170%
Total free: 68 KB 2%

When I comment out the videocache configuration part squid starts normally.
In videocache logs from time to time (once per ca. 5 start attepts) I get:
2010-03-10 15:22:38,315 17844 - - XMLRPCSERVER - Starting XMLRPCServer on port 9100.
2010-03-10 15:22:38,320 17844 - - SCHEDULEDER - Download Scheduler starting.
2010-03-10 15:22:42,531 17844 - - RELOAD - videocache plugin was reloaded.

Where is the problem?

please check the daemon of videocache from ps -ax, it seems the daemon still running

Ok.. after 24h of trying different things I found a solution. I created a script called /usr/local/sbin/start_videocache with content:

#!/bin/bash
/usr/bin/python /usr/share/videocache/videocache.py

and replaced the line in squid.conf:
url_rewrite_program /usr/bin/python /usr/share/videocache/videocache.py

with:
url_rewrite_program /usr/local/sbin/start_videocache

So it seems squid doesn't accept white characters in url_rewrite_program directive. Is it just an issue with my version of squid? Do you know how to fix it?

hello, I use centos + squid2.6
I have the same error pro se that has to do with "/usr/share/videocache/videocache.py" If you remove this line up this service.

Thank You!

I also have the same problem but your solution does not work with me. I'am using Debian 5 + apache2 + squid 2.7

2010/03/24 18:38:19| Starting Squid Cache version 2.7.STABLE3 for i386-debian-linux-gnu...
2010/03/24 18:38:19| Process ID 6451
2010/03/24 18:38:19| With 1024 file descriptors available
2010/03/24 18:38:19| Using epoll for the IO loop
2010/03/24 18:38:19| Performing DNS Tests...
2010/03/24 18:38:19| Successful DNS name lookup tests...
2010/03/24 18:38:19| DNS Socket created at 0.0.0.0, port 43926, FD 6
2010/03/24 18:38:19| Adding domain solintec.com.bo from /etc/resolv.conf
2010/03/24 18:38:19| Adding nameserver 200.58.160.25 from /etc/resolv.conf
2010/03/24 18:38:19| Adding nameserver 200.58.161.25 from /etc/resolv.conf
2010/03/24 18:38:19| helperOpenServers: Starting 10 'python' processes
2010/03/24 18:38:21| User-Agent logging is disabled.
2010/03/24 18:38:21| Referer logging is disabled.
2010/03/24 18:38:21| logfileOpen: opening log /var/log/squid/access.log
2010/03/24 18:38:21| Unlinkd pipe opened on FD 21
2010/03/24 18:38:21| Swap maxSize 102400 KB, estimated 7876 objects
2010/03/24 18:38:21| Target number of buckets: 393
2010/03/24 18:38:21| Using 8192 Store buckets
2010/03/24 18:38:21| Max Mem size: 16384 KB
2010/03/24 18:38:21| Max Swap size: 102400 KB
2010/03/24 18:38:21| Local cache digest enabled; rebuild/rewrite every 3600/3600 sec
2010/03/24 18:38:21| logfileOpen: opening log /var/log/squid/store.log
2010/03/24 18:38:21| Rebuilding storage in /var/spool/squid (CLEAN)
2010/03/24 18:38:21| Using Least Load store dir selection
2010/03/24 18:38:21| Set Current Directory to /var/spool/squid
2010/03/24 18:38:21| Loaded Icons.
2010/03/24 18:38:24| Accepting proxy HTTP connections at 192.168.255.95, port 3128, FD 23.
2010/03/24 18:38:24| Accepting ICP messages at 0.0.0.0, port 3130, FD 24.
2010/03/24 18:38:24| HTCP Disabled.
2010/03/24 18:38:24| WCCP Disabled.
2010/03/24 18:38:24| Ready to serve requests.
2010/03/24 18:38:24| WARNING: url_rewriter #1 (FD 7) exited
2010/03/24 18:38:24| Store rebuilding is 61.0% complete
2010/03/24 18:38:24| WARNING: url_rewriter #2 (FD 8) exited
2010/03/24 18:38:24| Done reading /var/spool/squid swaplog (6715 entries)
2010/03/24 18:38:24| Finished rebuilding storage from disk.
2010/03/24 18:38:24| 6715 Entries scanned
2010/03/24 18:38:24| 0 Invalid entries.
2010/03/24 18:38:24| 0 With invalid flags.
2010/03/24 18:38:24| 6715 Objects loaded.
2010/03/24 18:38:24| 0 Objects expired.
2010/03/24 18:38:24| 0 Objects cancelled.
2010/03/24 18:38:24| 0 Duplicate URLs purged.
2010/03/24 18:38:24| 0 Swapfile clashes avoided.
2010/03/24 18:38:24| Took 3.2 seconds (2108.3 objects/sec).
2010/03/24 18:38:24| Beginning Validation Procedure
2010/03/24 18:38:24| Completed Validation Procedure
2010/03/24 18:38:24| Validated 6715 Entries
2010/03/24 18:38:24| store_swap_size = 92156k
2010/03/24 18:38:25| storeLateRelease: released 0 objects
2010/03/24 18:38:25| WARNING: url_rewriter #6 (FD 12) exited
2010/03/24 18:38:25| WARNING: url_rewriter #8 (FD 14) exited
2010/03/24 18:38:25| WARNING: url_rewriter #3 (FD 9) exited
2010/03/24 18:38:25| Too few url_rewriter processes are running
2010/03/24 18:38:25| storeDirWriteCleanLogs: Starting...
2010/03/24 18:38:25| Finished. Wrote 6715 entries.
2010/03/24 18:38:25| Took 0.0 seconds (3215996.2 entries/sec).
FATAL: The url_rewriter helpers are crashing too rapidly, need help!

Aborted (core dumped)

Please help me.
Thank you very much.