Introduction

VideoCache Hacks

You are hereForums / Support / URL rewrite issues, crashing too fast

Version 1.9.9 is out. We have added support for Youtube mobile videos, Facebook, AOL and MySpace videos as well. Fixed caching issues for some already supported websites. Options to control cache directory selection algorithm, bandwidth usage by videocache, etc. More robust videocache scheduler with a lot more options and features. Have a look at changelog for more details. If you have purchased Videocache in last one year, Contact Us to claim your free upgrade. Please mention the email address using which you purchased Videocache. New users proceed to Pricing Page right now, secure your copy and enjoy caching :-) Also, check our new and simplified upgrade policy :-)

URL rewrite issues, crashing too fast

Post Reply
2 replies [Last post]
14 November, 2009 - 02:07
Hammerhead
Offline
Joined: Nov 14 2009
URL rewrite issues, crashing too fast
Printer-friendly versionSend to friend

Has anyone seen this. I have had this working for about 8 months now and after the last reboot this is what I am getting when I start "squid -d 5". Commenting the URL-rewrites out of the squid.conf makes it stop and squid works fine. Python from the command line imports urlgrabber and iniparse just fine. Running /usr/share/videocache/videocache.py from the command line sits there waiting for input.......HELP!!!

# 2009/11/13 13:34:36| Starting Squid Cache version 2.7.STABLE5 for i686-pc-linux-gnu...
2009/11/13 13:34:36| Process ID 7459
2009/11/13 13:34:36| With 1024 file descriptors available
2009/11/13 13:34:36| Using poll for the IO loop
2009/11/13 13:34:36| Performing DNS Tests...
2009/11/13 13:34:36| Successful DNS name lookup tests...
2009/11/13 13:34:36| DNS Socket created at 0.0.0.0, port 45600, FD 5
2009/11/13 13:34:36| Adding nameserver xxx.xxx.xxx.xxxfrom /etc/resolv.conf
2009/11/13 13:34:36| Adding nameserver xxx.xxx.xxx.xxx from /etc/resolv.conf
2009/11/13 13:34:36| helperOpenServers: Starting 15 'python' processes
2009/11/13 13:34:36| User-Agent logging is disabled.
2009/11/13 13:34:36| Referer logging is disabled.
2009/11/13 13:34:36| logfileOpen: opening log /var/log/squid/access.log
2009/11/13 13:34:36| Unlinkd pipe opened on FD 25
2009/11/13 13:34:36| Swap maxSize 8192000 + 8192 KB, estimated 0 objects
2009/11/13 13:34:36| Target number of buckets: 31539
2009/11/13 13:34:36| Using 32768 Store buckets
2009/11/13 13:34:36| Max Mem size: 8192 KB
2009/11/13 13:34:36| Max Swap size: 8192000 KB
2009/11/13 13:34:36| Local cache digest enabled; rebuild/rewrite every 3600/3600 sec
2009/11/13 13:34:36| logfileOpen: opening log /var/log/squid/store.log
2009/11/13 13:34:36| Rebuilding storage in /var/spool/squid (DIRTY)
2009/11/13 13:34:36| Using Least Load store dir selection
2009/11/13 13:34:36| Set Current Directory to /var/spool/squid
2009/11/13 13:34:36| Loaded Icons.
2009/11/13 13:34:36| Unlinkd pipe opened on FD 30
2009/11/13 13:34:36| Accepting transparently proxied HTTP connections at xxx.xxx.xxx.xxx, port 3128, FD 28.
2009/11/13 13:34:36| Accepting ICP messages at 0.0.0.0, port 3130, FD 29.
2009/11/13 13:34:36| HTCP Disabled.
2009/11/13 13:34:36| WCCP Disabled.
2009/11/13 13:34:36| Ready to serve requests.
2009/11/13 13:34:36| WARNING: url_rewriter #15 (FD 20) exited
2009/11/13 13:34:36| WARNING: url_rewriter #14 (FD 19) exited
2009/11/13 13:34:36| WARNING: url_rewriter #13 (FD 18) exited
2009/11/13 13:34:36| WARNING: url_rewriter #12 (FD 17) exited
2009/11/13 13:34:36| WARNING: url_rewriter #11 (FD 16) exited
2009/11/13 13:34:36| WARNING: url_rewriter #10 (FD 15) exited
2009/11/13 13:34:36| WARNING: url_rewriter #9 (FD 14) exited
2009/11/13 13:34:36| WARNING: url_rewriter #8 (FD 13) exited
2009/11/13 13:34:36| Too few url_rewriter processes are running
FATAL: The url_rewriter helpers are crashing too rapidly, need help!

Top
Tags:
14 November, 2009 - 04:47
#1
Hammerhead
Offline
Joined: Nov 14 2009

OK, so here is what I know. Changing the URL rewrite in the squid.conf to reference /usr/bin/python2.4 from /usr/bin/python makes everything work again. I have version 2.6 installed as well as 2.5. 2.4/2.5 work. 2.6 does not.

In the end I had to specify the version of python to get the videocache to start with out "crashing too fast"

Good luck.

Top
14 November, 2009 - 05:08
#2
admin's picture
admin
Offline
Joined: Nov 2 2008

Hammerhead,

Thank you very much for sharing the solution. Can you please post the exact python version ( output of python command) because I too have python 2.6 on my test system and videocache works fine with it?

Thank You!

Top

Post new comment

The content of this field is kept private and will not be shown publicly. If you have a Gravatar account, used to display your avatar.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Allowed HTML tags: <a> <em> <strong> <cite> <code> <ul> <ol> <li> <dl> <dt> <dd> <img> <code>
  • Lines and paragraphs break automatically.
  • HTML tags will be transformed to conform to HTML standards.

More information about formatting options

CAPTCHA
Are you a human visitor ?
Image CAPTCHA
Enter the characters (without spaces) shown in the image.
‹ Previous topic: SCHEDULED_ERR - Could not schedule video for download. Next topic: [Resolved] no caches ›

My Book on Squid

Purchase/Renew

One License - USD $399
One License - USD $349*
Validity - One Year
Need more? Contact Us
*Includes free upgrades and support for one year.



For details, check pricing.

New forum topics

more

Recent comments

Who's online

There are currently 0 users and 101 guests online.