VideoCache
Videocache is no longer in development.

ImportError, but i have installed the modules urlgrabber and iniparse from source!

by Anonymous on 1 May 2009
2009/05/01 03:29:08| Starting Squid Cache version 3.0.STABLE14 for i686-pc-linux-gnu...
2009/05/01 03:29:08| Process ID 4545
2009/05/01 03:29:08| With 1024 file descriptors available
2009/05/01 03:29:08| DNS Socket created at 0.0.0.0, port 32929, FD 7
2009/05/01 03:29:08| Adding domain localdomain from /etc/resolv.conf
2009/05/01 03:29:08| Adding nameserver 192.168.1.1 from /etc/resolv.conf
2009/05/01 03:29:08| helperOpenServers: Starting 7 'python' processes
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
2009/05/01 03:29:08| Unlinkd pipe opened on FD 19
2009/05/01 03:29:08| Swap maxSize 40960000 KB, estimated 3150769 objects
2009/05/01 03:29:08| Target number of buckets: 157538
2009/05/01 03:29:08| Using 262144 Store buckets
2009/05/01 03:29:08| Max Mem  size: 8192 KB
2009/05/01 03:29:08| Max Swap size: 40960000 KB
2009/05/01 03:29:08| Version 1 of swap file with LFS support detected... 
2009/05/01 03:29:08| Rebuilding storage in /cache (CLEAN)
2009/05/01 03:29:08| Using Least Load store dir selection
2009/05/01 03:29:08| Set Current Directory to /var/cache
2009/05/01 03:29:08| Loaded Icons.
2009/05/01 03:29:08| Accepting  HTTP connections at 0.0.0.0, port 3128, FD 21.
2009/05/01 03:29:08| Accepting ICP messages at 0.0.0.0, port 3130, FD 22.
2009/05/01 03:29:08| HTCP Disabled.
2009/05/01 03:29:08| Ready to serve requests.
2009/05/01 03:29:08| WARNING: redirector #3 (FD 10) exited
2009/05/01 03:29:08| WARNING: redirector #2 (FD 9) exited
2009/05/01 03:29:08| WARNING: redirector #1 (FD 8) exited
2009/05/01 03:29:08| WARNING: redirector #7 (FD 14) exited
2009/05/01 03:29:08| Done reading /cache swaplog (197 entries)
2009/05/01 03:29:08| Finished rebuilding storage from disk.
2009/05/01 03:29:08|       197 Entries scanned
2009/05/01 03:29:08|         0 Invalid entries.
2009/05/01 03:29:08|         0 With invalid flags.
2009/05/01 03:29:08|       197 Objects loaded.
2009/05/01 03:29:08|         0 Objects expired.
2009/05/01 03:29:08|         0 Objects cancelled.
2009/05/01 03:29:08|         0 Duplicate URLs purged.
2009/05/01 03:29:08|         0 Swapfile clashes avoided.
2009/05/01 03:29:08|   Took 0.08 seconds (2548.58 objects/sec).
2009/05/01 03:29:08| Beginning Validation Procedure
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
2009/05/01 03:29:08|   Completed Validation Procedure
2009/05/01 03:29:08|   Validated 419 Entries
2009/05/01 03:29:08|   store_swap_size = 7996
2009/05/01 03:29:08| WARNING: redirector #4 (FD 11) exited
2009/05/01 03:29:08| Too few redirector processes are running
2009/05/01 03:29:08| storeDirWriteCleanLogs: Starting...
2009/05/01 03:29:08|   Finished.  Wrote 197 entries.
2009/05/01 03:29:08|   Took 0.00 seconds (164166.67 entries/sec).
FATAL: The redirector helpers are crashing too rapidly, need help!

Squid Cache (Version 3.0.STABLE14): Terminated abnormally.
CPU Usage: 0.070 seconds = 0.041 user + 0.029 sys
Maximum Resident Size: 0 KB
Page faults with physical i/o: 0
Memory usage for squid via mallinfo():
    total space in arena:    3200 KB
    Ordinary blocks:         3054 KB     11 blks
    Small blocks:               0 KB      0 blks
    Holding blocks:          2796 KB      9 blks
    Free Small blocks:          0 KB
    Free Ordinary blocks:     145 KB
    Total in use:            5850 KB 183%
    Total free:               145 KB 5%
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
2009/05/01 03:29:11| Starting Squid Cache version 3.0.STABLE14 for i686-pc-linux-gnu...
2009/05/01 03:29:11| Process ID 4559
2009/05/01 03:29:11| With 1024 file descriptors available
2009/05/01 03:29:11| DNS Socket created at 0.0.0.0, port 32929, FD 7
2009/05/01 03:29:11| Adding domain localdomain from /etc/resolv.conf
2009/05/01 03:29:11| Adding nameserver 192.168.1.1 from /etc/resolv.conf
2009/05/01 03:29:11| helperOpenServers: Starting 7 'python' processes
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
2009/05/01 03:29:12| Unlinkd pipe opened on FD 19
2009/05/01 03:29:12| Swap maxSize 40960000 KB, estimated 3150769 objects
2009/05/01 03:29:12| Target number of buckets: 157538
2009/05/01 03:29:12| Using 262144 Store buckets
2009/05/01 03:29:12| Max Mem  size: 8192 KB
2009/05/01 03:29:12| Max Swap size: 40960000 KB
2009/05/01 03:29:12| Version 1 of swap file with LFS support detected... 
2009/05/01 03:29:12| Rebuilding storage in /cache (CLEAN)
2009/05/01 03:29:12| Using Least Load store dir selection
2009/05/01 03:29:12| Set Current Directory to /var/cache
2009/05/01 03:29:12| Loaded Icons.
2009/05/01 03:29:12| Accepting  HTTP connections at 0.0.0.0, port 3128, FD 21.
2009/05/01 03:29:12| Accepting ICP messages at 0.0.0.0, port 3130, FD 22.
2009/05/01 03:29:12| HTCP Disabled.
2009/05/01 03:29:12| Ready to serve requests.
2009/05/01 03:29:12| WARNING: redirector #1 (FD 8) exited
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
2009/05/01 03:29:12| Done reading /cache swaplog (197 entries)
2009/05/01 03:29:12| Finished rebuilding storage from disk.
2009/05/01 03:29:12|       197 Entries scanned
2009/05/01 03:29:12|         0 Invalid entries.
2009/05/01 03:29:12|         0 With invalid flags.
2009/05/01 03:29:12|       197 Objects loaded.
2009/05/01 03:29:12|         0 Objects expired.
2009/05/01 03:29:12|         0 Objects cancelled.
2009/05/01 03:29:12|         0 Duplicate URLs purged.
2009/05/01 03:29:12|         0 Swapfile clashes avoided.
2009/05/01 03:29:12|   Took 0.11 seconds (1716.03 objects/sec).
2009/05/01 03:29:12| Beginning Validation Procedure
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
2009/05/01 03:29:12|   Completed Validation Procedure
2009/05/01 03:29:12|   Validated 419 Entries
2009/05/01 03:29:12|   store_swap_size = 7996
2009/05/01 03:29:12| WARNING: redirector #2 (FD 9) exited
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
2009/05/01 03:29:12| WARNING: redirector #3 (FD 10) exited
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
2009/05/01 03:29:12| WARNING: redirector #7 (FD 14) exited
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
2009/05/01 03:29:12| WARNING: redirector #4 (FD 11) exited
2009/05/01 03:29:12| Too few redirector processes are running
2009/05/01 03:29:12| storeDirWriteCleanLogs: Starting...
2009/05/01 03:29:12|   Finished.  Wrote 197 entries.
2009/05/01 03:29:12|   Took 0.00 seconds (409563.41 entries/sec).
FATAL: The redirector helpers are crashing too rapidly, need help!

Squid Cache (Version 3.0.STABLE14): Terminated abnormally.
CPU Usage: 0.066 seconds = 0.038 user + 0.028 sys
Maximum Resident Size: 0 KB
Page faults with physical i/o: 0
Memory usage for squid via mallinfo():
    total space in arena:    3200 KB
    Ordinary blocks:         3054 KB      9 blks
    Small blocks:               0 KB      0 blks
    Holding blocks:          2796 KB      9 blks
    Free Small blocks:          0 KB
    Free Ordinary blocks:     145 KB
    Total in use:            5850 KB 183%
    Total free:               145 KB 5%
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
2009/05/01 03:29:15| Starting Squid Cache version 3.0.STABLE14 for i686-pc-linux-gnu...
2009/05/01 03:29:15| Process ID 4572
2009/05/01 03:29:15| With 1024 file descriptors available
2009/05/01 03:29:15| DNS Socket created at 0.0.0.0, port 32929, FD 7
2009/05/01 03:29:15| Adding domain localdomain from /etc/resolv.conf
2009/05/01 03:29:15| Adding nameserver 192.168.1.1 from /etc/resolv.conf
2009/05/01 03:29:15| helperOpenServers: Starting 7 'python' processes
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
2009/05/01 03:29:15| Unlinkd pipe opened on FD 19
2009/05/01 03:29:15| Swap maxSize 40960000 KB, estimated 3150769 objects
2009/05/01 03:29:15| Target number of buckets: 157538
2009/05/01 03:29:15| Using 262144 Store buckets
2009/05/01 03:29:15| Max Mem  size: 8192 KB
2009/05/01 03:29:15| Max Swap size: 40960000 KB
2009/05/01 03:29:15| Version 1 of swap file with LFS support detected... 
2009/05/01 03:29:15| Rebuilding storage in /cache (CLEAN)
2009/05/01 03:29:15| Using Least Load store dir selection
2009/05/01 03:29:15| Set Current Directory to /var/cache
2009/05/01 03:29:15| Loaded Icons.
2009/05/01 03:29:15| Accepting  HTTP connections at 0.0.0.0, port 3128, FD 21.
2009/05/01 03:29:15| Accepting ICP messages at 0.0.0.0, port 3130, FD 22.
2009/05/01 03:29:15| HTCP Disabled.
2009/05/01 03:29:15| Ready to serve requests.
2009/05/01 03:29:15| WARNING: redirector #5 (FD 12) exited
2009/05/01 03:29:15| WARNING: redirector #3 (FD 10) exited
2009/05/01 03:29:15| WARNING: redirector #4 (FD 11) exited
2009/05/01 03:29:15| WARNING: redirector #2 (FD 9) exited
2009/05/01 03:29:15| WARNING: redirector #1 (FD 8) exited
2009/05/01 03:29:15| Too few redirector processes are running
FATAL: The redirector helpers are crashing too rapidly, need help!

Squid Cache (Version 3.0.STABLE14): Terminated abnormally.
CPU Usage: 0.050 seconds = 0.026 user + 0.024 sys
Maximum Resident Size: 0 KB
Page faults with physical i/o: 0
Memory usage for squid via mallinfo():
    total space in arena:    3060 KB
    Ordinary blocks:         3022 KB      5 blks
    Small blocks:               0 KB      0 blks
    Holding blocks:          2796 KB      9 blks
    Free Small blocks:          0 KB
    Free Ordinary blocks:      37 KB
    Total in use:            5818 KB 190%
    Total free:                37 KB 1%
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
2009/05/01 03:29:18| Starting Squid Cache version 3.0.STABLE14 for i686-pc-linux-gnu...
2009/05/01 03:29:18| Process ID 4586
2009/05/01 03:29:18| With 1024 file descriptors available
2009/05/01 03:29:18| DNS Socket created at 0.0.0.0, port 32929, FD 7
2009/05/01 03:29:18| Adding domain localdomain from /etc/resolv.conf
2009/05/01 03:29:18| Adding nameserver 192.168.1.1 from /etc/resolv.conf
2009/05/01 03:29:18| helperOpenServers: Starting 7 'python' processes
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportErrorTraceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
: No module named urlgrabber
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
2009/05/01 03:29:19| Unlinkd pipe opened on FD 19
2009/05/01 03:29:19| Swap maxSize 40960000 KB, estimated 3150769 objects
2009/05/01 03:29:19| Target number of buckets: 157538
2009/05/01 03:29:19| Using 262144 Store buckets
2009/05/01 03:29:19| Max Mem  size: 8192 KB
2009/05/01 03:29:19| Max Swap size: 40960000 KB
2009/05/01 03:29:19| Version 1 of swap file with LFS support detected... 
2009/05/01 03:29:19| Rebuilding storage in /cache (DIRTY)
2009/05/01 03:29:19| Using Least Load store dir selection
2009/05/01 03:29:19| Set Current Directory to /var/cache
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
2009/05/01 03:29:19| Loaded Icons.
2009/05/01 03:29:19| Accepting  HTTP connections at 0.0.0.0, port 3128, FD 21.
2009/05/01 03:29:19| Accepting ICP messages at 0.0.0.0, port 3130, FD 22.
2009/05/01 03:29:19| HTCP Disabled.
2009/05/01 03:29:19| Ready to serve requests.
2009/05/01 03:29:19| WARNING: redirector #7 (FD 14) exited
2009/05/01 03:29:19| WARNING: redirector #5 (FD 12) exited
2009/05/01 03:29:19| WARNING: redirector #4 (FD 11) exited
2009/05/01 03:29:19| WARNING: redirector #3 (FD 10) exited
2009/05/01 03:29:19| WARNING: redirector #1 (FD 8) exited
2009/05/01 03:29:19| Too few redirector processes are running
FATAL: The redirector helpers are crashing too rapidly, need help!

Squid Cache (Version 3.0.STABLE14): Terminated abnormally.
CPU Usage: 0.049 seconds = 0.027 user + 0.022 sys
Maximum Resident Size: 0 KB
Page faults with physical i/o: 0
Memory usage for squid via mallinfo():
    total space in arena:    3060 KB
    Ordinary blocks:         3022 KB      5 blks
    Small blocks:               0 KB      0 blks
    Holding blocks:          2796 KB      9 blks
    Free Small blocks:          0 KB
    Free Ordinary blocks:      37 KB
    Total in use:            5818 KB 190%
    Total free:                37 KB 1%
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
2009/05/01 03:29:22| Starting Squid Cache version 3.0.STABLE14 for i686-pc-linux-gnu...
2009/05/01 03:29:22| Process ID 4599
2009/05/01 03:29:22| With 1024 file descriptors available
2009/05/01 03:29:22| DNS Socket created at 0.0.0.0, port 32929, FD 7
2009/05/01 03:29:22| Adding domain localdomain from /etc/resolv.conf
2009/05/01 03:29:22| Adding nameserver 192.168.1.1 from /etc/resolv.conf
2009/05/01 03:29:22| helperOpenServers: Starting 7 'python' processes
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
2009/05/01 03:29:22| Unlinkd pipe opened on FD 19
2009/05/01 03:29:22| Swap maxSize 40960000 KB, estimated 3150769 objects
2009/05/01 03:29:22| Target number of buckets: 157538
2009/05/01 03:29:22| Using 262144 Store buckets
2009/05/01 03:29:22| Max Mem  size: 8192 KB
2009/05/01 03:29:22| Max Swap size: 40960000 KB
2009/05/01 03:29:22| Version 1 of swap file with LFS support detected... 
2009/05/01 03:29:22| Rebuilding storage in /cache (DIRTY)
2009/05/01 03:29:22| Using Least Load store dir selection
2009/05/01 03:29:22| Set Current Directory to /var/cache
2009/05/01 03:29:22| Loaded Icons.
2009/05/01 03:29:22| Accepting  HTTP connections at 0.0.0.0, port 3128, FD 21.
2009/05/01 03:29:22| Accepting ICP messages at 0.0.0.0, port 3130, FD 22.
2009/05/01 03:29:22| HTCP Disabled.
2009/05/01 03:29:22| Ready to serve requests.
2009/05/01 03:29:22| WARNING: redirector #3 (FD 10) exited
2009/05/01 03:29:22| WARNING: redirector #5 (FD 12) exited
2009/05/01 03:29:22| WARNING: redirector #4 (FD 11) exited
2009/05/01 03:29:22| WARNING: redirector #2 (FD 9) exited
2009/05/01 03:29:22| WARNING: redirector #1 (FD 8) exited
2009/05/01 03:29:22| Too few redirector processes are running
FATAL: The redirector helpers are crashing too rapidly, need help!

Squid Cache (Version 3.0.STABLE14): Terminated abnormally.
CPU Usage: 0.049 seconds = 0.024 user + 0.025 sys
Maximum Resident Size: 0 KB
Page faults with physical i/o: 0
Memory usage for squid via mallinfo():
    total space in arena:    3060 KB
    Ordinary blocks:         3022 KB      5 blks
    Small blocks:               0 KB      0 blks
    Holding blocks:          2796 KB      9 blks
    Free Small blocks:          0 KB
    Free Ordinary blocks:      37 KB
    Total in use:            5818 KB 190%
    Total free:                37 KB 1%
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber
Traceback (most recent call last):
  File "/usr/share/videocache/videocache.py", line 25, in ?
    from config import readMainConfig, readStartupConfig
  File "/usr/share/videocache/config.py", line 29, in ?
    from parser import ConfigPreProcessor
  File "/usr/share/videocache/parser.py", line 23, in ?
    import urlgrabber
ImportError: No module named urlgrabber

my videocache.conf

[main]
# file : /etc/videocache.conf

# This option controls the global behavior of videocache plugin.
# If it is 0, videocache will stop caching or serving anything.
# This option's value can be either 0 or 1.
enable_video_cache = 1

# The hostname or IP address of the system on which caching is being done. This is
# used for serving the videos from the cache. Please don't use http:// or slashes (/).
# Just specify the domain name or IP address.
# Example : localhost.localdomain
# or proxy.example.com
# or 192.168.36.204
# or <Proxy_Server_IP_OR_Domain>
cache_host = localhost.localdomain

# Proxy for http content.
# Example : http_proxy = http://<Proxy_Server_IP_OR_Domain>:<Proxy_port>/
# or http://proxy.example.com:3128/
proxy = http://localhost.localdomain:3128/

# If the above proxy requires authentication, please specify the username.
proxy_username = 

# If the above proxy requires authentication, please specify the password.
proxy_password = 

# No of times a video should be requested before we start caching it.
hit_threshold = 1

# Base directories for caching the videos.
# You can specify multiple caching directories here separated by '|' symbol along
# with their sizes. Size of directories are in Mega Bytes. Don't append M or MB.
#
# EXAMPLE 1: To keep /videocache1 with size 700MB and /videocache2 with size 2GB as
# your cache directories, set base_dir to
# base_dir = /videocache/ : 700 | /videocache2:2048
#
# EXAMPLE 2: To keep /videocache1 with unlimited storage and /videocache2 with 2GB as
# your cache directory, set base_dir to
# base_dir = /videocache/ | /videocache2/:2048
#                   OR
# base_dir = /videocache/:0 | /videocache2/:2048
# ZERO size specifies unlimited storage.
# Please try to avoid special characters in directory names like spaces, $ etc.
base_dir = /cache/videocache/

# This option sets the minimum available free space in Mega Bytes that is left in a
# partition containing a cache directory before videocache treats that partition as FULL.
#
# EXAMPLE: If disk_avail_threshold = 200, videocache will stop caching videos in a cache
# directory if the free space available in a partition containing that cache directory is
# less than 200 Mega Bytes.
disk_avail_threshold = 200

# Directory to store partially downloaded videos. Directory name is relative to base_dir.
temp_dir = tmp

# The maximum number of parallel downloads allowed. If all connections are consumed,
# videos will be queued for download.
max_parallel_downloads = 30

# Enables the videocache cleaner script which will remove videos
# from cache which have not been used since long.
# The value of this option can be 0 or 1.
enable_videocache_cleaner = 1

# The maximum life of a video in cache without being used. If the video was not accessed
# for more than 'video_lifetime' days, it'll be removed from the cache. The unit of
# video_lifetime is days.
# For Example : video_lifetime = 3 will remove videos which were not used since last 3 or more days.
video_lifetime = 30

# Directory where videocache logs will be stored.
logdir = /var/log/videocache/

# Maximum size of logfile specified above. The size is in mega bytes.
# Note : Please don't use max_logfile_size = 10MB. Don't append MB.
max_logfile_size = 10

# The logfiles are automatically rotated once they have exceeded the max_logfile_size.
# max_logfile_backups is the number of backup files you want to keep.
# e.g. max_logfile_backups = 2 will keep videocache.log and videocache.log.1 and
# videocache.log.2 as logfiles.
max_logfile_backups = 10

# XMLRPCServer is used for memory sharing across different instances of
# videocache. Leave these settings as it is if you don't have a fair
# idea of XMLRPCServer. This will be same as cache_host in almost all the cases.
rpc_host = 127.0.0.1

# Please make sure this port is not currently in use. If it is in use by some
# other program, change this to some port above 1024 which is not in use by
# any other program.
rpc_port = 9100

# This option enables the caching of youtube videos.
# This option's value can be either 0 or 1.
enable_youtube_cache = 1

# Directory to cache youtube videos. Directory name is relative to base_dir.
# e.g. if you specify youtube_cache_dir = youtube, actual path for caching
# youtube videos would be /var/spool/videocache/youtube/ .
youtube_cache_dir = youtube

# Youtube videos with size more than max_youtube_video_size will not be cached. This
# size is in kilo bytes. Use 0 for unlimited caching.
# e.g. max_youtube_video_size = 10000. Only videos with size less than 10MB (10000KB)
# will be cached.
# NOTE : Don't use max_youtube_video_size = 10000KB. Don't append KB.
max_youtube_video_size = 0

# Youtube videos with size less than min_youtube_video_size will not be cached. This
# size is in kilo bytes. Use 0 for no lower limit.
# e.g. min_youtube_video_size = 10. Only videos with size more than 10KB will be cached.
# NOTE : Don't use min_youtube_video_size = 10KB. Don't append KB.
min_youtube_video_size = 0

# Metacafe.com Options
enable_metacafe_cache = 1
metacafe_cache_dir = metacafe
max_metacafe_video_size = 0
min_metacafe_video_size = 0

# Dailymotion.com Options
enable_dailymotion_cache = 1
dailymotion_cache_dir = dailymotion
max_dailymotion_video_size = 0
min_dailymotion_video_size = 0

# Google.com Options
enable_google_cache = 1
google_cache_dir = google
max_google_video_size = 0
min_google_video_size = 0

# Redute.com Options
enable_redtube_cache = 1
redtube_cache_dir = redtube
max_redtube_video_size = 0
min_redtube_video_size = 0

# Xtube.com Options
enable_xtube_cache = 1
xtube_cache_dir = xtube
max_xtube_video_size = 0
min_xtube_video_size = 0

# Vimeo.com Options
enable_vimeo_cache = 1
vimeo_cache_dir = vimeo
max_vimeo_video_size = 0
min_vimeo_video_size = 0

# Wrzuta.pl Options
enable_wrzuta_cache = 1
wrzuta_cache_dir = wrzuta
max_wrzuta_video_size = 0
min_wrzuta_video_size = 0

# Youporn.com Options
enable_youporn_cache = 1
youporn_cache_dir = youporn
max_youporn_video_size = 0
min_youporn_video_size = 0

# Soapbox.msn.com Options
enable_soapbox_cache = 1
soapbox_cache_dir = soapbox
max_soapbox_video_size = 0
min_soapbox_video_size = 0

# Tube8.com Options
enable_tube8_cache = 1
tube8_cache_dir = tube8
max_tube8_video_size = 0
min_tube8_video_size = 0

# Tvuol.uol.com.br Options
enable_tvuol_cache = 1
tvuol_cache_dir = tvuol
max_tvuol_video_size = 0
min_tvuol_video_size = 0

# Blip.tv Options
enable_bliptv_cache = 1
bliptv_cache_dir = bliptv
max_bliptv_video_size = 0
min_bliptv_video_size = 0

# Break.com Options
enable_break_cache = 1
break_cache_dir = break
max_break_video_size = 0
min_break_video_size = 0
# --BEGIN-- videocache config for squid
url_rewrite_program /usr/bin/python /usr/share/videocache/videocache.py
url_rewrite_children 7
acl videocache_allow_url url_regex -i \\.youtube\\.com\\/get_video\\?
acl videocache_allow_url url_regex -i \\.googlevideo\\.com\\/videoplayback \\.googlevideo\\.com\\/videoplay \\.googlevideo\\.com\\/get_video\\?
acl videocache_allow_url url_regex -i \\.google\\.com\\/videoplayback \\.google\\.com\\/videoplay \\.google\\.com\\/get_video\\?
acl videocache_allow_url url_regex -i \\.google\\.[a-z][a-z]\\/videoplayback \\.google\\.[a-z][a-z]\\/videoplay \\.google\\.[a-z][a-z]\\/get_video\\?
acl videocache_allow_url url_regex -i (25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)\\.(25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)\\.(25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)\\.(25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)\\/videoplayback\\?
acl videocache_allow_url url_regex -i (25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)\\.(25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)\\.(25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)\\.(25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)\\/videoplay\\?
acl videocache_allow_url url_regex -i (25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)\\.(25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)\\.(25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)\\.(25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)\\/get_video\\?
acl videocache_allow_url url_regex -i proxy[a-z0-9\\-][a-z0-9][a-z0-9][a-z0-9]?\\.dailymotion\\.com\\/
acl videocache_allow_url url_regex -i vid\\.akm\\.dailymotion\\.com\\/
acl videocache_allow_url url_regex -i [a-z0-9][0-9a-z][0-9a-z]?[0-9a-z]?[0-9a-z]?\\.xtube\\.com\\/(.*)flv
acl videocache_allow_url url_regex -i bitcast\\.vimeo\\.com\\/vimeo\\/videos\\/
acl videocache_allow_url url_regex -i va\\.wrzuta\\.pl\\/wa[0-9][0-9][0-9][0-9]?
acl videocache_allow_url url_regex -i \\.files\\.youporn\\.com\\/(.*)\\/flv\\/
acl videocache_allow_url url_regex -i \\.msn\\.com\\.edgesuite\\.net\\/(.*)\\.flv
acl videocache_allow_url url_regex -i media[a-z0-9]?[a-z0-9]?[a-z0-9]?\\.tube8\\.com\\/ mobile[a-z0-9]?[a-z0-9]?[a-z0-9]?\\.tube8\\.com\\/
acl videocache_allow_url url_regex -i \\.mais\\.uol\\.com\\.br\\/(.*)\\.flv
acl videocache_allow_url url_regex -i \\.video[a-z0-9]?[a-z0-9]?\\.blip\\.tv\\/(.*)\\.(flv|avi|mov|mp3|m4v|mp4|wmv|rm|ram)
acl videocache_allow_url url_regex -i video\\.break\\.com\\/(.*)\\.(flv|mp4)
acl videocache_allow_dom dstdomain .mccont.com dl.redtube.com .cdn.dailymotion.com
acl videocache_deny_url url_regex -i http:\\/\\/[a-z][a-z]\\.youtube\\.com http:\\/\\/www\\.youtube\\.com
url_rewrite_access deny videocache_deny_url
url_rewrite_access allow videocache_allow_url
url_rewrite_access allow videocache_allow_dom
redirector_bypass on
# --END-- videocache config for squid

please Help !
Jorge

1 Answers

by jtamayo on 1 May 2009

i have tested the "import urlgrabber" in python comand line and it works, buut in the videocache py not

Jorge