Introduction

VideoCache Hacks

You are hereForums / Support / Scalability of Videocache

Version 1.9.9 is out. We have added support for Youtube mobile videos, Facebook, AOL and MySpace videos as well. Fixed caching issues for some already supported websites. Options to control cache directory selection algorithm, bandwidth usage by videocache, etc. More robust videocache scheduler with a lot more options and features. Have a look at changelog for more details. If you have purchased Videocache in last one year, Contact Us to claim your free upgrade. Please mention the email address using which you purchased Videocache. New users proceed to Pricing Page right now, secure your copy and enjoy caching :-) Also, check our new and simplified upgrade policy :-)

Scalability of Videocache

Post Reply
13 replies [Last post]
4 November, 2009 - 21:53
cygnus
Offline
Joined: Nov 4 2009
Scalability of Videocache
Printer-friendly versionSend to friend

Hi!

Has someone some clues how stable videocache works and how videocache scales? Currently I am evaluating it for two Squid 3 servers (Dual Xeon 3,2 GHz Blade machines) with 4 Gig ram serving about 4500 users.

Any users out there using videocache with so many or perhaps more users? Feedback would be appreciated.

Greetings Torge

Top
Tags:
8 November, 2009 - 12:13
#1
Anonymous (not verified)

Yeah I am using it for more then online 8000 users with dual quard core 2.4 Ghz and 16 GB Ram , 1.1 TB raid0 over 4*300GB SAS, using Centos 5.3 , squid 3 , with videocache 1.9.1 & lighttpd.

Top
8 November, 2009 - 15:20
#2
admin's picture
admin
Offline
Joined: Nov 2 2008

Thank anon for mentioning the stats. It would have been more useful if you could mention the location as in Organization/broadband users etc.

Thank You!

Top
10 November, 2009 - 14:04
#3
rudy_kot
Offline
Joined: Nov 10 2009

Hi

Do you use this box for videocaching only or for squid caching+videocaching? What kind of CPU usage / disk I/O do you experience?

I'm planning to upgrade my current squid box that's overloaded and I'm thinking of implementing videocache.

Top
19 November, 2009 - 02:55
#4
TheOne4u (not verified)

Hay Admin I am that Anonymous we well I have Some question Right Now I am using 2 Servers as :

Server A (192.168.10.10) is Centos 5.3 , squid 3 , with videocache 1.9.1 & lighttpd + NFS Server to share the /videocache directory.

Server B (192.168.10.20) is Centos 5.3 , squid 3 , with videocache 1.9.1 + NFS Client to read & write the /videocache from Server and its working fine when ever Cache HIT its redirect client to lighttpd of 192.168.10.10 as define cache_host = 192.168.10.10 on both servers.

Now I have couple of questions.
1 is Why Server B writes data so slow @ 1Mbits/s on Server A over NSF on /videocache/tmp as whole /videocache/ directory shared and used by both Servers even 4 to 6 movies are downloading from Internet by it. May be you can gave some advice over it.

2 is Now I want to add 1.5 TB raid0 using SAS or SSD on SERVER B and also want to use for Caching as base_dir = /videocache/ | /videocache2/.

As you already knows /videocache/ is over NFS from Server A.
/videocache2/ will be shared over NFS to Server A.

I wanna do that because I want to Marge both Servers for big Storage and to Increase the HIT ratio.

can we define cache_host = 192.168.10.10 | 192.168.10.20 like this so that users can be redirect or served from that web server on which the video file is located.

3rd is Are you planning to use mysql as database to store cache video file indexing info as I think it will be more easy to load balance over multiple Servers or Storage using single Database.

Sorry for bad english and Thanks in advance for the reply.

TheOne4u

Top
24 November, 2009 - 10:34
#5
admin's picture
admin
Offline
Joined: Nov 2 2008

TheOne4u,

1. You have debug your network for that. In this case, videocache is trying to write videos to the remote server.
2. As you are sharing things over NFS, apache can also use those directories. After modifying base_dir option, just run update-vc and everything will work as expected :)
3. Yes. In future versions, mysql may be used optionally for stats calculation etc.

BTW you are using videocache 1.9.1, please upgrade to 1.9.2 so that I can offer better support :)

Thank You!

Top
25 March, 2011 - 17:50
#6
pospanko
Offline
Joined: Feb 22 2011

Hi all.

I'm trying this setup, but how to enable ServerB to write on ServerA videocache folder?
I mount ServerA NFS to /proxy/videocache folder on ServerB with rw option.

On confif file I added base_dir = /proxy/videocache/ but when I run update-vc I get error and in my log is: Could not change ownership of directory /proxy/videocache01/tmp

How to solve this?
Thx

Top
29 March, 2011 - 16:07
#7
admin's picture
admin
Offline
Joined: Nov 2 2008

Hi!

The directory was not mounted properly or the user didn't have proper permission to change the ownership of that directory. Please check if the NFS permissions are fine?

Thank You!

Top
21 April, 2011 - 13:21
#8
pospanko
Offline
Joined: Feb 22 2011

Hi,

I manage it to work over NFS.

But now I have different problem.

My upload/download ratio is falling down rapidly. From 35% I now have only 15%. It looks like both servers are caching the same files.

Also, if I set both machines with cache_peer in sibling mode, videocache isn't working.

Can you help me what to do? I plan to put 3-4 separate machines with squid and VC and this is problem I must solve to have redudancy and speed.

P.S. Option proxy, do I have to fill it with address or I can leave it blank in this configuration. One proxy is 10.10.1.1 and there is videocache files, on other (10.10.2.1) I put 10.10.1.1 to cache_host, but do I need put something for proxy and do I have to change rpc_host ad port?

Thx in advance

Top
22 April, 2011 - 11:38
#9
admin's picture
admin
Offline
Joined: Nov 2 2008

Hi!

Your problem looks a bit complicated. Contact me using contact link and we'll discuss it in details over email.

Thank You!

Top
20 November, 2009 - 11:13
#10
Ez (not verified)

Dear Admin i am using the videocache but when i configure it it does not make cache any ssite but on log its running properly so what is the problem on it

Thanks

Top
24 November, 2009 - 10:25
#11
admin's picture
admin
Offline
Joined: Nov 2 2008

Ez,

Please check this comment.

Thank you!

Top
30 November, 2009 - 01:32
#12
TheOne4u (not verified)

can we define cache_host = 192.168.10.10 | 192.168.10.20 like this so that users can be redirect or served from that web servers on which the video file is located.

Yeah I will update to the next Version but after some time.

TheOne4u

Top
3 December, 2009 - 18:49
#13
admin's picture
admin
Offline
Joined: Nov 2 2008

TheOne4u,

Not now. But thanks for suggesting. Its a good idea :)

Thank You!

Top

Post new comment

The content of this field is kept private and will not be shown publicly. If you have a Gravatar account, used to display your avatar.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Allowed HTML tags: <a> <em> <strong> <cite> <code> <ul> <ol> <li> <dl> <dt> <dd> <img> <code>
  • Lines and paragraphs break automatically.
  • HTML tags will be transformed to conform to HTML standards.

More information about formatting options

CAPTCHA
Are you a human visitor ?
Image CAPTCHA
Enter the characters (without spaces) shown in the image.
‹ Previous topic: Query videocache queue? Next topic: Need Help in vc 1.9.8 ›

My Book on Squid

Purchase/Renew

One License - USD $399
One License - USD $349*
Validity - One Year
Need more? Contact Us
*Includes free upgrades and support for one year.



For details, check pricing.

New forum topics

more

Recent comments

Who's online

There are currently 0 users and 98 guests online.