Archive for the ‘varnish’ Category

rpm packages of varnish-2.1.5

Friday, February 4th, 2011

Varnish is a state of the art http accelerator, or frontside cache, if you like.

varnish-2.1.5 was released the other day. I have updated my packages in Fedora and epel6. Builds for rhel4 and rhel5 may be found at the usual http://users.linpro.no/ingvar/varnish/. The rhel5 packages require some dependencies pulled from epel5.

Varnish Software produces their own packages, based on the specfile I maintain for Fedora. The only important change is that my spins link against a system installed jemalloc, instead of the one provided with the source. This gives us the opportunity to update jemalloc to the latest version without recompiling varnish.

I also build packages for rhel4. While probably unsupported from Varnish Software, it compiles and runs the test suite after some small fixes to the build. jemalloc packages are provided as well.

Updated packages of varnish-2.1.4 revisited

Friday, November 5th, 2010

An extra update of the varnish-2.1.4 packages was pushed to Fedora (rawhide, f14, f13, epel6) yesterday, including a bugfix.

I also finally got around and fixed make-initscript-reload-do-load-and-switch-vcl, by popular request. I had a look at the script in Debian, but found it too magical. My version uses explicit configuration in /etc/sysconfig/varnish.

Updated packages for RHEL4 and 5 available at the usual place.

Most of this will end up upstream rsn, srsly.

Updated packages of varnish-2.1.4

Friday, October 29th, 2010

Varnish is a state of the art HTTP accelerator, used to keep sites like Twitter, Wikia and Facebook up to speed.

Varnish version 2.1.4 was released the other day. Users of RHEL5 and clones may now use Varnish Software’s own repo directly.

I have done a few improvements over the specfile in the released version. They will be synced upstream soon. I have built updated packages for Fedora Rawhide, 14, 13, and epel6. You can find them in their respective testing repos from where they will eventually trickle down to stable. I have also built updated packages for el4 and el5. You can find them at http://users.linpro.no/ingvar/varnish

If you use Varnish Software’s own repo for rhel5, the only changes to these newer packages are related to documentation and the building process, and there is no need to upgrade to these packages for stability or bugfix reasons.

Accelerating the Internet (or actually, Squid) with Varnish

Wednesday, May 26th, 2010

Squid is an old, working-horse, caching proxy server that can be configurated to act as a reverse proxy. Varnish is the opposite, it’s an extremely fast http accellerator that’s configurated to be, well, just that. So I thought, just for the fun of it, what about configurating Varnish to cache the Internet for me, that is, use it as a general forwarding caching proxy server.

Obviously, we can’t define varnish backends for the entire world. But Squid can do that. So I used our corporate Squid proxy, and put a local varnish cache in front of it. The vcl is very simple:

backend default {
  # This is squidbox
  .host = "11.22.33.44";
  .port = "3128";
}

That’s it, actually. Start up varnish, and use that varnish instance’s address and http port as proxy in your web browser.

Then, using an ugly little perl script “proxytest” for testing, we found these quite interesting results:

$ for i in "" squidbox:3128 varnishbox:6081; do ./proxytest $i http://www.slashdot.org/ 10; done
1.0836112s
0.3773585s
0.0352446s

Lesson learned: Varnish is some 10 times faster than Squid, when caching the Internet!

With thanks to eric for playing with settings.

RPM packages of varnish-2.1.2

Wednesday, May 5th, 2010

Varnish is a high performance web accelerator. For more information about varnish, see the project homepage.

I had just added varnish-2.1.1 to rawhide when the upstream team released a bugfix update varnish-2.1.2.

Rawhide is updated. I also built packages for RHEL5. You can download them at http://users.linpro.no/ingvar/varnish/2.1.2/, or from SourceForge.

The usage of varnish revisited

Thursday, January 21st, 2010

Varnish is a high-performance HTTP accelerator. Working with Varnish is part of my day job. Among other things, I maintain the packages for Fedora and EPEL.

This is more or less a repost, with updated numbers.

Some months have passed, and it is time to run my poking scripts again, looking for sites that run Varnish. There is no deep magic here. I just parse the available top lists that I know of, and peek at the HTML headers of the sites that are listed. If there are subsites linked from the front page of the site, I scan them too. This means that twitter.com shows up, though Twitter only runs Varnish on its search site. Subsites with a Varnish match are shown in parenthesis in the results.

For the Nordic countries, I have found quite good lists, that is, upload result lists from the probably most visited media sites in the respective countries. Remember of course, that these are generally pay-to-be-included lists, and there may exist sites with far more hits than the ones listed.

For a global overview, I have used Alexa.

Now for the results. Varnish is sponsored by large Norwegian sites, so it is no big surprise that there are a lot of hits in Norway. Of the TNS Gallup top list, Varnish runs at 36 of the top 100 sites. That’s 3 up since my last probe.

For Denmark, I use FDIM‘s list. From May, we are up from 3 to 11 sites in the top 100. For Finland, I use TNS’ numbers again. No changes there. For Sweden, I use the KIA Index list. I now probe the 200 top sites, so there are several more varnish sites on the list. In the top 100, we are up from 8 to 9.

For the Alexa’s World top 500 list, I have tweaked my filters a bit, and the list is up from 7 to 17 sites since my last probe in May. World Domination, here we come!

The whole World: Alexa's global top 500 list
Place  12 Varnish running on twitter.com (http://integratedsearch.twitter.com/search.html)
Place  47 Varnish running on photobucket.com (http://blog.photobucket.com/)
Place  90 Varnish running on mixi.jp (http://img.mixi.jp/static/css/basic/logout_quirks) (and others)
Place 101 Varnish running on weather.com (http://www.weather.com/) (weather.com)
Place 107 Varnish running on globo.com (globo.com) (http://www.globo.com/)
Place 111 Varnish running on ifeng.com (http://big5.ifeng.com/gate/big5/www)
Place 138 Varnish running on answers.com (http://www.answers.com/) (answers.com)
Place 170 Varnish running on orange.fr (http://r.orange.fr/r/Eorangepublicite)
Place 179 Varnish running on hulu.com (hulu.com)
Place 199 Varnish running on wikia.com (wikia.com)
Place 213 Varnish running on xinhuanet.com (http://big5.xinhuanet.com/gate/big5/www)
Place 290 Varnish running on people.com.cn (http://bbs1.people.com.cn/boardList) (and others)
Place 344 Varnish running on tuenti.com (http://estaticos1.tuenti.com/layout/web2/images/favicon)
Place 428 Varnish running on chinanews.com.cn (http://www.chinanews.com.cn/test/index_back_d.html) (and others)
Place 433 Varnish running on mercadolivre.com.br (http://veiculos.mercadolivre.com.br/) (and others)
Place 447 Varnish running on mercadolibre.com.mx (http://tendencias.mercadolibre.com.mx/) (and others)
Place 456 Varnish running on break.com (break.com)

In my last probe, I poked sites all over Europe. With a few exceptions, that was a bit less interesting. Global .com and .net sites tend to cover most of the top 100 entries, as I had only toolbar lists, and it’s not that spectacular that for example people in Serbia and Monte Negro are browsing Twitter, like the rest of the World does. So I have skipped other countries. If you know of any good top list for you country that is not toolbar based, please let me know.

All the gory details are available here.

Other more or less worth mentioned sites that is reported to use Varnish but does not show up in my lists, may be Slashdot, WAT TV, The Pirate Bay, JDownloader, e.Republik, WOWwiki, Globo.com, PCWelt.de, BlackPlanet, funnyordie.com, n-tv.de and 20minutos.es to name a few.

Do you know of other famous sites running Varnish? Use the comments.

varnish-2.0.5 released, rpm packages updated

Tuesday, November 10th, 2009

Varnish is a state of the art high performance HTTP accelerator. varnish-2.0.5 was released yesterday.

I have submitted varnish-2.0.5 for Fedora and Fedora EPEL, and updates to the stable releases will be requested, so they will trickle down to the stable repos in a few weeks.

For RHEL and derivates, updates for both el4 and el5 are in the EPEL testing repo. For those who are too impatient to wait for stable, or want to participate in testing, you can update the package with yum:

rhel5# yum --enablerepo=epel-testing update varnish

… or download the package from RedHat:

http://download.fedora.redhat.com/pub/epel/testing/

Fedora packages are still pending for testing, but will be visible in a
few days, I guess. If you need packages for Fedora now, try
http://kojipkgs.fedoraproject.org/packages/varnish/.

Bugs in the package can be reported in Red Hat’s Bugzilla:
http://bugzilla.redhat.com/ or to varnish-dist(a)projects.linpro.no.

The usage of Varnish revisited

Wednesday, May 20th, 2009

Varnish is a high-performance HTTP accelerator. Working with Varnish is part of my day job. Among other things, I maintain the packages for Fedora and EPEL.

Some months have passed, and it is time to run my poking scripts again, looking for sites that run Varnish. There is no deep magic here. I just parse the available top lists that I know of, and peek at the HTML headers of the sites that are listed. If there are subsites linked from the front page of the site, I scan them too. This means that twitter.com shows up, though Twitter only runs Varnish on its search site. Subsites with a Varnish match are shown in parenthesis in the results.

For the Nordic countries, I have found quite good lists, that is, upload result lists from the probably most visited media sites in the respective countries. Remember of course, that these are generally pay-to-be-included lists, and there may exist sites with far more hits than the ones listed.

For the rest, I have used Alexa and Netcraft’s toolbar users’ lists with main sites summed up. With a few exceptions, they are a bit less interesting, as global .com and .net sites tend to cover most of the top 100 entries anyway.

Now for the results. Varnish is sponsored by large Norwegian sites, so it is no big surprise that there are a lot of hits in Norway. Of the TNS Gallup top list, Varnish runs at some every third site.

For Denmark, I use FDIM‘s list. The results are more or less the same as in my last run. For Finland, I use TNS’ numbers again. There are +1 site in the TNS top list. For Sweden, I use the KIA Index list. There is -1 Varnish site there since last.

For a global overview, I have used Alexa’s top 500 list. This is the first time I have got any hit on that list. That is interesting. Twitter is probably the most well known site outside the geekosphere running Varnish now.

The whole World: Alexa's global top 500 list
Place  39 Varnish running on twitter.com (search.twitter.com)         
Place  83 Varnish running on globo.com (globo.com)                       
Place 166 Varnish running on ifeng.com (ifeng.com)                         
Place 194 Varnish running on people.com.cn (bbs1.people.com.cn)         
Place 227 Varnish running on hulu.com (hulu.com)                      
Place 282 Varnish running on wikia.com (wikia.com)                          
Place 467 Varnish running on perezhilton.com (perezhilton.com)

Probing the rest of the World would probably take too much time, so I have done a scan of Alexa’s and Netcraft’s lists for their toolbar users in the European countries.

All the gory details are available here.

Other worth mentioned sites that uses Varnish that does not show up on my Alexa’s global list may be Slashdot, WAT TV, The Pirate Bay, JDownloader, e.Republik, WOWwiki, the Brazilian news site Globo.com, the German IDG site PC Welt, and the Chinese computer tech site Csdn.net.

Do you know of other famous sites running Varnish? Use the comments.

The usage of the varnish in the Nordic countries

Monday, February 2nd, 2009

The Varnish http accellerator has gained some general usage in the Nordic countries over the last months.

In Norway, using the top list from TNS Gallup , varnish now runs on 13 of the top 30, and 27 of the top 100 sites on the list. Including in these results are also major sites finn.no and nrk.no, new since my last probes.

In Denmark, using the top list from FDIM, varnish runs on 3 sites in the top 15.

In Finland, using the top list from TNS Gallup, varnish runs on 4 of the top 100 sites.

And finally, in Sweden, using the top list from the KIA-index, varnish runs on 7 sites in the top 100, and 13 sites of the whole list.

Remember of course, that these top sites are generally pay-to-be-included lists, and there may exist sites with far more hits than the ones on the lists. yr.no for instance, a very popular Norwegian weather site, does use varnish, but is not included on the TNS Gallup list.

For reference, I have also done som simple non-weighted probing of the most hitted web sites for netcraft toolbar users, showing probably a bit more geeky cut of the browsing population, actually showing that yr.no and the infamous Pirate Bay also uses varnish.

Disclaimer: Working with the developers of Varnish is part of my day job.

All details below.

#
# Norway
#
# TNS Gallup Topplisten
Place   1 Varnish running on vg.no (sport.vg.no) (skatt.vg.no) (interaktiv.vg.no) (www.vg.no) (www1.vg.no)
Place   4 Varnish running on startsiden.no (img.startsiden.no) (www.startsiden.no)
Place   5 Varnish running on nrk.no (www1.nrk.no) (www.nrk.no)
Place   6 Varnish running on finn.no (cache.finn.no)
Place  10 Varnish running on aftenposten.no (www.aftenposten.no)
Place  14 Varnish running on abcnyheter.no (www.abcnyheter.no)
Place  16 Varnish running on klikk.no (www.klikk.no) (skatt.klikk.no)
Place  20 Varnish running on e24.no (www.e24.no)
Place  23 Varnish running on bt.no (www.bt.no) (fotball.bt.no) (images.bt.no)
Place  24 Varnish running on dn.no (multimedia.dn.no)
Place  26 Varnish running on adressa.no (kundeservice.adressa.no) (www.adressa.no) (fotball.adressa.no) (berlin.adressa.no)
Place  28 Varnish running on dinepenger.no (www.dinepenger.no)
Place  30 Varnish running on ba.no (www.ba.no) (bildeserier.ba.no)
Place  31 Varnish running on aftenbladet.no (fotball.aftenbladet.no)
Place  41 Varnish running on rb.no (www.rb.no) (tjenester.rb.no)
Place  47 Varnish running on speaker.no (live.speaker.no)
Place  49 Varnish running on kvinneguiden.no (bilder.kvinneguiden.no)
Place  52 Varnish running on h-avis.no (livefotball.h-avis.no)
Place  59 Varnish running on nordlys.no (www.nordlys.no)
Place  66 Varnish running on idg.no (www.idg.no)
Place  69 Varnish running on budstikka.no (livefotball.budstikka.no) (www.budstikka.no)
Place  75 Varnish running on tvnorge.no (limefiles.tvnorge.no) (www.tvnorge.no)
Place  81 Varnish running on tu.no (www1.tu.no) (www.tu.no) (web.tu.no)
Place  82 Varnish running on vl.no (www.vl.no)
Place  87 Varnish running on nationen.no (www.nationen.no)
Place  92 Varnish running on rbk.no (www.rbk.no)
Place  98 Varnish running on journalisten.no (www.journalisten.no)
Place 103 Varnish running on dagligvarehandelen.no (www.dagligvarehandelen.no)

# Norwegian Netcraft toolbar users
Place   1 Varnish running on www.startsiden.no (www.startsiden.no)
Place   2 Varnish running on www.vg.no (www.vg.no)
Place   4 Varnish running on www.aftenposten.no (www.aftenposten.no)
Place   9 Varnish running on www.yr.no (www.yr.no)  
Place  14 Varnish running on www.bt.no (www.bt.no)         
Place  15 Varnish running on e24.no (e24.no) 
Place  16 Varnish running on sokm.startsiden.no (sokm.startsiden.no)
Place  20 Varnish running on www.abcnyheter.no (www.abcnyheter.no)
Place  21 Varnish running on www.adressa.no (www.adressa.no)
Place  23 Varnish running on www.nrk.no (www.nrk.no) 
Place  30 Varnish running on www1.vg.no (www1.vg.no)    
Place  46 Varnish running on www.ba.no (www.ba.no)           
Place  50 Varnish running on nrk.no (nrk.no) (www1.nrk.no) (www.nrk.no)
Place  51 Varnish running on vg.no (www.vg.no) (vg.no)
Place  57 Varnish running on www1.nrk.no (www1.nrk.no)  
Place  64 Varnish running on go.nrk.no (go.nrk.no)      
Place  68 Varnish running on www.norman.com (www.norman.com)
Place  79 Varnish running on www.op.no (www.op.no)         
Place  87 Varnish running on www.klikk.no (www.klikk.no) 
Place  88 Varnish running on atvs.vg.no (atvs.vg.no)


#
# Denmark
#
# FDIM toplist
Place   5 Varnish running on ekstrabladet.dk (multimedia.ekstrabladet.dk)
Place   9 Varnish running on dmi.dk (www.dmi.dk) (dmi.dk)
Place  14 Varnish running on jp.dk (multimedia.jp.dk)
Place 110 Varnish running on slankedoktor.dk (slankedoktor.dk)

# Danish Netcraft toolbar users
Place   4 Varnish running on ekstrabladet.dk (multimedia.ekstrabladet.dk)
Place   6 Varnish running on www.dmi.dk (www.dmi.dk)
Place  11 Varnish running on jp.dk (multimedia.jp.dk)  
Place  18 Varnish running on www.komogvind.dk (www.komogvind.dk)
Place  58 Varnish running on www.spielmit.com (www.spielmit.com)


#
# Finland
#
# TNS Gallup Finland
Place  56 Varnish running on talouselama.fi (www.talouselama.fi) (talouselama.fi)
Place  61 Varnish running on tekniikkatalous.fi (tekniikkatalous.fi) (www.tekniikkatalous.fi)
Place  67 Varnish running on arvopaperi.fi (arvopaperi.fi) (www.arvopaperi.fi)
Place  96 Varnish running on marmai.fi (marmai.fi) (www.marmai.fi)
Place 124 Varnish running on mediuutiset.fi (mediuutiset.fi) (www.mediuutiset.fi)

# Finnish Netcraft toolbar users
Place  13 Varnish running on apareena.arvopaperi.fi (apareena.arvopaperi.fi)


#
# Sweden
#
# KIA-Index
Place  20 Varnish running on Sydsvenskan.se (Sydsvenskan.se)
Place  39 Varnish running on hd.se (websvcc.hd.se) (coachen.hd.se) (misc.hd.se) (media.hd.se) (hd.se)
Place  48 Varnish running on alltomstockholm.se (www.alltomstockholm.se) (alltomstockholm.se)
Place  81 Varnish running on nyteknik.se (www.nyteknik.se) (nyteknik.se)
Place  83 Varnish running on affarsvarlden.se (affarsvarlden.se) (www.affarsvarlden.se)
Place  90 Varnish running on nwt.se (nwt.se)            
Place  99 Varnish running on bt.se (www.bt.se)         
Place 102 Varnish running on smp.se (www.smp.se) (smp.se)
Place 112 Varnish running on barometern.se (www.barometern.se) (barometern.se)
Place 113 Varnish running on norran.se (vader.norran.se) (norran.se)
Place 130 Varnish running on blt.se (www.blt.se) (blt.se)
Place 245 Varnish running on pchemma.se (pchemma.se) (www.pchemma.se)
Place 250 Varnish running on ut.se (ut.se) (www.ut.se)

# Swedish Netcraft toolbar users
Place   6 Varnish running on www.aftonbladet.se (www.aftonbladet.se)
Place  24 Varnish running on www.svd.se (www.svd.se)         
Place  29 Varnish running on torrents.thepiratebay.org (torrents.thepiratebay.org)
Place  38 Varnish running on aftonbladet.se (aftonbladet.se) (www.aftonbladet.se)
Place  44 Varnish running on www.e24.se (www.e24.se)                
Place  63 Varnish running on www.tietoviikko.fi (www.tietoviikko.fi)


Varnish in EPEL – packages for Red Hat Enterprise Linux and clones

Monday, October 20th, 2008

I requested EPEL EL-4 and EL-5 tag and build for varnish on friday night. The packages will be included in the main EPEL repos at the next sync from testing, that is primo November. These packages are the same as we use in production, and should be quite ready for general usage. Packages are available at http://download.fedora.redhat.com/pub/epel/testing/ . There is a list of known bugs that will be fixed eventually in the 2.0 series at http://varnish.projects.linpro.no/wiki/TroubleLog

Please report any problems as tickets in Trac at http://varnish.projects.linpro.no/ (you’ll to register and login to file tickets). Bugs reported by RedHat’s Bugzilla will end up the same place over time, but we would prefer our the local ticket system.