How seriously should I take Matousec results?

Sorry if I posted this in the wrong section. Mods please move it to the right section. Anyway, I was searching the net for best performing security softwares and I came across this link

http://www.matousec.com/projects/proactive-security-challenge/results.php

I presently use Avast free anti virus in combination with Zone alarm free firewall, I had rootkit infection twice with this setup, it was pretty impossible to remove the rootkit and I had reformat the my pc. Can any other users explain if I should take the results seriously, is Avast really good? Please clear my doubts.

search the forum for matousec :wink:

If you don’t get what he means, he’s saying matousec isn’t very well known and it really isn’t trustable. Just stick with what you have.

Also, I’d recommend using Malwarebytes Anti-Malware. Amazing tool.

@ sepiashimmer
It also rather depends on what these rootkits were, there are a couple doing the rounds and the malware removal specialists are seeing this on virtually all AVs.

Whilst they are able to get in, avast is one of the few that is actually able to keep it from getting much worse, by blocking access to other malware sites for it to download more malware or possibly upload harvested data from your system.

So it isn’t quite a clear cut answer.

I believe essexboy said in another post, not too long ago, that the problem is not with Avast! not being able to detect a rootkit; it now detects, for example, all versions of the Serifef rootkit, but it cannot detect all versions of a dropper used to initiate the infection routine.

It is the dropper that gets by Avast!, and it is the same with the other a/v’s. Malware writers will change this dropper code almost hourly to evade detection.

Where Avast! is better, is in preventing deeper damage to your system by holding the malware in check.

Gizmo criticizes the Matousec’s tests. It’s a technical reading, but seems fair (http://www.techsupportalert.com/content/matousec-personal-firewall-tests-analyzed.htm).
Others point to an interest conflict on Matousec’s tests, reducing their independence (?) (http://smokeys.wordpress.com/2008/04/20/matousecs-firewall-challenge-wrinkle-conflict-of-interests/).

Leak tests are popular mainly because they are very easy to perform: you simply run a program, and it tells you if it passed or failed the test. However, life is not that simple, unfortunately.

The primary goal of a firewall is to keep hackers out of your system, that is, prevent inbound attacks in the first place. It’s astonishing that many firewaller “testers” only focus on outbound protection, completely ignoring the inbound part (which is absolutely vital). It’s like they assumed it worked flawlessly in case of all the products, which, unfortunately, doesn’t seem to be the case, really.

Next, outbound protection is of course also important, but so called leak tests are not everything. There’s a myriad of other things that a decent firewall should do, and which are usually not assesed by these tests. All I’m saying is that testing a firewall is a very complex task and focusing on leak tests is a gross (and inappropriate) simplification.

Hi Tech,

The proverb says:“The pot calls the kettle black”
But the critique also goes the other way round: http://www.thetechherald.com/articles/Security-vendors-respond-to-Matousec-research/10138/
This is one of their services: http://nmap-online.com/
My security seems OK - Starting Nmap 4.75 ( http://nmap.org ) at 2012-08-11 18:03 Central Europe Daylight Time
Note: Host seems down. Stealth and blocking their PNG probes,

polonus

i would not trash Matousec like in old ways e.g. http://www.matousec.com/info/reports/Online-Payments-Threats.pdf

also all theirs tests are available with source codes so it can be easily analyzed and in case of need covred, plugged and secured