Survival of the Fittest

The Internet Storm Center blogged about the Survival Time on the Internet today. The survival time is defined as:
The survivaltime is calculated as the average time between reports for an average target IP address. If you are assuming that most of these reports are generated by worms that attempt to propagate, an unpatched system would be infected by such a probe.
The average time between probes will vary widely from network to network. Some of our submitters subscribe to ISPs which block ports commonly used by worms. As a result, these submitters report a much longer 'survival time'. On the other hand, University Networks and users of high speed internet services are frequently targeted with additional scans from malware like bots. If you are connected to such a network, your 'survival time' will be much smaller.
The main issue here is of course that the time to download critical patches will exceed this survival time.

With the help of honeypots, we can measure the survival time. For example, we can use low-interaction honeypot such as nepenthes or amun that emulate common network-based vulnerabilities and deploy them at different locations. The average time it takes to download the first binary is an estimation of the survival time: The honeypots emulate known vulnerabilities and are thus exploited by different kinds of autonomous spreading malware - similar to an unpatched system. At our lab, we deployed ten honeypots in different network ranges and measured different things as I'll explain with the following graphs. These are all based on measurements between August 2007 and July 2008.


This plot shows the total number of attacks (blue) and of downloads (red) per sensor for the measurement period. We see that there are huge differences depending on the network location (e.g., whether or not the ISP filters specific ports). Furthermore, not all attacks are successful and we also observed quite a lot failed attacks.


This plot shows the percentage of attacks (red) and downloads (blue) per time of day. We can observe a clear diurnal pattern: lower attack volume during the night and higher attack volume during the day, following the typical behavior of humans.


This plot shows the attacks (blue) and the downloads (red) per weekday for all sensors during the measurement period. The values are given in percentage of the sum of all attacks/downloads over the chosen period of time. The attack traffic is slightly higher during the weekends.


Another interesting observation is whether or not the attacks originate from the same ASN as the honeypot as depicted in the above picture. The figure shows the percentage of attacks coming from the same ISP as the honeypot, e.g., for sensor 1, about 90% of the attacks originate from machines within the same autonomous system. The graph can be interpreted as many attacks being local - which makes sense since autonomous spreading malware often prefers to propagate locally. In some ASNs, however, it seems like most attacks originate from other ASNs.


Finally, this graph shows an estimation of the survival time: The graph shows the average amount of time for the honeypot to be attacked successfully. Red bars are honeypots with a static IP address, thus we have only one measurement point for these honeypots. For the blue bars, each honeypot had a dynamic IP address, e.g., a disconnect every 24 hours. The bar depicts the average time from obtaining a new DHCP lease to first download which can be interpreted as the time it would take for an unpatched system to be compromised. Compared to the survival time from the Internet Storm Center which is currently below five minutes, we measure a higher survival time. However, the time is still short and you need to patch a system before taking it online.

More information and many more graphs are available in the thesis from Laura Itzel (unfortunately in German only).

Update: I updated the description of the fourth figure to explain it a bit better for non-German speaking readers.

Trackbacks

  1. Nach fünf Minuten gehackt? Heise will es wissen

    Heise Security fragt sich, was eigentlich zu halten sei von der immer wieder kolportierten Behauptung, ein ungepatchtes System am Netz sei nach wenigen Minuten kompromittiert. Am Ende steht eine Wette: »Und wer’s nicht glaubt: Ich wette einen Ka...

Comments

Display comments as (Linear | Threaded)

  1. Bob Brown says:

    The next to the last graph is not explained well for English-only speaking readers, as the graph legends are in German. Clarification would be appreciated.

  2. Thorsten says:

    I'll update the entry to explain the figure a bit better :-)

  3. Andrej says:

    Are most/all these vulnerabilities remotely triggered ?
    I'm asking this because there is a common belief that if a system has an active firewall when connected to the internet it would be safe to perform all the updates (the connections to that computer would be controlled by the firewall) and the survival time is thus increased allowing for patching.

  4. Thorsten says:

    Yes, all these vulnerabilities are remotely triggered: they are caused by autonomous spreading malware that tries to exploit well-known vulnerabilities. The honeypot emulates these vulnerabilities and tricks the malware into thinking that it actually exploits a real system.
    You are right, an active firewall definitely helps to protect against this kind of threats.

  5. David Oxley says:

    A great article. After years of reformatting and reinstalling computers, the "4 Minute Rule" has always seemed a bit far-fetched. This seems far more plausible.

    I'd be curious to see what older exploits were the most often-used, too. A future post? :)

  6. Yonah says:

    You don't tell us WHICH version of Windows was used? Pre service pack XP? Vista? Why do you show the results but omit the details?

  7. Thorsten says:

    Yonah, if you read the blog posting things should be more clear: "For example, we can use low-interaction honeypot such as nepenthes or amun that emulate common network-based vulnerabilities and deploy them at different locations."

    Thus we did not use native machines, but low-interaction honeypots that emulate different kinds of exploits. You can find more information about these tools at http://nepenthes.mwcollect.org and http://amunhoney.sf.net - hope this helps to understand the results a bit better.

  8. Nick B says:

    But were you emulating vulnerabilities that affect specific states of Windows? Unpatched XP vs. unpatched Vista are far different animals, after all.

  9. XP2003 says:

    These links are nearly impossible to understand, and the whole information is very blurry and incomplete, with no details given.

    So, which OS and SP and with/without firewall would be affected in this way?
    Say XP with SP2 and the XP firewall enabled upon installation, is that what your test refer to? Or do your tests represent Win98 only? I know what a honeypot is, but there's no use knowing that without also knowing which exact OS and SP-level it's presents itself as, signature-wise.
    And, does the user have to use the web browser? download e-mail or anything like that, or is it enough to just connect the computer and leave it unattended?

  10. Ross Richards says:

    I've always found the compromise will happen in less than 5 minutes, normally around the 2-3 minute mark(if that).

    Run a blank Windows machine with a updated realtime AV scan as a DMZ server. Time it from when you get an IP address to the AV detects the malware drop on the HD. I've done it to see and it's mostly around the 2-3 minute mark.

    Like all statistics, you need a fairly broad base to gather from and I think the statistics above are skewed drasticly.

    For example the following things would affect the statistics:

    Netblock you belong too
    Country - laws/hygene
    Current release of exploits
    Time of day
    Botnet ownerships/age/location/size

    Regardless, you still need to patch a Windows box before it comes onto the internet and the research helps underline that security is still not taken seriously at Redmond. 2008 aint much better.

  11. Thorsten says:

    I think the figures already address some of your concerns:
    - Figure 1, 4, and 5 show that the statistics depend on the netblock / country the machine belongs to.
    - Figure 2 and 3 show that the time of day has a significant influence on the statistics.

    Of course, the current release of exploits and the "online" botnets also influence this number - but that's not that easy measurable.

    Furthermore, I think that Microsoft does take security seriously in 2008: A Vista machine would presumably survive without any problems and also XP SP3 would survive for a long time. Remember: These statistics are for old exploits against unpatched systems (emulated by honeypots).

  12. Ross Richards says:

    It's the execution of the firewall and similiar security systems.

    Take UAC, its part of the operating system now and is great for a SOHO environment. Most people turn it off though. Vista/2008 is better..but is it robust enough to survive another 3 years? Not really. Hyper-V, single click firewalls = more types of malware.

    It really comes back to their architectual design, which will always be difficult to police in a Microsoft environment.
    The svr 2008 minimalist idea is heading in the right direction. *You don't need a firewall if your software isnt exploitable*.

    If they could only apply this to the desktop. The problem with this would ruin their $ return as they wouldn't need to reinvent/improve anymore.

    ..Hence why the eco-system itself is flawed and will always be the maker of problems.

    Regards,
    Ross

    www.rhinofile.com - Large file upload

  13. Thorsten says:

    "is it robust enough to survive another 3 years" -> How many remote exploits were published since the release of Vista? Are there any major remote vulnerabilities for XP SP3?

    I think MS did a great job improving the security and the network-based attacks are getting less and less - we currently observe the shift to more client-side attacks (e.g., browser or Office applications) and social engineering is still very successful as Storm showed.

  14. PMC says:

    Where do you get your statistics that most people turn off UAC?

  15. Steve Lloyd says:

    I don't really understand your hour of the day plot. If these are bots why do they follow the human activity pattern so closely. I would have expected the attacks to be much more uniform in time. Presumably the compromised computers are not on at night. It does support the hypothesis that they are local though otherwise they would be randomised by timezone variations.

  16. Thorsten says:

    Steve, I interpret the hour of the day plot similar to the way you interpret the data: Since most attacks are local (see Fig. 4), also the attacks follow a diurnal pattern. Many compromised machines are running on dial-up lines (most honeypots are deployed at DSL lines) and are thus presumably turned on in the morning and turned off during the evening.
    Actually if I plot the hour of the day plot with one of the sensors that does not receive local attacks (e.g., sensor 6), then the graph degrades and the pattern is not as clearly visible as over all data.
    Some time ago I also blogged about these diurnal pattern that we can often observe within botnets:
    http://honeyblog.org/archives/20-Diurnal-models-in-botnet-propagation.html and
    http://honeyblog.org/archives/19-Modeling-Botnet-Propagation-Using-Time-Zones.html

  17. Ross Richards says:

    Yes I agree it has improved a little. But any company can improve in 3 years.

    What I'm saying is the architecture and business goals go off on a tangent when it comes to the seriousness & quality of their eco-system.

    If they were serious Vista would be tighter, leaner and simpler to use, which it's not.

    I'm not trying to turn this into an MS bashing thing but it really has a lot of evidence to back this up.

  18. Brian says:

    Assuming that an XP box was exploited before patching, what would be the best way to a) determine that fact, and b) recover from it? Can anyone recommend some good links on this subject? Thanks!

  19. Eric Pinkerton says:

    Thats just it! you should assume any XP box on the internet, without patches or firewalls is compromised.

    You could monitor your egress traffic to see what your box is doing - if your compromised by a worm it is reasonable to expect your machine to try and infect others, if your compromised by a bot it is likely to attempt to phone home at some point - but unless you are experienced with this it might be like looking for a needle in a haystack with binoculars.

    If you wait long enough your ISP will probably tell you of the problem following the complaints from others about your machine attacking theirs.

    As for recovering from it, thats easy - simply format the machines and re install from scratch - this time install a personal firewall and patch and harden behind a Nat router (Microsoft themselves acknowlege that the only way to clean a compromised machine is to rebuild.

  20. Samor says:

    I do have experience with letting an unpatched XP (without service pack) on the net, and if you do not enable the/a firewall prior to doing so, it gets compromised quickly.

  21. Oj says:

    Hmmm. I just put 2 brand new laptops (one with Vista Home Premium and one with XP SP2) into service. The first thing I did was go to Windows Updates and install the updates. However, they were on the network WAY longer than 4 minutes. I don't know what kind of firewall my ISP (at home) uses, but as far as I can tell, I wasn't attacked or compromised....

  22. Vladimir says:

    Does the router save from this stuff? Or maybe some firewalls?

  23. William says:

    Thank you for the very fine article which was clear and informative.

    For normal usage, the exact time doesn't matter.

    When you bring home that new system, spend the extra bucks for a small router, turn off all other systems before connecting the new one and patch patch patch.

    Don't forget all the stuff that doesn't get included in windows updates, actobat, quick time, flash, shockwave, real player, ...

    Install and update anti virus before copying files to the new system.

  24. maht says:

    Survival of the fittest in Darwinian terms means survivial of organisms most suited to a particular ecological niche, i.e. they are a good fit for their environment.

    Windows/Unix niche was never "terminal in a worldwide nework of hostile entities" it is "localised network of benevolent entities". MacOSX has also tried to fit into the wrong niche (if you want a robust terminal).

    When deciding what system to hook up to a hostile environment it is better to choose a system designed primarily for that niche (such as OpenBSD / Plan 9 etc.al.) even if Linus calls you a wanker for doing so.


Add Comment


Enclosing asterisks marks text as bold (*word*), underscore are made via _word_.
E-Mail addresses will not be displayed and will only be used for E-Mail notifications

To prevent automated Bots from commentspamming, please enter the string you see in the image below in the appropriate input box. Your comment will only be submitted if the strings match. Please ensure that your browser supports and accepts cookies, or your comment cannot be verified correctly.
CAPTCHA

 
Submitted comments will be subject to moderation before being displayed.