Discussion:
[clamav-users] Freshclam failing
James Brown
2015-03-11 23:04:41 UTC
Permalink
Freshclam keeps failing for me. I delete the Mirrors.dat file and try again. Sometime it works, sometimes it claims that all of the mirrors are not synchronised.

This is the sort of thing I get running freshclam:

$ sudo freshclam
Password:
ClamAV update process started at Thu Mar 12 09:56:45 2015
main.cvd is up to date (version: 55, sigs: 2424225, f-level: 60, builder: neo)
WARNING: getfile: daily-20178.cdiff not found on remote server (IP: 193.1.193.64)
WARNING: getpatch: Can't download daily-20178.cdiff from db.AU.clamav.net
Trying host db.AU.clamav.net (117.104.160.194)...
WARNING: getfile: daily-20178.cdiff not found on remote server (IP: 117.104.160.194)
WARNING: getpatch: Can't download daily-20178.cdiff from db.AU.clamav.net
WARNING: getpatch: Can't download daily-20178.cdiff from db.AU.clamav.net
WARNING: Incremental update failed, trying to download daily.cvd
Downloading daily.cvd [100%]
WARNING: Mirror 117.104.160.194 is not synchronized.
Trying again in 5 secs...
ClamAV update process started at Thu Mar 12 09:56:56 2015
main.cvd is up to date (version: 55, sigs: 2424225, f-level: 60, builder: neo)
Trying host db.AU.clamav.net (193.1.193.64)...
WARNING: getfile: daily-20178.cdiff not found on remote server (IP: 193.1.193.64)
WARNING: getpatch: Can't download daily-20178.cdiff from db.AU.clamav.net
WARNING: getpatch: Can't download daily-20178.cdiff from db.AU.clamav.net
WARNING: getpatch: Can't download daily-20178.cdiff from db.AU.clamav.net
WARNING: Incremental update failed, trying to download daily.cvd
Downloading daily.cvd [100%]
WARNING: Mirror 117.104.160.194 is not synchronized.
Trying again in 5 secs...
ClamAV update process started at Thu Mar 12 09:57:04 2015
main.cvd is up to date (version: 55, sigs: 2424225, f-level: 60, builder: neo)
Trying host db.AU.clamav.net (193.1.193.64)...
WARNING: getfile: daily-20178.cdiff not found on remote server (IP: 193.1.193.64)
WARNING: getpatch: Can't download daily-20178.cdiff from db.AU.clamav.net
WARNING: getpatch: Can't download daily-20178.cdiff from db.AU.clamav.net
ERROR: getpatch: Can't download daily-20178.cdiff from db.AU.clamav.net
WARNING: Incremental update failed, trying to download daily.cvd
Downloading daily.cvd [100%]
WARNING: Mirror 117.104.160.194 is not synchronized.
Giving up on db.AU.clamav.net...
ClamAV update process started at Thu Mar 12 09:57:06 2015
main.cvd is up to date (version: 55, sigs: 2424225, f-level: 60, builder: neo)
Trying host database.clamav.net (193.1.193.64)...
WARNING: getfile: daily-20178.cdiff not found on remote server (IP: 193.1.193.64)
WARNING: getpatch: Can't download daily-20178.cdiff from database.clamav.net
WARNING: getpatch: Can't download daily-20178.cdiff from database.clamav.net
ERROR: getpatch: Can't download daily-20178.cdiff from database.clamav.net
WARNING: Incremental update failed, trying to download daily.cvd
Downloading daily.cvd [100%]
WARNING: Mirror 117.104.160.194 is not synchronized.
Giving up on database.clamav.net...
Update failed. Your network may be down or none of the mirrors listed in /usr/local/etc/freshclam.conf is working. Check http://www.clamav.net/doc/mirrors-faq.html for possible reasons.

Is it just the Australian mirrors that are the problem? Should I get my country to be somewhere else?

They are very unreliable - obviously running with outdated signatures is not good!

Any suggestions?

Shouldn’t it try another server when db.AU.clamav.net <http://db.au.clamav.net/> fails? Looks like in the above example it keeps trying 193.1.193.64 and 117.104.160.194.

Thanks,

James.
_______________________________________________
Help us build a comprehensive ClamAV guide:
https://github.com/vrtadmin/cl
Benny Pedersen
2015-03-11 23:11:47 UTC
Permalink
Post by James Brown
Freshclam keeps failing for me. I delete the Mirrors.dat file and try
again. Sometime it works, sometimes it claims that all of the mirrors
are not synchronised.
freshclam --list-mirrors

try change mirror country temporary, but mirror admins would solve from
the --list-mirrors
_______________________________________________
Help us build a comprehensive ClamAV guide:
https://github.com/vrtadmin/clamav-faq

http://www.clamav.net/contact.html#ml
James Brown
2015-03-11 23:14:03 UTC
Permalink
Post by Benny Pedersen
Post by James Brown
Freshclam keeps failing for me. I delete the Mirrors.dat file and try
again. Sometime it works, sometimes it claims that all of the mirrors
are not synchronised.
freshclam --list-mirrors
try change mirror country temporary, but mirror admins would solve from the --list-mirrors
$ freshclam --list-mirrors
Mirror #1
IP: 193.1.193.64
Successes: 4
Failures: 2
Last access: Thu Mar 12 10:08:22 2015
Ignore: Yes
-------------------------------------
Mirror #2
IP: 117.104.160.194
Successes: 0
Failures: 2
Last access: Thu Mar 12 10:09:36 2015
Ignore: Yes

James.

_______________________________________________
Help us build a comprehensive ClamAV guide:
https://github.com/vrtadmin/clamav-faq

http://www.clamav.net/contact.html#ml
Al Varnell
2015-03-12 00:15:59 UTC
Permalink
I help ClamXav users (Macintosh) with such issues, and I would just add that there have been more problems with AU users regarding things like this than any other, dating back to at least 2007.

There are only two mirrors for AU:
db.au.clamav.net. 60 IN A 193.1.193.64
db.au.clamav.net. 60 IN A 117.104.160.194

The first is in Dublin, Ireland and the second in Canberra. I’m not sure who came up with this combination nor do I have any information with regard to the load coming from AU, but I’ve said before that it looks to be quite fragile.

-Al-
Post by James Brown
Post by Benny Pedersen
Post by James Brown
Freshclam keeps failing for me. I delete the Mirrors.dat file and try
again. Sometime it works, sometimes it claims that all of the mirrors
are not synchronised.
freshclam --list-mirrors
try change mirror country temporary, but mirror admins would solve from the --list-mirrors
$ freshclam --list-mirrors
Mirror #1
IP: 193.1.193.64
Successes: 4
Failures: 2
Last access: Thu Mar 12 10:08:22 2015
Ignore: Yes
-------------------------------------
Mirror #2
IP: 117.104.160.194
Successes: 0
Failures: 2
Last access: Thu Mar 12 10:09:36 2015
Ignore: Yes
James.
_______________________________________________
Help us build a comprehensive ClamAV guide:
https://github.com/vrtadmin/clamav-faq

http://www.clamav.net/contact.html#ml
Dennis Peterson
2015-03-12 00:24:42 UTC
Permalink
Try using db.jp.clamav.net. Lots of mirrors and they're practically next door as
under-sea cables go.

nslookup db.jp.clamav.net
Server: 127.0.0.1
Address: 127.0.0.1#53

Non-authoritative answer:
Name: db.jp.clamav.net
Address: 27.96.54.66
Name: db.jp.clamav.net
Address: 120.29.176.126
Name: db.jp.clamav.net
Address: 203.178.137.175
Name: db.jp.clamav.net
Address: 203.212.42.128
Name: db.jp.clamav.net
Address: 218.44.253.75
Name: db.jp.clamav.net
Address: 219.94.128.99

The US list has some serious problems, too. Two sites with zero successes and
each with 10 or more failures. Surely Cisco can do better than this. The
internet runs on their hardware.

freshclam --list-mirrors |grep -B3 -A3 Failures:\ [12][0-9]
Mirror #4
IP: 209.198.147.20
Successes: 10
Failures: 12
Last access: Mon Mar 2 03:14:39 2015
Ignore: No
-------------------------------------
--
Mirror #6
IP: 78.46.84.244
Successes: 0
Failures: 25
Last access: Wed Mar 4 04:38:58 2015
Ignore: No
-------------------------------------
--
Mirror #12
IP: 65.19.179.67
Successes: 0
Failures: 23
Last access: Mon Feb 9 03:45:32 2015
Ignore: No
-------------------------------------


dp
Post by James Brown
Post by Benny Pedersen
Post by James Brown
Freshclam keeps failing for me. I delete the Mirrors.dat file and try
again. Sometime it works, sometimes it claims that all of the mirrors
are not synchronised.
freshclam --list-mirrors
try change mirror country temporary, but mirror admins would solve from the --list-mirrors
$ freshclam --list-mirrors
Mirror #1
IP: 193.1.193.64
Successes: 4
Failures: 2
Last access: Thu Mar 12 10:08:22 2015
Ignore: Yes
-------------------------------------
Mirror #2
IP: 117.104.160.194
Successes: 0
Failures: 2
Last access: Thu Mar 12 10:09:36 2015
Ignore: Yes
James.
_______________________________________________
https://github.com/vrtadmin/clamav-faq
http://www.clamav.net/contact.html#ml
_______________________________________________
Help us build a comprehensive ClamAV guide:
https://github.com/vrtadmin/clamav-faq

http://www.clamav.net/contact.html#ml
Al Varnell
2015-03-12 00:32:54 UTC
Permalink
This one should be gone: "Re: [clamav-users] Mirrors 65.19.179.67"
<http://lurker.clamav.net/message/20150212.145031.f8669263.en.html>

-Al-
Post by Dennis Peterson
Mirror #12
IP: 65.19.179.67
Successes: 0
Failures: 23
Last access: Mon Feb 9 03:45:32 2015
Ignore: No
-Al-
--
Al Varnell
Mountain View, CA




_______________________________________________
Help us build a comprehensive ClamAV guide:
https://github.com/vrtadmin/clamav-faq

http://www.clamav.net/contact.html#ml
Dennis Peterson
2015-03-12 00:45:52 UTC
Permalink
For people with their own DNS servers it is a fairly trivial thing to do to
create a DNS-based load balanced round robin server list using all the servers
from all world regions. Not unlike a BigIP in that regard, you check the
response lag of a DNS query to all servers and you might as well make it count
by grabbing the current signatures from the TXT record. A little bit of code to
find the mirrors with the best response and newest signatures, update the local
zone file and go to it. It shouldn't take long to zero in on the 10 top world
wide mirrors. This would be particularly nice if you are also a private mirror.

Reminds me of how we used to load balance software license servers at Boeing. In
that case we looked for servers that were up and had the most free licenses.

dp
Post by Al Varnell
This one should be gone: "Re: [clamav-users] Mirrors 65.19.179.67"
<http://lurker.clamav.net/message/20150212.145031.f8669263.en.html>
-Al-
Post by Dennis Peterson
Mirror #12
IP: 65.19.179.67
Successes: 0
Failures: 23
Last access: Mon Feb 9 03:45:32 2015
Ignore: No
-Al-
_______________________________________________
Help us build a comprehensive ClamAV guide:
https://github.com/vrtadmin/clamav-faq

http://www.clamav.net/contact.html#ml
James Brown
2015-03-12 01:12:50 UTC
Permalink
Thanks Dennis, JP seems to be much better:

$ sudo freshclam
ClamAV update process started at Thu Mar 12 12:08:25 2015
main.cvd is up to date (version: 55, sigs: 2424225, f-level: 60, builder: neo)
Downloading daily-20182.cdiff [100%]
daily.cld updated (version: 20182, sigs: 1346196, f-level: 63, builder: neo)
Empty script safebrowsing-43085.cdiff, need to download entire database
nonblock_recv: recv timing out (30 secs)
WARNING: getfile: Error while reading database from db.JP.clamav.net (IP: 219.94.128.99): Operation now in progress
WARNING: Can't download safebrowsing.cvd from db.JP.clamav.net
Trying again in 5 secs...
ClamAV update process started at Thu Mar 12 12:09:09 2015
main.cvd is up to date (version: 55, sigs: 2424225, f-level: 60, builder: neo)
daily.cld is up to date (version: 20182, sigs: 1346196, f-level: 63, builder: neo)
Empty script safebrowsing-43085.cdiff, need to download entire database
nonblock_recv: recv timing out (30 secs)
WARNING: getfile: Error while reading database from db.JP.clamav.net (IP: 203.178.137.175): Operation now in progress
WARNING: Can't download safebrowsing.cvd from db.JP.clamav.net
Trying again in 5 secs...
ClamAV update process started at Thu Mar 12 12:09:45 2015
main.cvd is up to date (version: 55, sigs: 2424225, f-level: 60, builder: neo)
daily.cld is up to date (version: 20182, sigs: 1346196, f-level: 63, builder: neo)
Empty script safebrowsing-43085.cdiff, need to download entire database
Downloading safebrowsing.cvd [100%]
safebrowsing.cvd updated (version: 43119, sigs: 1223029, f-level: 63, builder: google)
bytecode.cld is up to date (version: 247, sigs: 41, f-level: 63, builder: dgoddard)
Database updated (4993491 signatures) from db.JP.clamav.net (IP: 27.96.54.66)
Clamd successfully notified about the update.

Thanks again,

James.
Try using db.jp.clamav.net. Lots of mirrors and they're practically next door as under-sea cables go.
nslookup db.jp.clamav.net
Server: 127.0.0.1
Address: 127.0.0.1#53
Name: db.jp.clamav.net
Address: 27.96.54.66
Name: db.jp.clamav.net
Address: 120.29.176.126
Name: db.jp.clamav.net
Address: 203.178.137.175
Name: db.jp.clamav.net
Address: 203.212.42.128
Name: db.jp.clamav.net
Address: 218.44.253.75
Name: db.jp.clamav.net
Address: 219.94.128.99
The US list has some serious problems, too. Two sites with zero successes and each with 10 or more failures. Surely Cisco can do better than this. The internet runs on their hardware.
freshclam --list-mirrors |grep -B3 -A3 Failures:\ [12][0-9]
Mirror #4
IP: 209.198.147.20
Successes: 10
Failures: 12
Last access: Mon Mar 2 03:14:39 2015
Ignore: No
-------------------------------------
--
Mirror #6
IP: 78.46.84.244
Successes: 0
Failures: 25
Last access: Wed Mar 4 04:38:58 2015
Ignore: No
-------------------------------------
--
Mirror #12
IP: 65.19.179.67
Successes: 0
Failures: 23
Last access: Mon Feb 9 03:45:32 2015
Ignore: No
-------------------------------------
dp
Post by James Brown
Post by Benny Pedersen
Post by James Brown
Freshclam keeps failing for me. I delete the Mirrors.dat file and try
again. Sometime it works, sometimes it claims that all of the mirrors
are not synchronised.
freshclam --list-mirrors
try change mirror country temporary, but mirror admins would solve from the --list-mirrors
$ freshclam --list-mirrors
Mirror #1
IP: 193.1.193.64
Successes: 4
Failures: 2
Last access: Thu Mar 12 10:08:22 2015
Ignore: Yes
-------------------------------------
Mirror #2
IP: 117.104.160.194
Successes: 0
Failures: 2
Last access: Thu Mar 12 10:09:36 2015
Ignore: Yes
James.
_______________________________________________
https://github.com/vrtadmin/clamav-faq
http://www.clamav.net/contact.html#ml
_______________________________________________
https://github.com/vrtadmin/clamav-faq
http://www.clamav.net/contact.html#ml
_______________________________________________
Help us build a comprehensive ClamAV guide:
https://github.com/vrtadmin/clamav-faq

http://www.clamav.net/contact.html#ml

James Brown
2015-03-11 23:12:52 UTC
Permalink
OK, just deleted the Mirrors.dat file again and re-ran freshclam.

This time it managed to download the cdiff files, but fails on safe browsing.cvd:

$ sudo freshclam
Password:
ClamAV update process started at Thu Mar 12 10:07:04 2015
main.cvd is up to date (version: 55, sigs: 2424225, f-level: 60, builder: neo)
Downloading daily-20178.cdiff [100%]
Downloading daily-20179.cdiff [100%]
Downloading daily-20180.cdiff [100%]
Downloading daily-20181.cdiff [100%]
daily.cld updated (version: 20181, sigs: 1345679, f-level: 63, builder: neo)
Empty script safebrowsing-43085.cdiff, need to download entire database
nonblock_recv: recv timing out (30 secs)
WARNING: getfile: Error while reading database from db.AU.clamav.net (IP: 193.1.193.64): Operation now in progress
WARNING: Can't download safebrowsing.cvd from db.AU.clamav.net
Trying again in 5 secs...
ClamAV update process started at Thu Mar 12 10:07:51 2015
main.cvd is up to date (version: 55, sigs: 2424225, f-level: 60, builder: neo)
daily.cld is up to date (version: 20181, sigs: 1345679, f-level: 63, builder: neo)
Empty script safebrowsing-43085.cdiff, need to download entire database
nonblock_recv: recv timing out (30 secs)
WARNING: getfile: Error while reading database from db.AU.clamav.net (IP: 193.1.193.64): Operation now in progress
WARNING: Can't download safebrowsing.cvd from db.AU.clamav.net
Trying again in 5 secs...
ClamAV update process started at Thu Mar 12 10:08:28 2015
main.cvd is up to date (version: 55, sigs: 2424225, f-level: 60, builder: neo)
daily.cld is up to date (version: 20181, sigs: 1345679, f-level: 63, builder: neo)
Trying host db.AU.clamav.net (117.104.160.194)...
Empty script safebrowsing-43085.cdiff, need to download entire database
nonblock_recv: recv timing out (30 secs)
ERROR: getfile: Error while reading database from db.AU.clamav.net (IP: 117.104.160.194): Operation now in progress
ERROR: Can't download safebrowsing.cvd from db.AU.clamav.net
Giving up on db.AU.clamav.net...
ClamAV update process started at Thu Mar 12 10:09:03 2015
main.cvd is up to date (version: 55, sigs: 2424225, f-level: 60, builder: neo)
daily.cld is up to date (version: 20181, sigs: 1345679, f-level: 63, builder: neo)
Trying host database.clamav.net (117.104.160.194)...
Empty script safebrowsing-43085.cdiff, need to download entire database
nonblock_recv: recv timing out (30 secs)
ERROR: getfile: Error while reading database from database.clamav.net (IP: 117.104.160.194): Operation now in progress
ERROR: Can't download safebrowsing.cvd from database.clamav.net
Giving up on database.clamav.net...
Update failed. Your network may be down or none of the mirrors listed in /usr/local/etc/freshclam.conf is working. Check http://www.clamav.net/doc/mirrors-faq.html for possible reasons.

Thanks,

James.
_______________________________________________
Help us build a comprehensive ClamAV guide:
https://github.com/vrtadmin/clamav-faq

http://www.clamav.net/contact.html#ml
Loading...