Mirroring Archlinux ARM?

Problems with packages? Post here, using [tags] of the package name.

Mirroring Archlinux ARM?

Postby xiaq » Fri Oct 21, 2011 6:14 pm

Hi all,
I had just installed Archlinux ARM on my Android smartphone and it feels awesome :D
Obviously the next thing I did was finding out a nearby mirror site. Viewing /etc/pacman.d/mirrorlist, there is apparently no mirror site at this moment.
Being a maintainer of a mirror site, I'm considering the possibility of mirroring archlinuxarm.org/arm. Is the site ready to be mirrored (eg. rsync service or like)?
(FYI the mirror site I'm maintaining is http://mirrors.tuna.tsinghua.edu.cn. I'm just one of the many maintainers.)
xiaq
 
Posts: 4
Joined: Fri Oct 21, 2011 6:01 pm

Re: Mirroring Archlinux ARM?

Postby macau » Fri Oct 21, 2011 6:53 pm

some mirrors must be cool. rom me dl speed 60kb\s too slow
macau
 
Posts: 40
Joined: Thu Jul 21, 2011 6:43 am

Re: Mirroring Archlinux ARM?

Postby WarheadsSE » Fri Oct 21, 2011 8:08 pm

Due to the nature of our packaging system, and frequent automatic updates, there are consideration beyond a simple rsync.

See kmheilich (leming) & WarheadsSE (whse/WarheadsSE) in IRC
Core Developer
Remember: Arch Linux ARM is entirely community donation supported!
WarheadsSE
Developer
 
Posts: 6807
Joined: Mon Oct 18, 2010 2:12 pm

Re: Mirroring Archlinux ARM?

Postby xiaq » Sat Oct 22, 2011 5:30 am

$this->bbcode_second_pass_quote('WarheadsSE', 'D')ue to the nature of our packaging system, and frequent automatic updates, there are consideration beyond a simple rsync.

See kmheilich (leming) & WarheadsSE (whse/WarheadsSE) in IRC


But the practice of providing rsync service for mirroring is well established. Almost all kinds of repositories support that, including Archlinux's repository, of which [testing] is quite volatile.
xiaq
 
Posts: 4
Joined: Fri Oct 21, 2011 6:01 pm

Re: Mirroring Archlinux ARM?

Postby WarheadsSE » Sat Oct 22, 2011 5:44 pm

We're almost done with the complete v7h rebuild, and there are a few minor tidbits to finish up, then we'll have the whole system available.

The only major difference that may come along is signed packages in the semi-near future.
Core Developer
Remember: Arch Linux ARM is entirely community donation supported!
WarheadsSE
Developer
 
Posts: 6807
Joined: Mon Oct 18, 2010 2:12 pm

Re: Mirroring Archlinux ARM?

Postby xiaq » Sun Oct 23, 2011 5:59 am

$this->bbcode_second_pass_quote('WarheadsSE', 'W')e're almost done with the complete v7h rebuild, and there are a few minor tidbits to finish up, then we'll have the whole system available.

The only major difference that may come along is signed packages in the semi-near future.


I may likely have missed something, but how would that affect mirroring? Will the repository become ready to be mirrored once those minor tidbits have been finished?
xiaq
 
Posts: 4
Joined: Fri Oct 21, 2011 6:01 pm

Re: Mirroring Archlinux ARM?

Postby kmihelich » Mon Oct 24, 2011 12:06 am

Talking with others previously we decided against rsync in favor of an extension to our build system that would distribute packages to mirrors as they were built. This has the benefit of having instant updates to mirrors, and allows us to actually know that mirrors are up to date.

Though I am considering rsync again, just for simplicity. You're looking at around 15-20GB for the v5 and v7 repos combined. If you could tell me more about what resources you have that would be helpful.
Arch Linux ARM exists and continues to grow through community support, please donate today!
kmihelich
Developer
 
Posts: 1133
Joined: Tue Jul 20, 2010 6:55 am
Location: aka leming #archlinuxarm

Re: Mirroring Archlinux ARM?

Postby pepedog » Mon Oct 24, 2011 12:16 am

Curiosity,
What if one mirror is down when something is to be uploaded, does it catch up later?
pepedog
Developer
 
Posts: 2431
Joined: Mon Jun 07, 2010 3:30 pm
Location: London UK

Re: Mirroring Archlinux ARM?

Postby WarheadsSE » Mon Oct 24, 2011 12:40 am

Yes, the system we have designed will have the out-of-date mirror pickup from where it left off.
Core Developer
Remember: Arch Linux ARM is entirely community donation supported!
WarheadsSE
Developer
 
Posts: 6807
Joined: Mon Oct 18, 2010 2:12 pm

Re: Mirroring Archlinux ARM?

Postby xiaq » Wed Dec 14, 2011 4:58 am

$this->bbcode_second_pass_quote('kmihelich', 'T')alking with others previously we decided against rsync in favor of an extension to our build system that would distribute packages to mirrors as they were built. This has the benefit of having instant updates to mirrors, and allows us to actually know that mirrors are up to date.

Though I am considering rsync again, just for simplicity. You're looking at around 15-20GB for the v5 and v7 repos combined. If you could tell me more about what resources you have that would be helpful.
:

Sorry for being missing since then (I had too much on my hand and forgot the mirroring I proposed completely...)

Rsync can be set up to push, and that is precisely what you are talking about. Our mirror server has ~1TB spare disk space, so 15~20GB is no problem. As you can see at http://mirrors.tuna.tsinghua.edu.cn/, we mirror Debian, which is well over 200GB. We even do that by using naive rsync pull.
xiaq
 
Posts: 4
Joined: Fri Oct 21, 2011 6:01 pm
Top

Next

Return to Packages

Who is online

Users browsing this forum: No registered users and 7 guests