DaemonForums  

Go Back   DaemonForums > NetBSD > NetBSD General

NetBSD General Other questions regarding NetBSD which do not fit in any of the categories below.

Reply
 
Thread Tools Display Modes
  #1   (View Single Post)  
Old 3rd February 2011
s0xxx's Avatar
s0xxx s0xxx is offline
Package Pilot
 
Join Date: May 2008
Posts: 192
Default [Link] Distributed compilation on NetBSD

A very nice article about getting compile time sped up by spreading work across multiple machines using distcc, and ccache. In this case it's two Sun SPARC machines running NetBSD sparc64, but it applies to multiple machines too.
Quote:
Distributed Compilation, Part I

Introduction

I have several old Sun machines, which are all still working fine, but partly lack performance of modern computers and/or RAM.

I usually install NetBSD on my computers, especially on those Sun-boxes. The advantage is that every machine has the same "look and feel", I know exactly what to do, etc. The downside is that for this kind of platform I have to use pkgsrc and build everything by myself, as the software I like to use is oftentimes not available as a pre-built binary, and besides that, I usually use special CFLAGS to tweak the performance of the software being built.

So, sitting in front of my new favorite toy, my Ultra-60, I was thinking about how I could probably speed up compilation timings. Looking around, and seeing several spare machines that were ready installed with a NetBSD 5.1, but switched off and doing nothing, I had the idea to create a compilation-cluster. I knew that there was already software available to achieve ths, called "distcc". All I needed to do, was to install it on every machine, read the man-pages a bit, and give it try.

...
http://blog.nifelheim.info/tech/2011...lation-part-i/
__________________
The best way to learn UNIX is to play with it, and the harder you play, the more you learn.
If you play hard enough, you'll break something for sure, and having to fix a badly broken system is arguably the fastest way of all to learn. -Michael Lucas, AbsoluteBSD
Reply With Quote
  #2   (View Single Post)  
Old 19th August 2011
s0xxx's Avatar
s0xxx s0xxx is offline
Package Pilot
 
Join Date: May 2008
Posts: 192
Default

There is a part two now, author has added one more machine, but now i386 (those two earlier were sun sparc), showing how cross-compiling is easily done:
Quote:
Distributed Compilation, Part II


As I wrote in my previous Post, "Distributed Compilation, Part I", the so far gained speed up of compilation times was significant, but it still took long.

The most obvious solution was to add more hosts to the list, but which hosts should that be? The Ultra-5 of course not, and all other Sun computers were slower and less well equipped (with the exception of the Ultra Enterprise 2), and each of them would add a significant amount to our power-consumption. There is however panther. The sleeping power of the dual-cored Atom 330 with enabled hyperthreading is well known from compiling NetBSD, which, starting from scratch until completion of a ready-to-burn ISO-image including Xorg, usually takes about 3.5-4.0 hours depending on the target-architecture and whether the toolstack has to be created first.

Panther would not add additional power-consumption (at least not significantly) to the overall-power-consumption, and was idle most of the time. The only problems were these two:
  • is cross-compilation possible at all?
  • how to get the cross-compiler working?

...
http://blog.nifelheim.info/tech/2011...ation-part-ii/
__________________
The best way to learn UNIX is to play with it, and the harder you play, the more you learn.
If you play hard enough, you'll break something for sure, and having to fix a badly broken system is arguably the fastest way of all to learn. -Michael Lucas, AbsoluteBSD
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
NetBSD on D-Link DIR-100/300/320 Lexus45 NetBSD General 3 1st February 2011 12:24 PM
[Link] Runnable Userspace Meta Programs in NetBSD 5.0 s0xxx NetBSD General 1 23rd May 2009 07:05 AM
Distributed Computing Programs JMJ_coder General software and network 0 25th November 2008 08:50 PM
kde .desktop file link doesn't act like a link when opening files caesius FreeBSD Ports and Packages 3 14th October 2008 07:35 AM
link: `libtheora_la-common.lo' is not a valid libtool object error during compilation pax FreeBSD Ports and Packages 2 29th July 2008 11:30 AM


All times are GMT. The time now is 03:00 AM.


Powered by vBulletin® Version 3.8.4
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Content copyright © 2007-2010, the authors
Daemon image copyright ©1988, Marshall Kirk McKusick