Time Nick Message 14:13 pdurbin boegel: you around? 14:13 jgtimmer pdurbin: he's here 14:14 boegel boegel: I am 14:14 pdurbin i bet whorka will be un-idle in an hour or so. maybe you can explain a bit how easybuild might be helpful in deploying commercial apps 14:14 boegel pdurbin: I am :) 14:14 boegel pdurbin: sure 14:14 pdurbin (i mentioned easybuild at lunch yesterday) 14:15 boegel pdurbin: and how did they react? disbelief? :P 14:16 pdurbin heh. curious, i'd say 14:16 boegel sounds good 14:16 pdurbin do you even have generic build instructions for common commercial packages? 14:16 boegel pdurbin: I have a conf call scheduled in 45m, and I'll be leaving work in just over 2 hours, but let him ask his questions, I'll try and respond ASAP 14:17 boegel generic? well, once we support a certain package it's all very generic, yes 14:17 pdurbin oh, i don't think he's in a hurry. could wait until next week, next month :) 14:18 pdurbin huh. you have a page for this already, it seems: List of supported software packages ยท hpcugent/easybuild Wiki - https://github.com/hpcugent/easybuild/wiki/List-of-supported-software-packages 14:19 jgtimmer pdurbin: we have generic binary and tarred(packed binary) support, which will basically just unpack the binary and move it to the install dir, and then check for /bin /lib dirs and make the modulefile 14:20 jgtimmer we also compile some commercial software from source 14:20 pdurbin i don't see Mathematica, MATLAB or Stata on your list 14:20 jgtimmer we have an internal one for matlab, haven't open sourced it yet since it currently contains our license keys hardcoded 14:20 jgtimmer will have to fix this 14:21 pdurbin do you call it a matlab build script? 14:22 jgtimmer mathematica and stata are not on our systems no, so we're not planing to add it any time soon, but we'll glady accept pull request, and I can sponsor people into adding support 14:22 pdurbin hmm, easyconfig. easyblock maybe 14:22 pdurbin matlab sounds like a good place to start, if you can open source your easyconfig thing or whatever you call it 14:23 jgtimmer easyblock == build script/recipe, easyconfig == configuration 14:24 pdurbin thanks :) 14:29 pdurbin here's a list of candidates for easybuild: http://support.hmdc.harvard.edu/kb-1112/using_statistical_programs_overview 14:30 pdurbin but they have a good solution for open source apps 14:30 pdurbin i think easybuild might be a win for commercial apps though 14:30 jgtimmer pdurbin: https://github.com/hpcugent/easybuild/wiki/List-of-supported-software-packages/ede46976d7367a86fe76ae79adba7b8e9fd9f118 14:30 jgtimmer this is what we have internally 14:31 pdurbin cool 14:31 pdurbin i'm glad to see a * next to MATLAB :) 14:32 jgtimmer the ones that aren't in the current easybuild need to be checked out, they are written for our old internal easybuild version, before we did the cleanup/partial rewrite 14:33 pdurbin ok, i guess i'd say... please let us know when your matlab recipe is open source 14:33 jgtimmer http://pastebin.com/qx7fDV8c 14:33 jgtimmer here you go 14:33 pdurbin nice 14:34 jgtimmer but this is an old version, it doesn't use some of the new features of the framework yet (modulegenerator etc) and has old style function naming... 14:34 pdurbin and do we need to install atlas to use it? 14:34 pdurbin was it atlas? some big package and didn't compile with gcc or something 14:35 pdurbin that didn't compile, i mean 14:35 jgtimmer no, it just takes the install script and runs this. 14:35 jgtimmer hmm, wel, it seems to depend on java... 14:36 jgtimmer and we don't have java public yet either, I think we still used the system java at the time that was written :-s 14:36 pdurbin yeah, it was atlas: http://irclog.perlgeek.de/crimsonfu/2012-10-05#i_6039387 14:36 jgtimmer ah 14:36 jgtimmer no, it doesn't use any compiler at al 14:37 jgtimmer so you don't need the goalf toolkit 14:37 pdurbin great 14:38 jgtimmer actually we don't use it on our systems eiher 14:38 jgtimmer we use the intel compilers and mkl libraries 14:38 boegel pdurbin: getting support for what we have internally out there is usually a matter of cleaning up our easyblocks 14:39 jgtimmer we added the gcc/openmpi/atlas/fftw toolchainf to have a fully open source toolchain 14:39 boegel pdurbin: and only time is an issue there, time which we don't have :) 14:39 pdurbin :) 14:41 boegel pdurbin: if someone is interested in installing software with EasyBuild for which we have legagy support, we can supply them the old easyblock, and answer questions on how to make it work 14:45 pdurbin ok 14:47 boegel pdurbin: the best way is just to open a new issue in https://github.com/hpcugent/easybuild-easyblocks/issues?state=open, then we can let the person know whether we have legacy support for it or not 14:49 jgtimmer pdurbin: ATLAS builds with gcc, it just fails in a vm because it tries to do smart things with the cpu 14:50 pdurbin oh 14:50 boegel pdurbin: yeah, that was the issue in the log you sent me 14:50 boegel pdurbin: don't blame EasyBuild for that 14:50 pdurbin short memory. sorry. that's why i log this channel :) 14:51 boegel pdurbin: :) 14:53 jgtimmer I can look into adding a less heavy demo, e.g., just a plain python 14:54 pdurbin jgtimmer: that'd be great. put in in vagrant even :) 14:54 pdurbin it 14:56 boegel jgtimmer: the only reason why our current quick demo is heavy is the fact that it includes building a compiler toolchain (which is a one-time pain) 14:57 pdurbin i demand instant gratification 14:58 boegel pdurbin: https://github.com/hpcugent/easybuild/wiki/Getting-started 14:59 boegel pdurbin: the gzip dummy example easyconfig just builds gzip with your system compiler 14:59 boegel pdurbin: if you can make that fail, them you might as well change jobs :P 15:01 pdurbin i am changing jobs: https://twitter.com/philipdurbin/status/273229031082692608 15:02 boegel pdurbin: ah, well, ok, then you're allowed to screw up a gzip dummy build :P 15:03 pdurbin huh. this might be new. this example 15:05 jgtimmer yes, if the quick demo fails, you should read the getting-started and do step by step :-) 15:07 boegel_ pdurbin: I made some changes to that wiki page, but basically this gzip example has been on there for a while 15:07 boegel_ pdurbin: I'm gradually cleaning up documentation, I'm not fully there yet 15:09 jgtimmer pdurbin: are you aware of http://numfocus.org/ 15:09 pdurbin nope 15:09 jgtimmer they are a comunity looking into creating reproducible computing 15:10 jgtimmer data is a big part of that 15:10 jgtimmer the other part is recreating the software environment 15:11 pdurbin huh. sounds great 15:15 jgtimmer And I spoke to some people at continuum, and they were working on wakari, they plan to make a product for researchers to easily let other people redo their calculations 15:15 jgtimmer http://continuum.io/wakari.html 15:15 jgtimmer so might be a bit inline with what thedata.org wants to do 15:19 pdurbin jgtimmer: yes! sounds like it. thanks 15:22 jgtimmer congrats on your job btw 15:24 pdurbin thanks. one sec. you guys are gonna love this 15:29 pdurbin https://github.com/pdurbin/easybuild-vagrant 15:29 pdurbin boegel: gzip example works fine 15:32 jgtimmer pdurbin: 15:32 jgtimmer I'm not familiar with vagrant 15:33 jgtimmer what is that supposed to do? Install a vm whit environment modules in it 15:33 jgtimmer ? 15:33 pdurbin jgtimmer: http://wiki.greptilian.com/vagrant 15:34 pdurbin yes, demo of `eb /easyconfigs/gzip.eb` ultimately, in a VM 15:35 jgtimmer I noticed you skipped the step of installing environment modules, so they are already in your vm? 15:35 pdurbin no i didn't :) 15:35 jgtimmer ah, puppet 15:35 pdurbin https://github.com/pdurbin/easybuild-vagrant/blob/master/manifests/init.pp 15:35 jgtimmer I skipped that step 15:35 jgtimmer it went to fast 15:35 jgtimmer :-p 15:36 pdurbin oh? you got it to work already? 15:36 jgtimmer nono, when reading the readme 15:36 pdurbin ah :) 15:36 jgtimmer but it was just one line 15:37 boegel pdurbin: cool, thx 15:37 pdurbin well, please let me know if you get it to work 15:37 pdurbin boegel: sure. please give it a try 15:37 jgtimmer it's an easy way of testing easybuild under different OS'es 15:38 jgtimmer but what would be any other benefit? :-p 15:38 pdurbin marketing 15:38 pdurbin you could have it default to ubuntu and use centos instead by setting an enviroment variable: https://github.com/puppetlabs/puppetlabs-openstack_dev_env/blob/master/Vagrantfile 15:41 pdurbin it would be great if you guys would throw your matlab.eb in https://github.com/pdurbin/easybuild-vagrant/tree/master/easyconfigs test it, and let me know if `eb /easyconfigs/matalb.eb` works 15:42 pdurbin typo but you know what i mean, i hope 15:52 boegel pdurbin: that would require our matlab.py easyblock to be shipped in EasyBUild 15:53 pdurbin boegel: do you understand the value of that easybuild-vagrant repo? the idea is that it's an easy way for people to try out easybuild in a completely clean environment 15:53 pdurbin they can blow away the vm with `vagrant destroy` 15:54 pdurbin and run `vagrant up` to get it back 16:19 boegel pdurbin: https://github.com/hpcugent/easybuild-framework/issues/372 16:19 boegel pdurbin: I'll have to go, I may be online later tonight 16:20 boegel pdurbin: w.r.t. the guy(s) who had some questions, let them join #easybuild here on FreeNode, we might have someone there to answer the questions 16:20 boegel pdurbin: if not, tell them to use the bot and the !tell feature, that's always nice :) 16:20 boegel pdurbin: ttyl! 16:45 JoeJulian I read that wrong at first and was about to go to #easybuild to have the bot "!tell future" 16:47 pdurbin wouldn't that be nice 18:50 * pdurbin heads to a meeting with the gluster guys 18:51 semiosis cool 19:38 pdurbin gluster was inspired by gnu hurd! 19:38 pdurbin crimsonfubot: lucky gluster gnu hurd 19:38 crimsonfubot pdurbin: http://download.gluster.org/pub/gluster/glusterfs/LATEST/CentOS/epel-7/x86_64/repodata/primary.xml.gz 19:38 pdurbin bah 19:40 pdurbin "negative lookup cache" 19:40 pdurbin remember when we looked for something and didn't find it 19:42 pdurbin semiosis: they're singing your praises 19:42 pdurbin JoeJulian: you too 19:43 pdurbin huh. epel-7 ^^ 19:45 semiosis pdurbin: POIDH 19:45 pdurbin semiosis: huh? 19:45 semiosis hehe never mind 19:45 pdurbin :) 19:45 semiosis @lucky POIDH 19:45 crimsonfubot semiosis: http://www.urbandictionary.com/define.php?term=POIDH 19:59 pdurbin interesting that they plan to merge their tweaks to swift code back in 19:59 pdurbin westmaas: ^^ 20:03 pdurbin "An efficient WAN replication method with GlusterFS is to use the marker framework / queue using extended attributes to feed rsync a list of changed files, scales better than inotify" -- http://www.jebriggs.com/blog/2012/02/svlug-story-of-glusterfs/ 20:03 pdurbin i don't think i'd heard of the gluster "marker framework" 20:08 simmel What was the name of that distributed filesystem that recently was in the news? 20:09 simmel Ah, http://www.xtreemfs.org/ 20:09 pdurbin simmel: uh. gluster? :) 20:10 simmel Xtreemfs looks interesting. It's like AFS without the quirks. 20:10 pdurbin "XtreemFS is an open source distributed and replicated file system for the cloud" 20:10 pdurbin cool 20:11 simmel Would be awesome with Kerberos support for Xtreemfs but I guess it's only a matter of time before that is a reality. 20:30 pdurbin yeah 20:48 larsks Grrr, it's java based. 20:51 JoeJulian pdurbin: Nice of them to add to my already overly inflated ego. :D 20:54 JoeJulian wrt epel7 which leads me to rhel7: "On the desktop, RHEL 7 will also feature the GNOME 3 user experience, which will be new to RHEL users." I do not envy Red Hat's support staff. 21:31 pdurbin JoeJulian: huh. i guess you're quoting from this but it's from july: The Future of Red Hat Enterprise Linux 7 - http://www.serverwatch.com/server-trends/the-future-of-red-hat-enterprise-linux-7.html 21:31 pdurbin larsks: ask me in 6 months how i feel about java. gonna be staring at a lot of java soon 21:35 larsks pdurbin: My biggest complaint about Java is when I have something that will run under java 1.6.21 but not 1.6.20 or 1.6.22. Or something like that. Which I run into with alarming frequency. 21:36 larsks "WRITE ONCE RUN IN VERY SPECIFIC PLACES" 21:36 pdurbin heh 21:51 simmel My biggest issue with java is that all libs/products seldom have any or even remotely sane defaults. 22:01 semiosis +1 22:01 semiosis i call it 'insane by default' 22:02 semiosis larsks: that sounds awful. what could possibly change between those minor releases? 22:03 miah who cares about defaults. our job is to trash defaults and make shit awesome. 22:04 semiosis miah: spoken like a true java dev 22:04 miah i mean. how many people actually run a server with out of the box default configurations.