Research Log

A Batch Script for Hadoop on VMs

I've been benchmarking modifications to Hadoop in virtual machines lately, with others using the same server to benchmark their code. Paul suggested I should write a batch script we can use to run our benchmark jobs with the PBS batch scheduler, which is already set up on our server. The trickiness is that ideally we should not be running VMs when we're not using them, to avoid memory and cache contention. So, I wrote the following script, which starts the VMs, starts Hadoop, runs Hadoop commands from a file, shuts down Hadoop, and shuts down the VMs.

Organizing Papers on Linux

As I read papers, I try to keep an up-to-date bibliography. This is party to keep track of what I've read, and partly so that when I'm writing papers or my thesis later, I already have the bibliography ready to go. I used to do this by manually updating a BibTeX file as I went, but this is a bit onerous and not much fun.

After searching a bit, I found Mendeley, which is an online tool and desktop application for managing the papers you read and generating bibiographies as needed. It imports and generates BibTeX, lets you add papers by adding the PDF and letting it search Google Scholar for the title or by using a bookmarklet in your browser, and syncs between the website and the desktop application so you always have your bibliography and a copy of your papers available.

As an added bonus, it lets you hilight and annotate PDFs, which nothing else in Linux does very well. It's available for Mac, Windows, and Linux, plus the website works anywhere, so it's really quite handy.

Hello

Hi there. I'm Adam Wolfe Gordon, a masters student in Computing Science at the University of Alberta. My supervisor, Paul Lu, likes to say that there are three aspects to research: reading, thinking, and doing. Like (I suspect) many CS students, I'm best at the doing part: writing code, running experiments, etc. It's easy for reading and thinking to fall by the wayside, or go unrecorded.

That's what this website is for. I will try to take some time each week to update this with what I've been reading and thinking about, mostly for my own benefit. Enjoy!