Version 0.5.0 of brltty does no build on FC6.  To fix the build comment out 
#include <linux/compiler.h> in usb_linux.c

Also note the following requirements:
Pyrex is needed to build Python bindings
X-Window development libraries needed to build xw braille driver