You are basically correct, however PolyVox only uses a very small part of Boost (if C++0x is not present) and the parts that it does use are header-only. So there's no need to link against any of the Boost libraries. Also, one of our users seperted out the parts of Boost which are actually required, so you might find this useful:
http://www.thermite3d.org/phpBB3/viewtopic.php?f=2&t=99Note that the boost subset in that thread does not provide boost::function or boost::hash, but these are only used by the AStarPathfinder. If you don't use the AStarPathfinder you probably won't even notice they are missing.
Let me know if that works...