It is very easy to do. Here are the steps:
dir.create(Sys.getenv("R_LIBS_USER"), recursive = TRUE)
This will create a personal \Users\$user\My Documents\R\win-library\x.y for version x.y of R. It only needs to be run once, to make sure that the directory structure exists.
For those with a personal library (folder R\win-library\x.y of your
home directory, R\win64-library\x.y on 64-bit builds), you will
need to update that too when the minor version of R changes
(e.g. from 2.14.2 to 2.15.0). A simple way to do so is to copy
(say) R\win-library\2.14 to R\win-library\2.15 before running
update.packages(checkBuilt=TRUE, ask=FALSE).