make user library compilation optional

We need some CMAKEList options to make it optional (as it implies some asm code in ARM for example)