I think it can be useful to distinguish between open source and free software when you address this issue. Free software respects the 4 freedoms as published by the FSF. And one thing I recall being discussed there is the idea that you cannot stop certain users, such as the military, from using free software. The GPL specifies the only requirements for legally using free software, and any user who respects those requirements is legally licensed to use the software.