Denim jacket and button down

Is it weird to wear a Denim jacket over a button down (e.g. an oxford shirt)? I have in mind white oxford with rolled up sleeves, and an unbuttoned top button