It lloks like it may have been part of a pipe band uniform, I agree the cap badge is of WWII or Korean War vintage, the brass color matches the metal cantle on top and both obviously need polishing with good old Brasso.

If it is a US Army officer's cap badge it should have a screw post with a round knurled nut on the back.