That is not true. They are tried in military courts when they are charged with violating the Uniform Code of Military Justice.

When they are tried for state crimes, they are charged in state court; municipal offenses, municipal court. Federal offenses (other than the UCMJ), federal court.

If they break the laws of your state, they can be charged and convicted in your state.