It won't have a noticeable impact. Just wrap all your code in an if statement checking against the form ID:

<?php
function example_form_alter($form_id, &$form) {
  if ($form_id == 'the_form_id') {
    // Code goes here.
  }
}
?>