Interviews with public-sector employers are, in some ways, different from interviews with other employers. (See a basic discussion of interviewing on the Career Office website.)
In general, it is important to show the employer that you understand what they do and that you want to contribute to their mission. Your answer to the question "why do you want to work HERE?" may determine whether you get the job.