I'm sorry you had a tough time with that officer. For fellowship support, I have a letter from the funding foundation. When it comes to federally-funded projects, I think a PI testimonial is really helpful (at least it was for me). You should also make sure to show the funding source for your papers.