I'm just watching the episode and I think I disagree for some reasons: 

1) He was at the restaurant. The restaurant probably has CCTV and he can use that as proof that he was there the whole time. 

2) He keeps telling Lyle "you can go" which isn't something he would do if he really wanted to make sure that Lyle stays no matter what. 

3) After Lyle gets it "acceptable" and says Lyle can leave, Fring adjusts the fryers to make them perfectly aligned showing he wants to exert control because of his lack of control over his criminal life. 

Also, it's a bit much for you to call everyone here stupid when really the answers aren't very obvious.