The Blues currently sit in 6th place with five games left to play, but just three points above Arsenal who have three games in hand.
After this weekend’s 3-1 win over Burnley, which took the Blues to a run of eight home wins, Williams says there is a lot of confidence in the dressing room.
“All we can do is look after our own performances. Hopefully we are in that group of teams that are in the mix for those spots,” Williams told the club’s website.
“We have a lot of confidence and we are winning a lot of games. In that top six is where we want to be.
“But we know it is a difficult ask to push into that elite group. We are just trying to finish the season as strong as we can and as high as we can.”