There are two ways to close a chat on Guest Chat when you are finished with it.
List of chats
In your list of open chats, click on the black tick next to the chat to Mark as Closed.
Inside the chat window
In your active chat window, click on the black tick next to the chat to Mark as Closed.