The people knew Jesus was from Nazarath. The Christ was supposed to be born in Bethlehem. They did not realize that Jesus was born in Bethlehem. It is ironic that nobody asked Mary about this.

Source: John 7:41-43