The country’s problems are not caused by people crossing the Channel, the Green Party’s Bedford candidate has said.