There's the formal process to follow which u can Google. In the mean time, you can just make it difficult living there such as fumigating the house repeatedly and doing some other creative ways involving the police that I'd rather not mention here.
Pretty much. Can't do anything without court injunction and that takes a long time to schedule and chances are, judges typically side with the tenant unless the tenant is a "bad" person - not paying rent doesn't cut it as bad. You'll need to execute the "creative" plan B to boot.