Conversation

I am not sure how many more times I can be bitten by the case where None is a string in a Pandas dataframe and I try to subset using notnull(). I've spent an hour on this. Oh well. At least I found it. #pandas #pydata

JSON Baumgartner

@jasonbaumgartne

Replying to

@DataJunkie

So is there some strange behavior with pandas in how it treats the string "None" vs the None type? This would be good to know in case I ever fall into that rabbit hole. Thanks!

12:20 AM · Sep 21, 2018Twitter Web Client

Replying to

Yes. If you have a string column and the value None appears in it, it's actually a string not the standard None type so you have to use == and !=. notnull returns True!!

Replying to

👍 Thank you!