Conversation

coding shouldnt be this hard, it's unreasonable. i asked ppl 'how many ppl have u had sex with', fill-in-the-blank and all i want to do is delete everything that isnt within a specific numerical range in the dataframe's column You'd think this would be pretty simple. you'd think.

344

Aella

@Aella_Girl

its been two days of me trying to figure out how to do this intermittently between surges of emotional fury and i still have not figured it out. i thought i got it at one point but turns out idk what i did and can't recreate it. the color has gone out of my life.

10:48 PM · Oct 31, 2022

Replying to

it is absurd that humanity has somehow produced such a useful thing to learn that is so unlearnable

173

Replying to

Can you share the data file so we can help you out with the exact concise code that will make this work? You’re right, this is not hard and should not be difficult. There are many straightforward approaches, depending on how messy the input data is.

Replying to

and

I’ve been a Python trainer for most of my life so I can help explain to you why certain approaches are better than others, so you’ll have more context for your next data problem. You might also look at Datasette.io (

@simonw

says there’s a beta cloud ver?)

datasette.io

Datasette

Datasette is a tool for exploring and publishing data. It helps people take data of any shape, analyze and explore it, and publish it as an interactive website and accompanying API.

Replying to

Are you doing this in python ? Pandas?

Replying to

Good lord that sucks DM if u wanna get on a zoom call, show me your screen, and pair program thru this together

Replying to

Data analysis is the right kind for voice command. Hey py! Replace all values in column x greater than 10 with NaN. Wonder why there is nothing like that.

Replying to

You can clean up your data with no-code apps like Knime

Replying to

This is why you need source control even if you are the only person in the team. Check in with a meaningful comment every time you make progress and you will be able to recreate what you did. git and mercurial are free and popular. Long ago I used subversion at work.

Replying to

Why do I think there are some non traditional number inputs messing it all up?

Replying to

There are many ways to do this. You could first define the range of numbers in a numpy array, like: rng = np.arange(start, end) Then you can use Series.isin: data[column_name].Isin(rng) This will give you a boolean series that you can use to subset rows from your data.