Hacker News new | past | comments | ask | show | jobs | submit
> This is a classic fallacy: that interview should look the same as the job.

I think I'm gonna get a stroke reading this. The classic fallacy is the nonsense you're spouting — that there's anything besides the job itself that is relevant to it. You're hiring people for x, so the only thing you care about is their ability to do x. This is obvious.

The perfect test is just hiring someone on the spot and seeing how they perform. We don't do this because it's expensive but obviously it would be the perfect test, measuring exactly what you're hiring for, by definition.

So then any test that goes further and further away from that ideal becomes worse and worse at predicting job performance. The trick is figuring out a good enough test that's still reasonably quick and cheap to do.

Deliberately going out of your way to test your canditates for something unrelated to the job is insanely stupid.

It's essentially just arrogance. Arrogantly asserting that you know for sure your particular "generic" test actually selects for ~all traits you want while also rejecting ~all traits you don't. I assure you, the chances of you having a good enough model of reality to do this are laughable. Pure arrogance.

Again, easiest to see by thinking of the opposite example to before — the worst test possible would of course be something completely unrelated, so idk, having a chef play ping-pong. I'm sure you could convincingly argue it tests something, but why in the world would you not just have him make a dish, since you know, that's what you're hiring him to do? (it's not actually by the way, now that's a classic fallacy — that the job is the mechanical subset of it and not the job as a whole. Soft skills, anyone? sigh).

I've seen someone suggesting that since a lot of programmers like playing Factorio, why not interview people by having them play Factorio? Ah, because then you're selecting for Factorio players. Do you have a good model of what makes a good Factorio player? Hell, do you have a good model of what makes a good performer at your job? You absolutely do not. Why select for Factorio players when you can select for your-job players?

Another common example of this utter arrogance is thinking that a candidate's performance during a highly stressful, unnatural, and artificial classic interview grilling environment is indicative of their perfomance in the every day feeling-secure-in-their-job state of mind. Oh, look, this fool I'm basically abusing from my position of power is stammering and squirming, must mean he's a good-for-nothing loser! Hah, another fraud found!

So sure, keep putting people in as much stress as possible and asking them how many golf balls fit in an airplane. BTW, I walk out of such interviews immediately. Have fun with your new Leetcode grinder performative actor hires though — you get what you test for.

> ...you get what you test for.

Multiple trillion dollar companies has not been that bad.